00010000:00010000:1.0:1789996914.280353:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013230132/0x65b43101d592ac6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae701 expref: 7 pid: 6659 timeout: 1202 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.280395:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013230132/0x65b43101d592ac6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae701 expref: 7 pid: 6659 timeout: 1202 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.280417:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996914.280422:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996914.280427:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.280436:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.280458:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996914.280503:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704299008:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 199us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996914.280511:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 254 00000100:00080000:1.0:1789996914.280531:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789996914.280983:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.280995:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.281006:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.281025:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.281108:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789996914.282932:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712816384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41431us (41619us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789996914.282943:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00010000:00010000:1.0:1789996914.282975:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996914.282982:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.283009:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996914.283013:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.283024:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.283042:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.283050:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592ac8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996914.283069:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996914.283079:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996914.283080:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996914.443836:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789996915.234109:0:56198:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec4efd910 20000000:00000080:1.0:1789996915.234126:0:56198:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c7d1a800 uarg=0000000000000000 00010000:00010000:1.0:1789996915.235016:0:56198:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789996915.235050:0:56198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x19:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789996915.235054:0:56198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789996915.235065:0:56198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592ac17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x19:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae6e5 expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.235087:0:56198:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789996915.235103:0:56198:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789996915.235117:0:56198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ac95 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 56198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.235129:0:56198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592abfb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592abf4 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.235137:0:56198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ac95 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 56198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.235172:0:56198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592abfb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592abf4 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.235186:0:56198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592abfb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592abf4 expref: 18 pid: 5803 timeout: 1253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996915.235199:0:56198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56198:1876946712816640:0@lo:104: 00000100:00100000:1.0:1789996915.235257:0:56198:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996915.235384:0:56198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61240 going to sleep for 11 seconds 00010000:00010000:1.0:1789996915.236997:0:56198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592abfb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592abf4 expref: 18 pid: 5803 timeout: 1253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996915.237011:0:56198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:56198:1876946712816640:0@lo:104: 00010000:00010000:1.0:1789996915.237026:0:56198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ac95 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.237035:0:56198:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ac95 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.237042:0:56198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ac95 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.237048:0:56198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ac95 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996915.471384:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996916.492855:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996917.514918:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996918.040378:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996918.040421:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996918.040464:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996918.040800:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996918.040829:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704299520 00000100:00100000:1.0:1789996918.040839:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704299520 00000100:00100000:1.0:1789996918.040892:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704299392 00000100:00100000:1.0:1789996918.040895:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704299392 00000100:00100000:1.0:1789996918.040919:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 373 00000100:00100000:1.0:1789996918.040928:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704299520:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996918.041022:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704299520:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 93us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996918.041031:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 373 00000100:00100000:1.0:1789996918.041048:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 374 00000100:00100000:1.0:1789996918.041054:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704299392:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996918.041079:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704299392:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996918.041085:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 374 00000100:00100000:1.0:1789996918.041103:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704299136 00000100:00100000:1.0:1789996918.041107:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704299136 00000100:00100000:1.0:1789996918.041132:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 741 00000100:00100000:1.0:1789996918.041138:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704299136:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996918.041173:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704299136:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996918.041180:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 741 00010000:00010000:1.0:1789996918.538796:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996918.832717:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000001:00080000:1.0:1789996918.905426:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00010000:00010000:1.0:1789996919.566100:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996919.799642:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996919.799690:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c73e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712818176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996919.799760:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996919.805425:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c73e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712818176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996920.587838:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996921.293030:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712818688 00000100:00100000:1.0:1789996921.293041:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712818688 00000100:00100000:1.0:1789996921.293075:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712818816 00000100:00100000:1.0:1789996921.293078:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712818816 00000100:00100000:1.0:1789996921.293099:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789996921.293105:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712818688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996921.293146:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712818688:12345-0@lo:400:kworker.0 Request processed in 41us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996921.293152:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789996921.293164:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789996921.293169:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712818816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996921.293212:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712818816:12345-0@lo:400:kworker.0 Request processed in 43us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996921.293218:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789996921.293257:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712818688:0@lo:400:kworker.0 00000100:00100000:1.0:1789996921.293282:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712818816:0@lo:400:kworker.0 00000100:00100000:1.0:1789996923.158845:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704300160 00000100:00100000:1.0:1789996923.158850:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704300160 00000100:00100000:1.0:1789996923.158884:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 744 00000100:00100000:1.0:1789996923.158891:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704300160:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996923.158935:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704300160:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996923.158942:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 744 00000100:00100000:1.0:1789996923.184279:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704300416 00000100:00100000:1.0:1789996923.184293:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704300416 00000100:00100000:1.0:1789996923.184539:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704300544 00000100:00100000:1.0:1789996923.184543:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704300544 00000100:00100000:1.0:1789996923.189559:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 377 00000100:00100000:1.0:1789996923.189573:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704300544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996923.189678:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704300544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 107us (11416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996923.189686:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 377 00000100:00100000:1.0:1789996923.339861:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712819200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996923.339937:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996923.343431:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712819200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996923.661687:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996924.690085:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789996924.690102:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712819456 00000100:00100000:1.0:1789996924.690109:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712819456 00000100:00100000:1.0:1789996924.690176:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789996924.690187:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d8e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:56643:x1876946712819456:12345-0@lo:104: 00010000:00010000:1.0:1789996924.690203:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592acc6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592accd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.690267:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996924.690274:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d8e83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:56643:x1876946712819456:12345-0@lo:104: Request processed in 89us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996924.690281:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789996924.691518:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712819584 00000100:00100000:1.0:1789996924.691524:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712819584 00010000:00010000:1.0:1789996924.691550:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592accd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592acc6 expref: 19 pid: 5803 timeout: 1263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996924.691584:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789996924.691598:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712819584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996924.691609:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996924.691614:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0a00/0x65b43101d592accd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592acc6 expref: 19 pid: 5803 timeout: 1263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691625:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592accd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592acc6 expref: 19 pid: 5803 timeout: 1263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691637:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592accd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592acc6 expref: 19 pid: 5803 timeout: 1263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691678:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691687:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691702:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691709:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691716:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691722:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691728:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996924.691732:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691746:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691758:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a200/0x65b43101d592acf0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 56643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996924.691766:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996924.693114:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712819584:12345-0@lo:103:ldlm_bl.0 Request processed in 1511us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996924.693126:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789996926.415997:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712819840:0@lo:400:kworker.0 00000100:00100000:1.0:1789996926.416076:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996926.420183:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712819840 00000100:00100000:1.0:1789996926.420191:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712819840 00000100:00100000:1.0:1789996926.420229:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1789996926.420238:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712819840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996926.420299:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712819840:12345-0@lo:400:kworker.0 Request processed in 62us (4222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996926.420306:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:1.0:1789996926.420348:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712819840:0@lo:400:kworker.0 00000100:00100000:1.0:1789996928.459055:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996928.466005:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712820608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996928.466548:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789996928.481590:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789996928.779850:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996929.808933:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712821120 00000100:00100000:1.0:1789996929.808959:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712821120 00000100:00100000:1.0:1789996929.809079:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1789996929.809090:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712821120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996929.809104:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996929.809119:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ad28 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ad21 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996929.809145:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ad28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ad21 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996929.809157:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ad28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ad21 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996929.809167:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789996929.809233:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712821120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996929.809241:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00010000:00010000:1.0:1789996931.850862:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996932.013505:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996932.022408:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996932.042897:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996932.135069:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996932.150134:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704302976 00000100:00100000:1.0:1789996932.150145:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704302976 00000100:00100000:1.0:1789996932.150200:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 178 00000100:00100000:1.0:1789996932.150210:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:34131:x1876946704302976:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789996932.150239:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996932.150262:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592ad75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae72b expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996932.150307:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789996932.150329:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=1120s v=(0 0) 00010000:00010000:1.0:1789996932.150334:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996932.150343:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592ad75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae72b expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996932.150361:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592ad75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae72b expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996932.150375:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789996932.150441:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:34131:x1876946704302976:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 232us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996932.150449:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 178 00000100:00100000:1.0:1789996932.172030:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996932.222581:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000001:00080000:1.0:1789996932.247170:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967440 is committed 00000100:00100000:1.0:1789996932.249633:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996932.287895:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000001:00080000:1.0:1789996933.525864:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000100:00100000:1.0:1789996933.584789:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996933.584812:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712822144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996933.584889:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996933.585398:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712822144:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789996934.840298:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 31 committed 00000004:00080000:1.0:1789996934.843227:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 32 committed 00010000:00010000:1.0:1789996934.923863:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996936.226311:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704304256 00000100:00100000:1.0:1789996936.226329:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704304256 00000100:00100000:1.0:1789996936.226402:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 357 00000100:00100000:1.0:1789996936.226413:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:34325:x1876946704304256:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789996936.226517:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:34325:x1876946704304256:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 105us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996936.226524:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 357 00000100:00100000:1.0:1789996936.232093:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:1.0:1789996936.232767:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996936.235847:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704304640 00000100:00100000:1.0:1789996936.235858:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704304640 00000100:00100000:1.0:1789996936.236071:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 358 00000100:00100000:1.0:1789996936.236083:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:34325:x1876946704304640:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789996936.236608:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:34325:x1876946704304640:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 526us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996936.236617:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 358 00000100:00100000:1.0:1789996936.270956:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996936.340601:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:1.0:1789996936.346267:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996936.346274:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ad91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996936.346281:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996936.346284:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ad91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996936.346291:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ad91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996936.346308:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:1.0:1789996936.346310:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789996936.346313:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ad91 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996936.346318:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ad91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996936.346331:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996936.346332:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996936.346334:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996936.972012:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996938.521804:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996938.521847:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996938.522024:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996938.522104:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996938.707832:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712823424 00000100:00100000:1.0:1789996938.707842:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712823424 00000100:00100000:1.0:1789996938.707902:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789996938.707912:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712823424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996938.707950:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789996938.708003:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712823424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996938.708010:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789996938.708069:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712823424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996939.023678:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996941.777743:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712823808:0@lo:400:kworker.0 00000100:00100000:1.0:1789996941.777844:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996941.777888:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789996941.777898:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712823680:0@lo:400:kworker.0 00000100:00100000:1.0:1789996941.777922:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996941.777941:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712824192:0@lo:400:kworker.0 00000100:00100000:1.0:1789996941.777961:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996941.778628:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712823808 00000100:00100000:1.0:1789996941.778637:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712823808 00000100:00100000:1.0:1789996941.778783:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712823680 00000100:00100000:1.0:1789996941.778788:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712823680 00000100:00100000:1.0:1789996941.778821:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1789996941.778831:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712823808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996941.778898:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712823808:12345-0@lo:400:kworker.0 Request processed in 68us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996941.778906:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1789996941.778923:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712824192 00000100:00100000:1.0:1789996941.778927:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712824192 00000100:00100000:1.0:1789996941.778952:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789996941.778957:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712823680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996941.778988:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712823680:12345-0@lo:400:kworker.0 Request processed in 30us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996941.778994:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789996941.779004:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1789996941.779011:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712824192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996941.779187:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712824192:12345-0@lo:400:kworker.0 Request processed in 176us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996941.779208:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00080000:1.0:1789996941.779342:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996941.779509:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712823680:0@lo:400:kworker.0 00000100:00100000:1.0:1789996941.779525:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712824192:0@lo:400:kworker.0 00000100:00100000:1.0:1789996941.779538:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712823808:0@lo:400:kworker.0 00010000:00010000:1.0:1789996942.096335:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996943.645293:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704306304 00000100:00100000:1.0:1789996943.645299:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704306304 00000100:00100000:1.0:1789996943.645362:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 805 00000100:00100000:1.0:1789996943.645370:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704306304:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996943.645414:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704306304:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996943.645422:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 805 00000100:00080000:1.0:1789996943.825995:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789996945.164299:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996948.235696:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996948.764882:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704307072 00000100:00100000:1.0:1789996948.764892:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704307072 00000100:00100000:1.0:1789996948.764963:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704306944 00000100:00100000:1.0:1789996948.764967:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704306944 00000100:00100000:1.0:1789996948.764994:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 395 00000100:00100000:1.0:1789996948.765005:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704307072:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996948.765074:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704307072:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996948.765454:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 395 00000100:00100000:1.0:1789996948.939282:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712825472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996948.939328:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789996951.306871:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996952.011332:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712825600:0@lo:400:kworker.0 00000100:00100000:1.0:1789996952.011367:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996952.012877:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb493b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712826112:0@lo:400:kworker.0 00000100:00100000:1.0:1789996952.012925:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996952.012975:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1789996952.012988:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712825856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996952.022935:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712825856:12345-0@lo:400:kworker.0 Request processed in 9940us (10210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996952.022962:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1789996952.159813:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704307584 00000100:00100000:1.0:1789996952.159824:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704307584 00000100:00100000:1.0:1789996952.159960:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 363 00000100:00100000:1.0:1789996952.159973:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:34506:x1876946704307584:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789996952.160502:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:34506:x1876946704307584:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 531us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996952.160511:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 363 00000100:00100000:1.0:1789996952.183326:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704307968 00000100:00100000:1.0:1789996952.183338:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704307968 00000100:00100000:1.0:1789996952.183408:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 188 00000100:00100000:1.0:1789996952.183420:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:34506:x1876946704307968:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789996952.183832:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:34506:x1876946704307968:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 413us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996952.183850:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 188 00010000:00010000:1.0:1789996953.361940:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996953.783234:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996953.783241:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ad21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ad28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.783248:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789996953.783252:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ad21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ad28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.783261:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ad21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ad28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996953.783270:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ad21 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ad28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996953.783276:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789996953.783323:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ad21 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ad28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.783330:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996953.783350:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ad21 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ad28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.783357:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ad21 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ad28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.783383:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996953.783385:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996953.783386:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996953.783907:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712826496 00000100:00100000:1.0:1789996953.783912:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712826496 00010000:00010000:1.0:1789996953.783932:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ad28 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ad21 expref: 19 pid: 5805 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996953.783960:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789996953.783968:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712826496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996953.783978:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996953.783983:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ad28 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ad21 expref: 19 pid: 5805 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.783991:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ad28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ad21 expref: 19 pid: 5805 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784004:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ad28 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ad21 expref: 19 pid: 5805 timeout: 1292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784016:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784024:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784037:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784045:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784052:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784070:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784075:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996953.784079:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784086:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784097:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592add0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996953.784106:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996953.784142:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712826496:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996953.784149:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789996953.784178:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712826496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996953.877989:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996953.878022:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996953.878039:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996953.878081:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996953.878207:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704309504 00000100:00100000:1.0:1789996953.878217:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704309504 00000100:00100000:1.0:1789996953.878262:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704309632 00000100:00100000:1.0:1789996953.878266:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704309632 00000100:00100000:1.0:1789996953.878291:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 399 00000100:00100000:1.0:1789996953.878302:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704309504:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996953.878388:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704309504:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996953.878395:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 399 00000100:00100000:1.0:1789996953.878411:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 400 00000100:00100000:1.0:1789996953.878417:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704309632:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996953.878437:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704309632:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 21us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996953.878452:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 400 00000100:00100000:1.0:1789996954.059792:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712826624 00000100:00100000:1.0:1789996954.059800:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712826624 00000100:00100000:1.0:1789996954.059853:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712826752 00000100:00100000:1.0:1789996954.059856:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712826752 00000100:00100000:1.0:1789996954.059874:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1789996954.059884:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712826624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996954.059917:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996954.059969:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712826624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996954.059976:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1789996954.059997:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1789996954.060006:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712826752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996954.060026:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996954.060061:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712826752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996954.060067:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000001:00080000:1.0:1789996954.106266:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000100:00100000:1.0:1789996957.132475:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712827008:0@lo:400:kworker.0 00000100:00100000:1.0:1789996957.138892:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996957.138944:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712827520:0@lo:400:kworker.0 00000100:00100000:1.0:1789996957.139064:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789996957.139916:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996957.139946:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712827008:0@lo:400:kworker.0 00000100:00100000:1.0:1789996957.139958:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712827520:0@lo:400:kworker.0 00000100:00100000:1.0:1789996958.931507:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712827776 00000100:00100000:1.0:1789996958.931515:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712827776 00000100:00100000:1.0:1789996958.931611:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789996958.931621:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:57692:x1876946712827776:12345-0@lo:104: 00010000:00010000:1.0:1789996958.931635:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592add7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592adde expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996958.931725:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996958.931731:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:57692:x1876946712827776:12345-0@lo:104: Request processed in 112us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996958.931737:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789996959.185288:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712828032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996959.185355:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996959.185681:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712828032 00000100:00100000:1.0:1789996959.189215:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712828032 00000100:00100000:1.0:1789996959.189303:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712828160 00000100:00100000:1.0:1789996959.189310:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712828160 00000100:00100000:1.0:1789996959.189335:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789996959.189346:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712828032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996959.189399:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996959.189498:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712828032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996959.189506:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789996959.189524:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789996959.189532:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712828160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996959.189552:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996959.189587:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712828160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996959.189593:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00080000:1.0:1789996959.189814:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789996959.189819:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996959.189859:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712828032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996959.192872:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712828160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996960.524155:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996960.715185:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712828288 00000100:00100000:1.0:1789996960.715195:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712828288 00000100:00100000:1.0:1789996960.715253:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:1.0:1789996960.715264:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712828288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996960.715277:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996960.715291:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592adfa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592adf3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996960.715314:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592adfa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592adf3 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996960.715341:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592adfa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592adf3 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996960.715349:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789996960.715399:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712828288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996960.715405:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:1.0:1789996962.251996:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712828544:0@lo:400:kworker.0 00000100:00100000:1.0:1789996962.252063:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996962.252109:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712829056:0@lo:400:kworker.0 00000100:00100000:1.0:1789996962.252131:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996962.252152:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996962.252158:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712828672:0@lo:400:kworker.0 00000100:00100000:1.0:1789996962.252178:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996962.252879:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712828800 00000100:00100000:1.0:1789996962.252885:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712828800 00000100:00100000:1.0:1789996962.252932:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712828928 00000100:00100000:1.0:1789996962.252935:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712828928 00000100:00100000:1.0:1789996962.252955:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789996962.252962:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712828800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996962.252999:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712828800:12345-0@lo:400:kworker.0 Request processed in 38us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996962.253005:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789996962.253017:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789996962.253023:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712828928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996962.253062:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712828928:12345-0@lo:400:kworker.0 Request processed in 39us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996962.253069:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789996962.785306:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996962.785338:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996962.849062:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:1.0:1789996962.858931:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ae94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996962.858947:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ae94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996962.858955:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ae94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996962.858961:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996962.858965:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ae94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996962.858973:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ae94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996962.859005:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:1.0:1789996962.859008:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789996962.859014:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ae94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996962.859020:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ae94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567555:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996963.567567:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592adf3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592adfa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567574:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789996963.567578:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592adf3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592adfa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567587:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592adf3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592adfa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996963.567594:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592adf3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592adfa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996963.567600:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789996963.567642:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592adf3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592adfa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567650:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996963.567708:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592adf3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592adfa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567716:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592adf3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592adfa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567731:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996963.567732:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996963.567734:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996963.567752:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712829312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996963.567782:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996963.567821:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712829312 00000100:00100000:1.0:1789996963.567831:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712829312 00010000:00010000:1.0:1789996963.567851:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592adfa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592adf3 expref: 19 pid: 5805 timeout: 1302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996963.567872:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789996963.567878:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712829312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996963.567888:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996963.567893:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592adfa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592adf3 expref: 19 pid: 5805 timeout: 1302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567903:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592adfa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592adf3 expref: 19 pid: 5805 timeout: 1302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567918:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567926:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567940:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567947:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567955:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567961:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567967:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996963.567976:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567984:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.567993:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592ae9b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 57937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996963.568002:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996963.568044:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712829312:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996963.568051:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789996963.568091:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712829312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996964.303623:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712829440 00000100:00100000:1.0:1789996964.303631:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712829440 00000100:00100000:1.0:1789996964.303707:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789996964.303715:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb2aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712829440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996964.303749:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996964.304056:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb2aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712829440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 340us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996964.304064:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789996964.305563:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712829568 00000100:00100000:1.0:1789996964.305569:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712829568 00000100:00100000:1.0:1789996964.305622:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789996964.305630:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712829568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996964.305670:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996964.305722:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712829568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996964.305740:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789996964.305776:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712829568:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789996964.305795:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996965.264473:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0ccdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996965.264525:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712829696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996965.264545:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996965.264556:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996965.264591:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789996965.264597:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996965.264605:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996965.642851:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996967.526771:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996967.526805:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704312960 00000100:00100000:1.0:1789996967.526815:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704312960 00000100:00100000:1.0:1789996967.526887:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00100000:1.0:1789996967.526898:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704312960:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996967.526913:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996967.526916:0:5796:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592ae71) 00010000:00010000:1.0:1789996967.526918:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996967.526979:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704312960:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 82us (218us total) trans 0 rc 116/116 00000100:00100000:1.0:1789996967.526987:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 7 00000100:00080000:1.0:1789996967.527008:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789996968.715981:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996969.243491:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996969.243536:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996969.243565:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996969.243596:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996969.243623:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704313472 00000100:00100000:1.0:1789996969.243633:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704313472 00000100:00100000:1.0:1789996969.243720:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704313344 00000100:00100000:1.0:1789996969.243723:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704313344 00000100:00100000:1.0:1789996969.243748:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 411 00000100:00100000:1.0:1789996969.243758:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704313472:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996969.243828:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704313472:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996969.243835:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 411 00000100:00100000:1.0:1789996969.243851:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 412 00000100:00100000:1.0:1789996969.243858:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704313344:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996969.243879:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704313344:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 22us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996969.243885:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 412 00000100:00080000:1.0:1789996969.243903:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789996969.243907:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996969.244829:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996969.258730:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712830592 00000100:00100000:1.0:1789996969.258744:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712830592 00000100:00100000:1.0:1789996969.258794:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789996969.258803:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:58231:x1876946712830592:12345-0@lo:104: 00010000:00010000:1.0:1789996969.258816:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996969.258877:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996969.258883:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:58231:x1876946712830592:12345-0@lo:104: Request processed in 82us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996969.258890:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00010000:0.0:1789996969.258969:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789996969.258979:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.258988:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789996969.258994:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996969.259000:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789996969.259034:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259040:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789996969.259062:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259069:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592aea9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592aeb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259083:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996969.259084:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996969.259086:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996969.259098:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712830720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789996969.259128:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996969.259169:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712830720 00000100:00100000:0.0:1789996969.259173:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712830720 00010000:00010000:0.0:1789996969.259192:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b600/0x65b43101d592aeb0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592aea9 expref: 19 pid: 5803 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996969.259211:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789996969.259224:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712830720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789996969.259234:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996969.259240:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b600/0x65b43101d592aeb0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592aea9 expref: 19 pid: 5803 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259249:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b600/0x65b43101d592aeb0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592aea9 expref: 19 pid: 5803 timeout: 1307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259276:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259285:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259300:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259306:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259313:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259320:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259325:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789996969.259329:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259337:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259353:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592aeb7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58231 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996969.259361:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996969.259389:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712830720:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996969.259396:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789996969.259434:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712830720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996969.425877:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712830848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996969.425969:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996969.426483:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712830848 00000100:00100000:1.0:1789996969.426494:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712830848 00000100:00100000:1.0:1789996969.426557:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1789996969.426568:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712830848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996969.426608:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996969.426686:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712830848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996969.426694:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00080000:1.0:1789996969.426826:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996969.426874:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712830848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996969.428079:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712830976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996969.428436:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789996970.762855:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789996970.890826:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789996970.890834:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789996970.890928:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789996970.890972:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996970.890995:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996970.891008:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996970.891032:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712831104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996970.891118:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996970.891164:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789996971.788687:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996971.956400:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704313728 00000100:00100000:1.0:1789996971.956410:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704313728 00000100:00100000:1.0:1789996971.956626:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 380 00000100:00100000:1.0:1789996971.956637:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:34878:x1876946704313728:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789996971.956812:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996971.956845:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592aeda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae771 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.956907:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.956921:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.956932:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.956992:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957008:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957015:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957414:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592aeef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957424:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592aeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957431:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592aeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996971.957923:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1789996971.957927:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996971.957944:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592aeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957957:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957963:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957969:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957974:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996971.957978:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.957991:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958002:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:1.0:1789996971.958005:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996971.958010:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958015:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592aee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958025:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958031:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958037:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958042:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996971.958045:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958051:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958058:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38e062d500) 00010000:00010000:1.0:1789996971.958061:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996971.958064:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958080:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592aee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958114:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592aeda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae771 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958126:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592aeef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae771 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.958133:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789996971.958135:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789996971.958138:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789996971.958199:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:34878:x1876946704313728:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 1564us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996971.958207:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 380 00000100:00100000:1.0:1789996971.973954:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704313984 00000100:00100000:1.0:1789996971.973963:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704313984 00000100:00100000:1.0:1789996971.974108:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 381 00000100:00100000:1.0:1789996971.974119:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:34878:x1876946704313984:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789996971.974174:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996971.974200:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592aeef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae771 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.974230:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789996971.974241:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996971.974269:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592aef6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.974295:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592aef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996971.974306:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592aef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996972.024225:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967450 is committed 00000100:00100000:1.0:1789996972.490872:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712831232:0@lo:400:kworker.0 00000100:00100000:1.0:1789996972.490962:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996972.491030:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712831744:0@lo:400:kworker.0 00000100:00100000:1.0:1789996972.491065:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996972.491230:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712831616 00000100:00100000:1.0:1789996972.491241:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712831616 00000100:00100000:1.0:1789996972.491308:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712831744 00000100:00100000:1.0:1789996972.491312:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712831744 00000100:00100000:1.0:1789996972.491341:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789996972.491352:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712831616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996972.491456:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712831616:12345-0@lo:400:kworker.0 Request processed in 106us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996972.491465:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789996972.491484:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789996972.491491:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712831744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996972.491524:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712831744:12345-0@lo:400:kworker.0 Request processed in 34us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996972.491530:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789996972.491568:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712831744:0@lo:400:kworker.0 00000100:00100000:1.0:1789996972.491749:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712831232:0@lo:400:kworker.0 00000100:00100000:1.0:1789996972.491979:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712831488:0@lo:400:kworker.0 00000100:00100000:1.0:1789996972.491992:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712831360:0@lo:400:kworker.0 00000100:00100000:1.0:1789996972.492004:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712831872:0@lo:400:kworker.0 00000100:00100000:0.0:1789996972.794486:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712832000 00000100:00100000:0.0:1789996972.794493:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712832000 00000100:00100000:0.0:1789996972.794572:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789996972.794583:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:58428:x1876946712832000:12345-0@lo:104: 00010000:00010000:0.0:1789996972.794596:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592aec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996972.794698:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789996972.794704:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:58428:x1876946712832000:12345-0@lo:104: Request processed in 125us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996972.794711:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00010000:1.0:1789996972.794769:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996972.794776:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592aec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.794784:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789996972.794789:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592aec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.794798:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592aec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996972.794805:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592aec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996972.794811:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789996972.794842:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592aec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.794849:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996972.794867:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592aec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.794874:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592aebe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592aec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.794900:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996972.794902:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996972.794904:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996972.794924:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712832128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996972.794957:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996972.794996:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712832128 00000100:00100000:1.0:1789996972.795000:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712832128 00010000:00010000:1.0:1789996972.795019:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592aec5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592aebe expref: 19 pid: 5805 timeout: 1311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996972.795040:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789996972.795046:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712832128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996972.795056:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996972.795061:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052be00/0x65b43101d592aec5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592aebe expref: 19 pid: 5805 timeout: 1311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795070:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052be00/0x65b43101d592aec5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592aebe expref: 19 pid: 5805 timeout: 1311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795084:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795092:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795106:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795114:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795126:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795132:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795137:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996972.795141:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795148:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795157:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592aefd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996972.795166:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996972.795194:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712832128:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996972.795226:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789996972.795294:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712832128:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996972.813886:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996973.839167:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996974.365288:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996974.365322:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996974.365353:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704314240 00000100:00100000:0.0:1789996974.365361:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704314240 00000100:00100000:0.0:1789996974.365418:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 829 00000100:00100000:0.0:1789996974.365436:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704314240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789996974.365503:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704314240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996974.365510:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 829 00000100:00080000:0.0:1789996974.365531:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996974.369419:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 190 00000100:00100000:0.0:1789996974.369429:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704314496:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:0.0:1789996974.369442:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592a517 00000100:00080000:0.0:1789996974.369448:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c859c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789996974.369474:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967320 00000100:00100000:0.0:1789996974.372240:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704314496:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 2803us (3090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996974.372255:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 190 00010000:00010000:0.0:1789996974.372291:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789996974.372300:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789996974.372305:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789996974.539784:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789996974.539790:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789996974.539794:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789996974.539825:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996974.539838:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996974.539859:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996974.539882:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712832512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996974.539949:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996974.540008:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789996974.540026:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712832256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996974.540055:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996974.540081:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996974.540086:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712832384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996974.540106:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996974.540134:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712832256 00000100:00100000:1.0:1789996974.540137:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712832256 00000100:00100000:1.0:1789996974.540181:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712832384 00000100:00100000:1.0:1789996974.540184:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712832384 00000100:00100000:1.0:1789996974.540200:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1789996974.540206:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712832256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996974.540232:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996974.540263:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712832256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996974.540271:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1789996974.540286:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1789996974.540292:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712832384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996974.540309:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996974.540350:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712832384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996974.540362:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00080000:1.0:1789996974.540382:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996974.540386:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996974.540419:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb490380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712832384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996974.540431:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712832256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996974.540462:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712832512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996974.540475:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996974.540484:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996974.540496:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789996974.540500:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996974.540508:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996974.860075:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996975.342594:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704314624 00000100:00100000:1.0:1789996975.342607:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704314624 00000100:00100000:1.0:1789996975.342682:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 382 00000100:00100000:1.0:1789996975.342693:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:34955:x1876946704314624:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789996975.342712:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996975.342734:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592af12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae778 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.342818:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.342831:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.342845:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.342855:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.342862:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.342868:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343138:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592af27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343146:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592af27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343167:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592af27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996975.343187:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1789996975.343191:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996975.343208:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592af27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343234:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343240:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343247:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343253:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996975.343257:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343263:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343275:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:1.0:1789996975.343277:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996975.343282:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343288:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592af19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343299:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343305:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343310:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343321:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996975.343324:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343330:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343337:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38e062de00) 00010000:00010000:1.0:1789996975.343340:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996975.343343:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343349:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592af20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343377:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592af12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae778 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343390:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592af27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae778 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.343396:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789996975.343398:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789996975.343400:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789996975.343463:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:34955:x1876946704314624:12345-192.168.204.4@tcp:101:touch.0 Request processed in 773us (3209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996975.343471:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 382 00010000:00010000:0.0:1789996975.356030:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592af3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.356048:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592af3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.356057:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592af3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.356062:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789996975.356067:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592af3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.356081:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592af3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.356096:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789996975.356099:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996975.356104:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592af3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.356109:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592af3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996975.358428:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704315136 00000100:00100000:0.0:1789996975.358439:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704315136 00000100:00100000:0.0:1789996975.358487:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 384 00000100:00100000:0.0:1789996975.358496:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:34955:x1876946704315136:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:0.0:1789996975.358549:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996975.358572:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592af43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae77f expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.358588:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:0.0:1789996975.358599:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996975.358639:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592af51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.358672:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592af51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.358684:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592af51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996975.358885:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de887096 reply state 0000000016fccd1d transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592af51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996975.358894:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996975.358984:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:34955:x1876946704315136:12345-192.168.204.4@tcp:36:touch.0 Request processed in 489us (1110us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1789996975.358992:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 384 00000100:00100000:0.0:1789996975.361534:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996975.361570:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704315264 00000100:00100000:0.0:1789996975.361578:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704315264 00000100:00100000:0.0:1789996975.361626:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 385 00000100:00100000:0.0:1789996975.361636:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:34955:x1876946704315264:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789996975.361741:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996975.362899:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592af58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae786 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.362972:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592af58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae786 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.362990:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592af58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae786 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.363009:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789996975.363013:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996975.363017:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789996975.363081:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:34955:x1876946704315264:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1445us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996975.363099:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 385 00000100:00100000:1.0:1789996975.374512:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996975.374744:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704315392 00000100:00100000:0.0:1789996975.374755:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704315392 00000100:00100000:0.0:1789996975.374876:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 191 00000100:00100000:0.0:1789996975.374885:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876946704315392:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:0.0:1789996975.374921:0:6659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1164 last 0 00000020:00000080:0.0:1789996975.374953:0:6659:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592af5f 00002000:00100000:0.0:1789996975.374966:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38fadab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789996975.374978:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789996975.375079:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789996975.375111:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38fadad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789996975.375192:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704315392:12345-192.168.204.4@tcp:8:touch.0 Request processed in 305us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996975.375200:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 191 00000100:00100000:0.0:1789996975.388461:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:1.0:1789996975.390483:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789996975.437870:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000001:00100000:0.0:1789996975.437887:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789996975.437891:0:7614:0:(genops.c:885:class_export_put()) final put ffff8a38c859e000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000001:00080000:0.0:1789996975.437921:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1789996975.442473:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996975.525916:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996975.533878:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996975.537369:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704316032 00000100:00100000:1.0:1789996975.537387:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704316032 00000100:00100000:1.0:1789996975.537469:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 193 00000100:00100000:1.0:1789996975.537480:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704316032:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789996975.537509:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996975.537530:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095d02401/0x65b43101d592af82 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae794 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996975.537557:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x6ab12faf, atime: 0x6ab12faf, ctime: 0x6ab12faf, blocks: 0x1 00010000:00010000:1.0:1789996975.537577:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=1164s v=(0 0) 00010000:00010000:1.0:1789996975.537834:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996975.537845:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095d02401/0x65b43101d592af82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae794 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.537865:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000095d02401/0x65b43101d592af82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae794 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.537879:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789996975.537996:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704316032:12345-192.168.204.4@tcp:101:rm.0 Request processed in 517us (4127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996975.538004:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 193 00000100:00100000:1.0:1789996975.555917:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996975.556220:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704316288 00000100:00100000:0.0:1789996975.556231:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704316288 00000100:00100000:0.0:1789996975.556298:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 387 00000100:00100000:0.0:1789996975.556309:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:34959:x1876946704316288:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789996975.556511:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789996975.556538:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592af7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae78d expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556563:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592af58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae786 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556573:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789996975.556584:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996975.556607:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556621:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556630:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556644:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592af90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556697:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592af90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556705:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592af90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556973:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.556981:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.557120:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789996975.558272:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9024 00000004:00080000:0.0:1789996975.558284:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1164250629345ns, next at 1165250627075ns, rc = 0 00010000:00010000:0.0:1789996975.558342:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.558356:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.558366:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559494:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559508:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559514:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559616:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789996975.559643:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559649:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559675:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559691:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789996975.559697:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559705:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559717:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789996975.559720:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789996975.559725:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559731:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592af97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559772:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559778:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559784:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559789:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789996975.559791:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559797:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559815:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:0.0:1789996975.559817:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996975.559821:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996975.559827:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592af89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996975.559845:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f80887ab reply state 00000000ac5b202e transno 4294967454 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592af90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996975.559855:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996975.559946:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:34959:x1876946704316288:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3635us (4035us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789996975.559955:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 387 00010000:00010000:1.0:1789996975.570383:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996975.570399:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.570432:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996975.570437:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.570446:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.570464:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:1.0:1789996975.570467:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789996975.570472:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.570478:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592af9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996975.570517:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996975.570520:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996975.570522:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996976.907914:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789996977.177148:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789996977.177159:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a38c53d8800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789996977.177192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38c53d8800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:1.0:1789996977.177238:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38c53df800 for lustre-OST0000 00000020:00000080:1.0:1789996977.191296:0:58676:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff608d8570 20000000:00000080:1.0:1789996977.191315:0:58676:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c7f6cc00 uarg=0000000000000000 00010000:00010000:1.0:1789996977.192533:0:58676:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789996977.192571:0:58676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789996977.192576:0:58676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789996977.192588:0:58676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592af27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae778 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.192627:0:58676:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789996977.192645:0:58676:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789996977.192692:0:58676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.192706:0:58676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592af0b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592af04 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.192714:0:58676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.193556:0:58676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592af0b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592af04 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.193571:0:58676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592af0b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592af04 expref: 18 pid: 7594 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996977.193587:0:58676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3041880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58676:1876946712832640:0@lo:104: 00000100:00100000:1.0:1789996977.193678:0:58676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996977.193733:0:58676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789996977.193972:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789996977.193987:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712832640 00000100:00100000:0.0:1789996977.193995:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712832640 00000100:00100000:0.0:1789996977.194040:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789996977.194050:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:58676:x1876946712832640:12345-0@lo:104: 00010000:00010000:0.0:1789996977.194063:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996977.194129:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789996977.194135:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:58676:x1876946712832640:12345-0@lo:104: Request processed in 87us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996977.194141:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00010000:1.0:1789996977.194297:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996977.194304:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194312:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789996977.194317:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194326:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996977.194350:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996977.194357:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789996977.194392:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194399:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996977.194420:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194428:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592af04 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592af0b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194444:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996977.194446:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996977.194448:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996977.194460:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712832768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996977.194490:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996977.194531:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712832768 00000100:00100000:1.0:1789996977.194536:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712832768 00010000:00010000:1.0:1789996977.194554:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592af0b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592af04 expref: 19 pid: 7594 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996977.194577:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789996977.194584:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712832768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996977.194594:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996977.194599:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592af0b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592af04 expref: 19 pid: 7594 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194615:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592af0b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592af04 expref: 19 pid: 7594 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194631:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194641:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194687:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194697:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194705:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194712:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194898:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996977.194904:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194913:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.194924:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.195017:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996977.195093:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712832768:12345-0@lo:103:ldlm_bl.0 Request processed in 509us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996977.195100:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:1.0:1789996977.195335:0:58676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592af0b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592af04 expref: 18 pid: 7594 timeout: 1315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996977.195353:0:58676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3041880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:58676:1876946712832640:0@lo:104: 00010000:00010000:1.0:1789996977.195371:0:58676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.195380:0:58676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.195386:0:58676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996977.195392:0:58676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592afa5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996977.198484:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712832768:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1789996977.202847:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:0.0:1789996977.202858:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 34 committed 00000100:00100000:0.0:1789996977.203014:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712832896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789996977.203082:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996977.203146:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712832896 00000100:00100000:0.0:1789996977.203153:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712832896 00000100:00100000:0.0:1789996977.203208:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789996977.203217:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712832896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789996977.203245:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:13 count 1 00010000:00010000:0.0:1789996977.203271:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592afac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996977.203293:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095d02401/0x65b43101d592af82 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae794 expref: 5 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996977.203303:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789996977.203307:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996977.203312:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592afac lrc: 4/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996977.203355:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095d02401/0x65b43101d592af82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae794 expref: 5 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996977.203371:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095d02401/0x65b43101d592af82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae794 expref: 5 pid: 6659 timeout: 1265 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996977.203406:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8169:1876946712833024:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789996977.203471:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5c840 going to sleep for 11 seconds 00000100:00080000:0.0:1789996977.203483:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789996977.210897:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c610d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8169:1876946712833024:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789996977.210940:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592afac lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996977.217520:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:1.0:1789996977.219353:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789996977.933502:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996978.955088:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996979.488126:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704316544 00000100:00100000:0.0:1789996979.488137:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704316544 00000100:00100000:0.0:1789996979.488197:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 774 00000100:00100000:0.0:1789996979.488208:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704316544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789996979.488295:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704316544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996979.488302:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 774 00000100:00100000:1.0:1789996979.488792:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704316672 00000100:00100000:1.0:1789996979.488797:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704316672 00000100:00100000:1.0:1789996979.488916:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 833 00000100:00100000:1.0:1789996979.488930:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704316672:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996979.488974:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704316672:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996979.488990:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 833 00000100:00080000:0.0:1789996979.489291:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789996979.489381:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996979.660593:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996979.660617:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712834048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996979.661968:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789996979.662649:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789996979.662686:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789996979.662920:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712834176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996979.663805:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712834048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789996979.979035:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789996980.364276:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ed7fbaf reply state 00000000a1fa0ad2 transno 4294967455 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592afcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996980.364299:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789996980.364328:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00080000:0.0:1789996980.364553:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789996980.364575:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35046:x1876946704317184:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 50287us (50398us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789996980.364585:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 389 00010000:00010000:1.0:1789996981.194617:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996981.194625:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3200/0x65b43101d592afb3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592afba expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194632:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789996981.194636:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3200/0x65b43101d592afb3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592afba expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194644:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3200/0x65b43101d592afb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592afba expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996981.194676:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3200/0x65b43101d592afb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592afba expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996981.194683:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789996981.194715:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3200/0x65b43101d592afb3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592afba expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194721:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996981.194739:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3200/0x65b43101d592afb3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592afba expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194747:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3200/0x65b43101d592afb3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592afba expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194768:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996981.194770:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996981.194772:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996981.194783:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712834432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996981.194812:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996981.194846:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712834432 00000100:00100000:1.0:1789996981.194850:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712834432 00010000:00010000:1.0:1789996981.194868:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592afba lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592afb3 expref: 19 pid: 7594 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996981.194889:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789996981.194896:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712834432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996981.194906:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996981.194911:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592afba lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592afb3 expref: 19 pid: 7594 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194921:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592afba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592afb3 expref: 19 pid: 7594 timeout: 1319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194936:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194943:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194955:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194961:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194973:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194979:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194984:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789996981.194989:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.194996:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.195004:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b800/0x65b43101d592afd6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 58873 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996981.195013:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996981.195054:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712834432:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996981.195060:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789996981.195095:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712834432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789996982.027310:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996982.413471:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712834560 00000100:00100000:0.0:1789996982.413482:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712834560 00000100:00100000:0.0:1789996982.413541:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:0.0:1789996982.413551:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712834560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996982.413565:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996982.413580:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592afe4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592afdd expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996982.413605:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592afe4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592afdd expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996982.413617:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592afe4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592afdd expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996982.413626:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789996982.413699:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712834560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996982.413707:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00010000:00010000:0.0:1789996983.052134:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996984.075310:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996984.088188:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:1.0:1789996984.090622:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996984.093961:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704317568 00000100:00100000:1.0:1789996984.093971:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704317568 00000100:00100000:1.0:1789996984.094041:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 391 00000100:00100000:1.0:1789996984.094051:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35123:x1876946704317568:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789996984.094086:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996984.094105:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b007 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae7a9 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094194:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094209:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094221:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094236:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094242:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094248:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996984.094260:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00010000:1.0:1789996984.094280:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094286:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094291:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094305:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996984.094309:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094316:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094329:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:1.0:1789996984.094331:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996984.094336:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094342:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b00e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094355:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094361:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094366:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094371:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996984.094374:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094380:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094398:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff8a38e062df00) 00010000:00010000:1.0:1789996984.094401:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996984.094404:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094410:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b015 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094445:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b007 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7a9 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094455:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:1.0:1789996984.094458:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996984.094462:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b007 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7a9 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996984.094470:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789996984.094537:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35123:x1876946704317568:12345-192.168.204.4@tcp:101:touch.0 Request processed in 487us (679us total) trans 0 rc 301/301 00000100:00100000:1.0:1789996984.094543:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 391 00000100:00100000:1.0:1789996984.599686:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996984.599734:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996984.779459:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789996984.779920:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c610d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712835456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996984.780112:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996984.781752:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712835456 00000100:00100000:1.0:1789996984.781764:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712835456 00000100:00100000:0.0:1789996984.782843:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1789996984.782855:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712835456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996984.782905:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996984.783000:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c610c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712835456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996984.783007:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1789996984.783058:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c610d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712835456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996985.792116:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712835584 00000100:00100000:0.0:1789996985.792133:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712835584 00000100:00100000:0.0:1789996985.792189:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789996985.792199:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:59118:x1876946712835584:12345-0@lo:104: 00010000:00010000:0.0:1789996985.792211:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592afdd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592afe4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792276:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789996985.792283:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:59118:x1876946712835584:12345-0@lo:104: Request processed in 86us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996985.792291:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00010000:00010000:0.0:1789996985.792312:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996985.792318:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592afdd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592afe4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792326:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789996985.792329:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592afdd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592afe4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792337:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592afdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592afe4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789996985.792345:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592afdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592afe4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996985.792359:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789996985.792390:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592afdd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592afe4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792396:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789996985.792418:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592afdd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592afe4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792425:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592afdd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592afe4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792439:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996985.792441:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996985.792443:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996985.792461:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c610d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712835712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789996985.792493:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996985.792531:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712835712 00000100:00100000:0.0:1789996985.792536:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712835712 00010000:00010000:0.0:1789996985.792554:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592afe4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592afdd expref: 19 pid: 7594 timeout: 1324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996985.792577:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789996985.792584:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c610d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712835712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789996985.792594:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996985.792600:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0200/0x65b43101d592afe4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592afdd expref: 19 pid: 7594 timeout: 1324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792610:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0200/0x65b43101d592afe4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592afdd expref: 19 pid: 7594 timeout: 1324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792632:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792641:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792684:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792693:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792700:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792706:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792711:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789996985.792716:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792722:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792731:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592b046 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996985.792741:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996985.792772:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c610d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712835712:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996985.792789:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789996985.792827:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c610d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712835712:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789996987.467874:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789996987.467883:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789996987.467888:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789996987.467949:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996987.467960:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996987.467971:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996987.467996:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c610d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712835840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789996987.468065:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996987.468134:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789996987.468244:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712835840 00000100:00100000:1.0:1789996987.468252:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712835840 00000100:00100000:1.0:1789996987.468306:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1789996987.468330:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712835840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996987.468342:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996987.468354:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b054 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b04d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996987.468377:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b054 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b04d expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996987.468387:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b054 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b04d expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996987.468395:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:1.0:1789996987.468448:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712835840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996987.468455:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1789996987.850958:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712836352:0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851058:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996987.851123:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789996987.851130:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712835968:0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851153:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996987.851169:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712836480:0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851185:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996987.851204:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712836096:0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851223:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996987.851240:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996987.851244:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712836224:0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851259:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996987.851291:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712835968 00000100:00100000:1.0:1789996987.851299:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712835968 00000100:00100000:1.0:1789996987.851332:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712836480 00000100:00100000:1.0:1789996987.851334:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712836480 00000100:00100000:1.0:1789996987.851352:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712836096 00000100:00100000:1.0:1789996987.851354:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712836096 00000100:00100000:1.0:1789996987.851369:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1789996987.851376:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d8e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712835968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851422:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d8e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712835968:12345-0@lo:400:kworker.0 Request processed in 46us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996987.851429:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1789996987.851443:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1789996987.851448:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712836480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851468:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712836480:12345-0@lo:400:kworker.0 Request processed in 20us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996987.851473:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1789996987.851481:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1789996987.851486:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712836096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851507:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712836096:12345-0@lo:400:kworker.0 Request processed in 21us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996987.851512:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:1.0:1789996987.851598:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712836096:0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851626:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712835968:0@lo:400:kworker.0 00000100:00100000:1.0:1789996987.851635:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712836480:0@lo:400:kworker.0 00000100:00080000:1.0:1789996987.852263:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789996988.172872:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996988.716941:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996988.721315:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704318208 00000100:00100000:1.0:1789996988.721336:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704318208 00000100:00100000:0.0:1789996988.728836:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 394 00000100:00100000:0.0:1789996988.728862:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c610d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35209:x1876946704318208:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789996988.728883:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996988.728915:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b05b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae7be expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996988.728981:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b062 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996988.729004:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996988.729017:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996988.729051:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:0.0:1789996988.729055:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996988.729071:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996988.729095:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b05b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7be expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996988.729352:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7be expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996988.729361:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789996988.729364:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996988.729368:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789996988.729442:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c610d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35209:x1876946704318208:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 594us (12511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996988.729450:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 394 00000100:00100000:1.0:1789996988.733313:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:1.0:1789996988.739999:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b069 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996988.740017:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b069 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996988.740025:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b069 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996988.740031:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996988.740037:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b069 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996988.740044:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b069 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996988.740059:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:1.0:1789996988.740063:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789996988.740069:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b069 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996988.740075:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b069 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996989.590277:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712836608 00000100:00100000:0.0:1789996989.590284:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712836608 00000100:00100000:0.0:1789996989.590377:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789996989.590388:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:59314:x1876946712836608:12345-0@lo:104: 00010000:00010000:0.0:1789996989.590405:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996989.590484:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789996989.590491:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:59314:x1876946712836608:12345-0@lo:104: Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996989.590498:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00010000:00010000:1.0:1789996989.590551:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996989.590558:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996989.590566:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789996989.590570:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996989.590585:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996989.590592:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996989.590597:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789996989.590631:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996989.590637:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996989.590678:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996989.590686:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592b04d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996989.590701:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996989.590703:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996989.590705:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996989.591372:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712836736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789996989.721098:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704318720 00000100:00100000:0.0:1789996989.721106:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704318720 00000100:00100000:0.0:1789996989.721154:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 840 00000100:00100000:0.0:1789996989.721163:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704318720:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789996989.721216:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704318720:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 54us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996989.721224:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 840 00000100:00100000:0.0:1789996989.900087:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789996989.900101:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712836992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996989.900138:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996989.900172:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712836992 00000100:00100000:0.0:1789996989.900175:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712836992 00000100:00100000:0.0:1789996989.900220:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1789996989.900230:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712836992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996989.900276:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996989.900329:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c610d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712836992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996989.900336:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00080000:1.0:1789996989.900361:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996989.900367:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996989.900391:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712836992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996990.218818:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789996990.667936:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789996990.667945:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789996990.667950:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789996990.667998:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996990.668010:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996990.668034:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996990.668058:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712837120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996990.668120:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996990.668163:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789996990.670503:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712837120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996990.670530:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996990.670543:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996990.670566:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789996990.670572:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996990.670579:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996991.248379:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996992.193077:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704318976 00000100:00100000:0.0:1789996992.193088:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704318976 00000100:00100000:0.0:1789996992.193189:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 396 00000100:00100000:0.0:1789996992.193200:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35294:x1876946704318976:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789996992.193309:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35294:x1876946704318976:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996992.193317:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 396 00000100:00080000:1.0:1789996992.193485:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996992.199003:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704319232 00000100:00100000:0.0:1789996992.199011:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704319232 00000100:00100000:0.0:1789996992.199151:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 196 00000100:00100000:0.0:1789996992.199163:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35294:x1876946704319232:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789996992.199527:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35294:x1876946704319232:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 366us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996992.199535:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 196 00000100:00080000:1.0:1789996992.199771:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996992.202511:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:1.0:1789996992.202906:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996992.208996:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704319488 00000100:00100000:1.0:1789996992.209006:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704319488 00000100:00100000:1.0:1789996992.209249:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 397 00000100:00100000:1.0:1789996992.209261:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35294:x1876946704319488:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789996992.209782:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35294:x1876946704319488:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 521us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996992.209791:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 397 00000100:00100000:1.0:1789996992.212746:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996992.212943:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704319616 00000100:00100000:0.0:1789996992.212953:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704319616 00000100:00100000:0.0:1789996992.213168:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 398 00000100:00100000:0.0:1789996992.213180:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35294:x1876946704319616:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789996992.213284:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35294:x1876946704319616:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 106us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996992.213291:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 398 00000100:00100000:0.0:1789996992.214958:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996992.219874:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996992.219929:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704320000 00000100:00100000:0.0:1789996992.219937:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704320000 00010000:00010000:1.0:1789996992.267338:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996992.268731:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996992.341495:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996992.343760:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704320640 00000100:00100000:0.0:1789996992.343776:0:6662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704320640 00002000:00100000:0.0:1789996992.343850:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xd:0x0] (0->1048575) req@ffff8a37c7f43b80 x1876946704320640/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:723/0 lens 488/0 e 0 to 0 dl 1789997003 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996992.343861:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c7f43b80 with x1876946704320640 ext(0->1048575) 00002000:00010000:0.0:1789996992.343867:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c7f43b80 00000100:00100000:0.0:1789996992.343975:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:0.0:1789996992.343986:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704320640:12345-192.168.204.4@tcp:4:dd.0 00000100:00100000:1.0:1789996992.414472:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704320640:12345-192.168.204.4@tcp:4:dd.0 Request processed in 70478us (72978us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789996992.414484:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00002000:00100000:1.0:1789996992.414498:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xd:0x0] (0->1048575) req@ffff8a37c7f43b80 x1876946704320640/t4294967321(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:723/0 lens 488/448 e 0 to 0 dl 1789997003 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789996992.414508:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c7f43b80 with x1876946704320640 ext(0->1048575) 00002000:00010000:1.0:1789996992.414515:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c7f43b80 00000100:00100000:1.0:1789996992.422262:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996992.422457:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704320768 00000100:00100000:0.0:1789996992.422468:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704320768 00000100:00100000:0.0:1789996992.422531:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 402 00000100:00100000:0.0:1789996992.422543:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:35298:x1876946704320768:12345-192.168.204.4@tcp:44:dd.0 00000100:00100000:1.0:1789996992.470478:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:35298:x1876946704320768:12345-192.168.204.4@tcp:44:dd.0 Request processed in 47926us (48218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996992.470493:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 402 00000100:00100000:1.0:1789996992.505146:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704320896:12345-192.168.204.4@tcp:16:dd.0 Request processed in 31364us (31596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996992.505162:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 201 00000100:00100000:0.0:1789996992.511538:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:1.0:1789996993.291508:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996994.316402:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789996994.783444:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 35 committed 00000004:00080000:1.0:1789996994.783475:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 34 committed 00000100:00100000:1.0:1789996994.843235:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704321280 00000100:00100000:1.0:1789996994.843240:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704321280 00000100:00100000:1.0:1789996994.843284:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 781 00000100:00100000:1.0:1789996994.843291:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704321280:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996994.843321:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704321280:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996994.843327:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 781 00000100:00100000:1.0:1789996995.019288:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712838016 00000100:00100000:1.0:1789996995.019297:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712838016 00000100:00100000:1.0:1789996995.019352:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1789996995.019362:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712838016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996995.019409:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00080000:0.0:1789996995.019480:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996995.024549:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712838016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5185us (5336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996995.024558:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00010000:00010000:1.0:1789996995.338970:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996995.940721:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789996995.942821:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:35492:x1876946704321792:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789996995.942930:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:35492:x1876946704321792:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 110us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996995.942937:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 403 00000100:00100000:0.0:1789996995.947157:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996995.947196:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704321920 00000100:00100000:0.0:1789996995.947206:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704321920 00000100:00100000:0.0:1789996995.947259:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 202 00000100:00100000:0.0:1789996995.947349:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35492:x1876946704321920:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789996995.951357:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35492:x1876946704321920:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 4004us (4199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996995.951387:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 202 00000100:00100000:2.0:1789996995.954890:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996995.955023:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704322048 00000100:00100000:0.0:1789996995.955034:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704322048 00000100:00100000:0.0:1789996995.955100:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 203 00000100:00100000:0.0:1789996995.955113:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35492:x1876946704322048:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789996995.957009:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35492:x1876946704322048:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1892us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996995.957021:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 203 00000100:00100000:0.0:1789996995.965906:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996995.973199:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996995.976348:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996995.976447:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704322432 00000100:00100000:0.0:1789996995.976459:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704322432 00000100:00100000:0.0:1789996995.976520:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 204 00000100:00100000:0.0:1789996995.976530:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35492:x1876946704322432:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789996995.977049:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35492:x1876946704322432:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 519us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996995.977058:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 204 00000100:00100000:1.0:1789996995.983059:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996995.988601:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789996995.989207:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704322688 00000100:00100000:2.0:1789996995.989220:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704322688 00000100:00100000:2.0:1789996995.989290:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 406 00000100:00100000:2.0:1789996995.989302:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:35492:x1876946704322688:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789996995.990492:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:35492:x1876946704322688:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 1188us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996995.990503:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 406 00000100:00100000:1.0:1789996996.037387:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996996.037525:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704322944 00000100:00100000:0.0:1789996996.037536:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704322944 00000100:00100000:0.0:1789996996.037617:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 407 00000100:00100000:0.0:1789996996.037628:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:35496:x1876946704322944:12345-192.168.204.4@tcp:36:rm.0 00000100:00080000:2.0:1789996996.037765:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789996996.040152:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996996.040359:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b0bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7cc expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040382:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:1.0:1789996996.040394:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996996.040418:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040431:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040459:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040475:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040483:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040489:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040835:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040845:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.040853:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789996996.043088:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9024 00000004:00080000:1.0:1789996996.043174:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1184735519821ns, next at 1185735516222ns, rc = 0 00010000:00010000:1.0:1789996996.043304:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.043319:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044608:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044677:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044685:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044692:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044716:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789996996.044740:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996996.044759:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996996.044766:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789996996.044770:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996996.044785:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044799:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044805:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044811:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996996.044812:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:0.0:1789996996.044815:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789996996.044817:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789996996.044819:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044821:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996996.044826:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b0e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044827:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996996.044842:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996996.044844:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996996.044846:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:0.0:1789996996.044846:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996996.044848:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789996996.044851:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044867:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b0e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044890:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044896:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044901:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044905:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996996.044908:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044913:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044920:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:1.0:1789996996.044922:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996996.044925:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.044929:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b0d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996996.044937:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000253c56fb reply state 00000000c8e698d5 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996996.044946:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996996.045057:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:35496:x1876946704322944:12345-192.168.204.4@tcp:36:rm.0 Request processed in 7427us (7676us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789996996.045066:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 407 00010000:00010000:1.0:1789996996.047873:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.047891:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.047898:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.047904:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789996996.047909:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.047917:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.047933:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff8a38e062de00) 00010000:00010000:1.0:1789996996.047936:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996996.047941:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996996.047947:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b0d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996996.364367:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996997.387065:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789996997.832624:0:59705:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1186524966616ns, next at 1185735516222ns, rc = 0 00000004:00080000:2.0:1789996997.891597:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 36 committed 00000001:00080000:2.0:1789996997.891856:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1789996997.891864:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 35 committed 00000100:00100000:0.0:1789996997.892193:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712838272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789996997.892261:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996997.893043:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712838272 00000100:00100000:1.0:1789996997.893052:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712838272 00000100:00100000:1.0:1789996997.893158:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789996997.893169:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712838272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789996997.893211:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:13 count 1 00010000:00010000:1.0:1789996997.893238:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.893259:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000115126c9/0x65b43101d592b0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7d3 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.893267:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xd:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1789996997.893272:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996997.893276:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 4/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.893309:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000115126c9/0x65b43101d592b0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7d3 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.893322:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000115126c9/0x65b43101d592b0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7d3 expref: 5 pid: 6658 timeout: 1286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996997.893333:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712838400:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789996997.893420:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e0d99cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1789996997.895008:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996997.898910:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789996997.899460:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704323072 00000100:00100000:2.0:1789996997.899474:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704323072 00010000:00010000:2.0:1789996997.899562:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000115126c9/0x65b43101d592b0cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7d3 expref: 6 pid: 6658 timeout: 1286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996997.899608:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 270 00000100:00100000:2.0:1789996997.899622:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704323072:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996997.899638:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996997.899643:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000115126c9/0x65b43101d592b0cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7d3 expref: 6 pid: 6658 timeout: 1286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996997.899839:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000115126c9/0x65b43101d592b0cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7d3 expref: 6 pid: 6658 timeout: 1286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996997.899863:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789996997.899868:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789996997.899873:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996997.899883:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996997.899903:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789996997.900030:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789996997.900162:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000115126c9/0x65b43101d592b0cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7d3 expref: 6 pid: 6658 timeout: 1286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996997.900179:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712838400:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789996997.900200:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.900223:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.900230:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.900238:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.900244:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996997.900269:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789996997.900799:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7181f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704323072:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1178us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996997.900814:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 270 00010000:00010000:0.0:1789996997.901133:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996997.901140:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996997.901149:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789996997.901153:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996997.901174:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996997.901189:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996997.901196:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7e7eec0/0x65b43101d592b0ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996997.901214:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996997.901216:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996997.901218:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996997.901948:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712838272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8767us (9673us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789996997.901959:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000004:00080000:0.0:1789996997.902274:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c7f57b80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789996997.902293:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712838272:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789996997.907214:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 36 committed 00000100:00100000:1.0:1789996998.091327:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712838912:0@lo:400:kworker.0 00000100:00100000:0.0:1789996998.091385:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712838656:0@lo:400:kworker.0 00000100:00100000:1.0:1789996998.091399:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996998.091434:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996998.091465:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712838784:0@lo:400:kworker.0 00000100:00100000:0.0:1789996998.091487:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789996998.091493:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712838528:0@lo:400:kworker.0 00000100:00100000:2.0:1789996998.091494:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996998.091519:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996998.091537:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712839040:0@lo:400:kworker.0 00000100:00100000:0.0:1789996998.091561:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996998.091629:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712838912 00000100:00100000:1.0:1789996998.091639:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712838912 00000100:00100000:1.0:1789996998.091732:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1789996998.091742:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712838912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996998.091795:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712838912:12345-0@lo:400:kworker.0 Request processed in 55us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996998.091802:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1789996998.091858:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712838912:0@lo:400:kworker.0 00000100:00100000:1.0:1789996998.091892:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712838656 00000100:00100000:1.0:1789996998.091896:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712838656 00000100:00100000:1.0:1789996998.091918:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712838784 00000100:00100000:1.0:1789996998.091921:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712838784 00000100:00100000:1.0:1789996998.091937:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712839040 00000100:00100000:1.0:1789996998.091939:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712839040 00000100:00100000:1.0:1789996998.091956:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1789996998.091962:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712838656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996998.091999:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712838656:12345-0@lo:400:kworker.0 Request processed in 37us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996998.092006:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1789996998.092017:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:1.0:1789996998.092023:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712838784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996998.092049:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712838784:12345-0@lo:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996998.092055:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:1.0:1789996998.092067:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1789996998.092072:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712839040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996998.092096:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712839040:12345-0@lo:400:kworker.0 Request processed in 25us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996998.092101:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1789996998.092134:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712839040:0@lo:400:kworker.0 00000100:00100000:1.0:1789996998.092144:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712838656:0@lo:400:kworker.0 00000100:00080000:0.0:1789996998.092268:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789996998.092273:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996998.092637:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712838784:0@lo:400:kworker.0 00000100:00100000:1.0:1789996998.092804:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712838528:0@lo:400:kworker.0 00010000:00010000:1.0:1789996998.410910:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996999.435094:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996999.963110:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996999.963154:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789996999.963214:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789996999.963294:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704323200 00000100:00100000:1.0:1789996999.963305:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704323200 00000100:00100000:1.0:1789996999.963364:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 783 00000100:00100000:1.0:1789996999.963375:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704323200:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789996999.963452:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704323200:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996999.963460:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 783 00000100:00100000:2.0:1789996999.964047:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704323328 00000100:00100000:2.0:1789996999.964053:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704323328 00000100:00100000:2.0:1789996999.964112:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 848 00000100:00100000:2.0:1789996999.964121:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704323328:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789996999.964170:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704323328:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 51us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996999.964187:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 848 00000100:00100000:2.0:1789996999.965188:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:1.0:1789996999.965603:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996999.965608:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789996999.965611:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997000.139553:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712839168 00000100:00100000:2.0:1789997000.139561:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712839168 00000100:00100000:2.0:1789997000.139642:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1789997000.139684:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712839168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997000.139721:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789997000.139774:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712839168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997000.139780:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1789997000.139823:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712839168:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997000.140009:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997000.140349:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712839296 00000100:00100000:0.0:1789997000.140354:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712839296 00000100:00100000:0.0:1789997000.140400:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1789997000.140415:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712839296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997000.140435:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997000.140468:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712839296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997000.140475:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00080000:1.0:1789997000.140733:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997000.460209:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997001.213856:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00010000:00010000:1.0:1789997001.482954:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997002.524810:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997003.211397:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712839808:0@lo:400:kworker.0 00000100:00100000:2.0:1789997003.211465:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997003.211527:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789997003.211535:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712839424:0@lo:400:kworker.0 00000100:00100000:2.0:1789997003.211564:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997003.211588:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712839936:0@lo:400:kworker.0 00000100:00100000:2.0:1789997003.211622:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997003.211804:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712839552:0@lo:400:kworker.0 00000100:00100000:2.0:1789997003.211905:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997003.211931:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712840064:0@lo:400:kworker.0 00000100:00100000:2.0:1789997003.211955:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997003.211975:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997003.211981:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712839680:0@lo:400:kworker.0 00000100:00100000:2.0:1789997003.212023:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997003.212059:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712839808 00000100:00100000:2.0:1789997003.212068:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712839808 00000100:00100000:2.0:1789997003.212122:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712839936 00000100:00100000:2.0:1789997003.212126:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712839936 00000100:00100000:2.0:1789997003.212151:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789997003.212160:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712839808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997003.212214:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712839808:12345-0@lo:400:kworker.0 Request processed in 55us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997003.212222:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789997003.212240:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:2.0:1789997003.212246:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712839936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997003.212404:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712839552 00000100:00100000:1.0:1789997003.212409:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712839552 00000100:00100000:1.0:1789997003.212437:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712840064 00000100:00100000:1.0:1789997003.212440:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712840064 00000100:00100000:1.0:1789997003.212456:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712839680 00000100:00100000:1.0:1789997003.212458:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712839680 00000100:00100000:1.0:1789997003.212478:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1789997003.212486:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712839552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997003.214485:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712839552:12345-0@lo:400:kworker.0 Request processed in 1991us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997003.214509:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1789997003.214524:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c8777450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712839680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997003.214572:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:0.0:1789997003.214590:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c8777450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712839680:12345-0@lo:400:kworker.0 Request processed in 73us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997003.214596:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1789997003.214620:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712839424 00000100:00100000:1.0:1789997003.214627:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712839424 00000100:00100000:1.0:1789997003.214678:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:1.0:1789997003.214684:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712839424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997003.214737:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712839424:12345-0@lo:400:kworker.0 Request processed in 53us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997003.214744:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00080000:1.0:1789997003.214997:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997003.215004:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997003.215007:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997003.215067:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712839680:0@lo:400:kworker.0 00000100:00100000:1.0:1789997003.215083:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712839552:0@lo:400:kworker.0 00000100:00100000:1.0:1789997003.215130:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712839424:0@lo:400:kworker.0 00000100:00100000:1.0:1789997003.215143:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1789997003.215150:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c7f57b80, transno 4294967322 00000100:00100000:1.0:1789997003.215161:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712839808:0@lo:400:kworker.0 00000100:00100000:0.0:1789997003.218270:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712839936:0@lo:400:kworker.0 00000100:00100000:0.0:1789997003.218322:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712840064:0@lo:400:kworker.0 00000100:00100000:2.0:1789997003.219635:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712839936:12345-0@lo:400:kworker.0 Request processed in 5772us (6396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997003.219749:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00010000:00010000:0.0:1789997003.531269:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997004.555195:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997005.088979:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997005.089026:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997005.089053:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997005.089078:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997005.089109:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704324096 00000100:00100000:2.0:1789997005.089119:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704324096 00000100:00100000:2.0:1789997005.089192:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704323968 00000100:00100000:2.0:1789997005.089196:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704323968 00000100:00100000:2.0:1789997005.089222:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 433 00000100:00100000:2.0:1789997005.089233:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704324096:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997005.089322:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704324096:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 91us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997005.089340:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 433 00000100:00100000:2.0:1789997005.089359:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 434 00000100:00100000:2.0:1789997005.089365:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704323968:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997005.089392:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704323968:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997005.089398:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 434 00000100:00100000:2.0:1789997005.089418:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704323712 00000100:00100000:2.0:1789997005.089421:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704323712 00000100:00100000:2.0:1789997005.089447:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 785 00000100:00100000:2.0:1789997005.089454:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704323712:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997005.089478:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704323712:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997005.089484:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 785 00000100:00080000:2.0:1789997005.089513:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997005.089517:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997005.258914:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997005.258930:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712840320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997005.264669:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997005.264669:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712840192 00000100:00100000:0.0:1789997005.264681:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712840192 00000100:00100000:1.0:1789997005.264738:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712840320 00000100:00100000:1.0:1789997005.264742:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712840320 00000100:00100000:1.0:1789997005.264819:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789997005.264830:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712840320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997005.264869:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997005.264943:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712840320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997005.264951:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789997005.265015:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712840320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997005.265329:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789997005.265337:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712840192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997005.265369:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997005.265442:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712840192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997005.265449:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789997005.265470:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712840192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997005.578896:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997006.603022:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997007.627154:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997008.333965:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712840448:0@lo:400:kworker.0 00000100:00100000:1.0:1789997008.334000:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997008.334034:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712840960:0@lo:400:kworker.0 00000100:00100000:1.0:1789997008.334071:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997008.334094:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997008.334101:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712840832:0@lo:400:kworker.0 00000100:00100000:1.0:1789997008.334123:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997008.334152:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712840960 00000100:00100000:1.0:1789997008.334160:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712840960 00000100:00100000:1.0:1789997008.334208:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712840832 00000100:00100000:1.0:1789997008.334211:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712840832 00000100:00100000:1.0:1789997008.334235:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1789997008.334244:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712840960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997008.334314:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712840960:12345-0@lo:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997008.334321:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1789997008.334337:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1789997008.334343:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712840832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997008.334372:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712840832:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997008.334378:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1789997008.334421:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712840832:0@lo:400:kworker.0 00000100:00100000:1.0:1789997008.334431:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712840960:0@lo:400:kworker.0 00000100:00100000:0.0:1789997008.334711:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712840704 00000100:00100000:0.0:1789997008.334716:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712840704 00000100:00100000:0.0:1789997008.334755:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712840576 00000100:00100000:0.0:1789997008.334758:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712840576 00000100:00100000:0.0:1789997008.334776:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712841088 00000100:00100000:0.0:1789997008.334779:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712841088 00000100:00100000:0.0:1789997008.334799:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1789997008.334806:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712840704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997008.334847:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712840704:12345-0@lo:400:kworker.0 Request processed in 42us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997008.334854:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1789997008.334867:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1789997008.334874:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712840576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997008.334902:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712840576:12345-0@lo:400:kworker.0 Request processed in 29us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997008.334908:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1789997008.334918:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1789997008.334924:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712841088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997008.334951:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712841088:12345-0@lo:400:kworker.0 Request processed in 27us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997008.334956:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00010000:00010000:0.0:1789997008.650946:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997009.675683:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997010.200116:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704324352 00000100:00100000:0.0:1789997010.200121:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704324352 00000100:00100000:0.0:1789997010.200178:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 856 00000100:00100000:0.0:1789997010.200187:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704324352:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997010.200225:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704324352:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997010.200232:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 856 00000100:00100000:2.0:1789997010.200233:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704324224 00000100:00100000:2.0:1789997010.200240:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704324224 00000100:00100000:2.0:1789997010.200273:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 787 00000100:00100000:2.0:1789997010.200281:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704324224:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997010.200312:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704324224:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997010.200326:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 787 00000100:00100000:1.0:1789997010.380964:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997010.380989:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712841216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997010.381058:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789997010.381814:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997010.381819:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997010.698935:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997011.723137:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997012.747241:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997013.450972:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712841856:0@lo:400:kworker.0 00000100:00100000:1.0:1789997013.451037:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997013.451209:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712841600:0@lo:400:kworker.0 00000100:00100000:1.0:1789997013.451465:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997013.451823:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712842112:0@lo:400:kworker.0 00000100:00100000:1.0:1789997013.451849:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997013.451872:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997013.451878:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712841728:0@lo:400:kworker.0 00000100:00100000:1.0:1789997013.451899:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997013.462856:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712841600 00000100:00100000:1.0:1789997013.462875:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712841600 00000100:00100000:1.0:1789997013.462944:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712842112 00000100:00100000:1.0:1789997013.462949:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712842112 00000100:00100000:1.0:1789997013.462981:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712841728 00000100:00100000:1.0:1789997013.462985:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712841728 00000100:00100000:1.0:1789997013.463012:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1789997013.463023:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712841600:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789997013.463070:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997013.463105:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712841600:12345-0@lo:400:kworker.0 Request processed in 84us (11639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997013.463110:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712841472 00000100:00100000:1.0:1789997013.463112:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1789997013.463114:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712841472 00000100:00100000:1.0:1789997013.463129:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1789997013.463135:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712842112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463140:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:2.0:1789997013.463146:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712841472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463177:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712841472:12345-0@lo:400:kworker.0 Request processed in 31us (11219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997013.463177:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712842112:12345-0@lo:400:kworker.0 Request processed in 41us (11326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997013.463183:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1789997013.463253:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:2.0:1789997013.463283:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1789997013.463292:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712841728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463323:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712841728:12345-0@lo:400:kworker.0 Request processed in 34us (11424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997013.463329:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1789997013.463445:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712841856 00000100:00100000:2.0:1789997013.463450:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712841856 00000100:00100000:2.0:1789997013.463483:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:2.0:1789997013.463490:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712841856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463528:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712841856:12345-0@lo:400:kworker.0 Request processed in 39us (12491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997013.463534:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00080000:2.0:1789997013.463547:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997013.463585:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712841856:0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463619:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712841728:0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463648:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712841600:0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463711:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712842112:0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463749:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712841984 00000100:00100000:2.0:1789997013.463752:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712841984 00000100:00100000:2.0:1789997013.463930:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789997013.463937:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712841984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997013.463973:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712841984:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997013.463978:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:0.0:1789997013.771126:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997014.795042:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997015.211832:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997015.212184:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704324736 00000100:00100000:2.0:1789997015.212195:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704324736 00000100:00100000:2.0:1789997015.212283:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 408 00000100:00100000:2.0:1789997015.212294:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35753:x1876946704324736:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997015.212417:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35753:x1876946704324736:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 125us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997015.212424:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 408 00000100:00100000:2.0:1789997015.214738:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704324864 00000100:00100000:2.0:1789997015.214747:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704324864 00000100:00100000:2.0:1789997015.214823:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 207 00000100:00100000:2.0:1789997015.214833:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35753:x1876946704324864:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997015.215210:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35753:x1876946704324864:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 378us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997015.215219:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 207 00000100:00100000:1.0:1789997015.218879:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:2.0:1789997015.223481:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997015.227168:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997015.227261:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704325120 00000100:00100000:2.0:1789997015.227286:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704325120 00000100:00100000:2.0:1789997015.227348:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 409 00000100:00100000:2.0:1789997015.227358:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35753:x1876946704325120:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997015.228199:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35753:x1876946704325120:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 838us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997015.228209:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 409 00000100:00100000:0.0:1789997015.236625:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997015.236876:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704325248 00000100:00100000:2.0:1789997015.236887:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704325248 00000100:00100000:2.0:1789997015.236973:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 410 00000100:00100000:2.0:1789997015.236993:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35753:x1876946704325248:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997015.237113:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35753:x1876946704325248:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 128us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997015.237123:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 410 00000100:00100000:1.0:1789997015.239293:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997015.241835:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704325376 00000100:00100000:2.0:1789997015.241856:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704325376 00000100:00100000:2.0:1789997015.241965:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 209 00000100:00100000:2.0:1789997015.241981:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35753:x1876946704325376:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997015.242429:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35753:x1876946704325376:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 451us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997015.242437:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 209 00000100:00100000:0.0:1789997015.247115:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997015.247224:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704325504 00000100:00100000:1.0:1789997015.247240:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704325504 00000100:00100000:1.0:1789997015.247304:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 210 00000100:00100000:1.0:1789997015.247315:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35753:x1876946704325504:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997015.248200:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35753:x1876946704325504:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 883us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997015.248209:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 210 00000100:00100000:0.0:1789997015.250110:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997015.250184:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704325632 00000100:00100000:1.0:1789997015.250192:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704325632 00000100:00100000:1.0:1789997015.250276:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 411 00000100:00100000:1.0:1789997015.250286:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35753:x1876946704325632:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997015.250693:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35753:x1876946704325632:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 407us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997015.250700:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 411 00000100:00100000:2.0:1789997015.327822:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704325760 00000100:00100000:2.0:1789997015.327833:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704325760 00000100:00100000:2.0:1789997015.327894:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 789 00000100:00100000:2.0:1789997015.327905:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704325760:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997015.327992:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704325760:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997015.328017:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 789 00000100:00100000:2.0:1789997015.500536:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712842240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997015.500958:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997015.501029:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712842368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997015.501055:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997015.501095:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712842240 00000100:00100000:2.0:1789997015.501102:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712842240 00000100:00100000:2.0:1789997015.501151:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712842368 00000100:00100000:2.0:1789997015.501154:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712842368 00000100:00100000:2.0:1789997015.501172:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789997015.501180:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712842240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997015.501213:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997015.501256:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712842240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997015.501264:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789997015.501280:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1789997015.501286:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712842368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997015.501303:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997015.501331:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712842368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997015.501337:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00080000:2.0:1789997015.501353:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997015.501357:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997015.504545:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712842240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997015.504599:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712842368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789997015.826394:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997016.852375:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997017.493643:0:60019:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed0a028d0 20000000:00000080:0.0:1789997017.494213:0:60019:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae91000 uarg=0000000000000000 00010000:00010000:0.0:1789997017.495314:0:60019:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997017.495361:0:60019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:0.0:1789997017.495365:0:60019:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997017.495376:0:60019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b0a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7c5 expref: 5 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997017.495405:0:60019:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997017.495422:0:60019:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997017.495437:0:60019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997017.495459:0:60019:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b07e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b077 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997017.495467:0:60019:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997017.495507:0:60019:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b07e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b077 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997017.495524:0:60019:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b07e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b077 expref: 18 pid: 5803 timeout: 1356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997017.495537:0:60019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60019:1876946712842496:0@lo:104: 00000100:00100000:0.0:1789997017.495613:0:60019:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997017.495835:0:60019:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997017.496485:0:60019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60019:1876946712842496:0@lo:104: 00010000:00010000:0.0:1789997017.496503:0:60019:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997017.496541:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997017.496549:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997017.496622:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997017.496626:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997017.496635:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997017.496642:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997017.496952:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997017.496981:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997017.496988:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997017.497009:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997017.497015:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592b077 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b07e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997017.497029:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997017.497031:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997017.497033:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997017.497376:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712842624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997017.497423:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789997017.498142:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b07e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b077 expref: 19 pid: 5803 timeout: 1356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997017.498178:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789997017.498189:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712842624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997017.498201:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997017.498206:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b07e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b077 expref: 19 pid: 5803 timeout: 1356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498217:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b07e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b077 expref: 19 pid: 5803 timeout: 1356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498308:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b07e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b077 expref: 19 pid: 5803 timeout: 1356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498326:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498347:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498364:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498371:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498378:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498395:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498402:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997017.498406:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.498414:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997017.499140:0:60019:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997017.499152:0:60019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.501044:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.501060:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592b0f5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997017.501081:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997017.501230:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712842624:12345-0@lo:103:ldlm_bl.0 Request processed in 3039us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997017.501253:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789997018.577414:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712842752:0@lo:400:kworker.0 00000100:00100000:2.0:1789997018.577458:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997018.577486:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712843264:0@lo:400:kworker.0 00000100:00100000:2.0:1789997018.577508:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997018.577529:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789997018.577535:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712842880:0@lo:400:kworker.0 00000100:00100000:2.0:1789997018.577556:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997018.577589:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712843392:0@lo:400:kworker.0 00000100:00100000:2.0:1789997018.577612:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997018.577648:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712842752 00000100:00100000:2.0:1789997018.577677:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712842752 00000100:00100000:2.0:1789997018.577722:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1789997018.577732:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712842752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997018.577784:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712842752:12345-0@lo:400:kworker.0 Request processed in 54us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997018.577791:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1789997018.577924:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712843136 00000100:00100000:0.0:1789997018.577930:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712843136 00000100:00100000:0.0:1789997018.578106:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712843264 00000100:00100000:0.0:1789997018.578110:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712843264 00000100:00100000:0.0:1789997018.578147:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1789997018.578155:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712843136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997018.578194:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712843136:12345-0@lo:400:kworker.0 Request processed in 40us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997018.578199:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1789997018.578211:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1789997018.578218:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712843264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997018.578245:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712843264:12345-0@lo:400:kworker.0 Request processed in 28us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997018.578251:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00080000:0.0:1789997018.578267:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997018.578271:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997018.578704:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712843008 00000100:00100000:2.0:1789997018.578710:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712843008 00000100:00100000:2.0:1789997018.578749:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712842880 00000100:00100000:2.0:1789997018.578752:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712842880 00000100:00100000:2.0:1789997018.578768:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712843392 00000100:00100000:2.0:1789997018.578770:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712843392 00000100:00100000:2.0:1789997018.578794:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1789997018.578802:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712843008:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997018.579013:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997018.579200:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712843008:12345-0@lo:400:kworker.0 Request processed in 398us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997018.579207:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1789997018.579223:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1789997018.579230:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712842880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997018.579259:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712842880:12345-0@lo:400:kworker.0 Request processed in 30us (1703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997018.579265:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1789997018.579277:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1789997018.579283:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712843392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997018.579335:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712843392:12345-0@lo:400:kworker.0 Request processed in 51us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997018.579341:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:0.0:1789997018.581060:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712842880:0@lo:400:kworker.0 00000100:00100000:0.0:1789997018.581078:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712843392:0@lo:400:kworker.0 00000100:00100000:0.0:1789997018.581088:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712842752:0@lo:400:kworker.0 00000100:00100000:0.0:1789997018.581100:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712843264:0@lo:400:kworker.0 00010000:00010000:1.0:1789997018.891562:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997019.019722:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997019.019731:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997019.019735:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997019.019780:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997019.019799:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997019.019822:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997019.019851:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8037480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712843520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997019.019937:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997019.019985:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3eb9180 going to sleep for 11 seconds 00000100:00100000:1.0:1789997019.020244:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712843520 00000100:00100000:1.0:1789997019.020253:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712843520 00000100:00100000:1.0:1789997019.020322:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1789997019.020335:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712843520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997019.020349:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997019.020364:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b0fc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997019.020388:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b0fc expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997019.020404:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b0fc expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997019.020426:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997019.020474:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712843520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997019.020481:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1789997019.022049:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8037480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712843520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997019.022082:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997019.022094:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997019.022116:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997019.022122:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997019.022130:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997019.918986:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997020.438523:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997020.438569:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997020.438600:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997020.438631:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997020.438678:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704326272 00000100:00100000:0.0:1789997020.438689:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704326272 00000100:00100000:0.0:1789997020.438742:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704326144 00000100:00100000:0.0:1789997020.438746:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704326144 00000100:00100000:0.0:1789997020.438767:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 443 00000100:00100000:0.0:1789997020.438786:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704326272:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997020.438854:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704326272:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997020.438862:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 443 00000100:00100000:0.0:1789997020.438879:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 444 00000100:00100000:0.0:1789997020.438885:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704326144:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997020.438910:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704326144:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997020.438916:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 444 00000100:00100000:1.0:1789997020.439044:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704326016 00000100:00100000:1.0:1789997020.439048:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704326016 00000100:00100000:1.0:1789997020.439094:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 863 00000100:00100000:1.0:1789997020.439101:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704326016:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997020.439134:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704326016:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997020.439140:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 863 00000100:00080000:1.0:1789997020.447624:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997020.447635:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997020.447638:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997020.619849:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712843648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997020.619921:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997020.619999:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712843648 00000100:00100000:2.0:1789997020.620007:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712843648 00000100:00100000:2.0:1789997020.620060:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789997020.620069:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712843648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997020.620216:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997020.620262:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712843648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997020.620280:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789997020.620344:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8036680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712843648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997020.620394:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997020.620623:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712843776 00000100:00100000:1.0:1789997020.620628:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712843776 00000100:00100000:1.0:1789997020.620763:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1789997020.620771:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712843776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997020.620791:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997020.620822:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712843776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997020.620828:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789997020.691029:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997020.691102:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704326400 00000100:00100000:1.0:1789997020.691113:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704326400 00000100:00100000:1.0:1789997020.691182:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 412 00000100:00100000:1.0:1789997020.691193:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35840:x1876946704326400:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997020.691214:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997020.691237:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b10a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae7da expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.691315:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b111 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.691329:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.691343:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997020.691379:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1789997020.691390:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997020.691413:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b111 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.691438:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b10a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7da expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.691458:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b111 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7da expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.691467:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:1.0:1789997020.691470:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997020.691473:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997020.691530:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35840:x1876946704326400:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 339us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997020.691537:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 412 00000100:00100000:2.0:1789997020.702818:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704326656 00000100:00100000:2.0:1789997020.702830:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704326656 00000100:00100000:2.0:1789997020.702883:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 413 00000100:00100000:2.0:1789997020.702894:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35840:x1876946704326656:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997020.702973:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997020.703005:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b111 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7da expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997020.703023:0:12471:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b0a1) 00010000:00010000:2.0:1789997020.703028:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:2.0:1789997020.703039:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997020.703066:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997020.703080:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997020.703090:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997020.765482:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00010000:2.0:1789997020.767224:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029ba097b reply state 000000003263d9ad transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997020.767245:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997020.767264:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00080000:2.0:1789997020.767389:0:12471:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789997020.767413:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35840:x1876946704326656:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 64516us (65978us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789997020.767437:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 413 00010000:00010000:1.0:1789997020.767583:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.767598:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.767606:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.767613:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997020.767618:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.767627:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.767669:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:1.0:1789997020.767672:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997020.767679:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997020.767687:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b118 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789997021.644928:0:60216:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd7ddb8d20 20000000:00000080:1.0:1789997021.644947:0:60216:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e5400 uarg=0000000000000000 00010000:00010000:1.0:1789997021.645409:0:60216:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997021.645524:0:60216:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997021.645542:0:60216:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997021.645561:0:60216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997021.645578:0:60216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b0fc expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997021.645586:0:60216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997021.645625:0:60216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b0fc expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997021.645641:0:60216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b0fc expref: 18 pid: 5803 timeout: 1360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997021.645799:0:60216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60216:1876946712843904:0@lo:104: 00000100:00100000:1.0:1789997021.645868:0:60216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997021.645930:0:60216:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa16f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997021.645991:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712843904 00000100:00100000:0.0:1789997021.645999:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712843904 00000100:00100000:0.0:1789997021.646048:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789997021.646057:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:60216:x1876946712843904:12345-0@lo:104: 00010000:00010000:0.0:1789997021.646070:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646139:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997021.646145:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:60216:x1876946712843904:12345-0@lo:104: Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997021.646152:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00010000:0.0:1789997021.646173:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997021.646179:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646186:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997021.646196:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646205:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997021.646212:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997021.646218:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997021.646245:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646263:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997021.646287:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646293:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b0fc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646309:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997021.646311:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997021.646313:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997021.646331:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712844032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997021.646360:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997021.646391:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712844032 00000100:00100000:0.0:1789997021.646395:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712844032 00010000:00010000:0.0:1789997021.646415:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b0fc expref: 19 pid: 5803 timeout: 1360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997021.646435:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789997021.646447:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712844032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997021.646458:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997021.646463:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b0fc expref: 19 pid: 5803 timeout: 1360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646473:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b103 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b0fc expref: 19 pid: 5803 timeout: 1360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646487:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646496:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646508:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646515:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646523:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646529:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646534:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997021.646538:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646545:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646561:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b11f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997021.646570:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997021.646600:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712844032:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997021.646606:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789997021.646640:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712844032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997021.968319:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997023.501252:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997023.501262:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997023.501268:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997023.501314:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997023.501326:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997023.501338:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997023.501364:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8037100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712844160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997023.502139:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997023.502186:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789997023.502916:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712844160 00000100:00100000:1.0:1789997023.502926:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712844160 00000100:00100000:1.0:1789997023.502975:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1789997023.502985:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712844160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997023.502999:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997023.503016:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b126 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997023.503042:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b126 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997023.503054:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b126 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997023.503063:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997023.503188:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712844160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997023.503195:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1789997023.503334:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8037100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712844160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997023.503353:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997023.503362:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997023.503514:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997023.503521:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997023.503530:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997023.693111:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712844416:0@lo:400:kworker.0 00000100:00100000:0.0:1789997023.693136:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712844672:0@lo:400:kworker.0 00000100:00100000:1.0:1789997023.693515:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712844544:0@lo:400:kworker.0 00000100:00100000:0.0:1789997023.696586:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997023.696721:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712844672 00000100:00100000:0.0:1789997023.696731:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712844672 00000100:00100000:0.0:1789997023.696792:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1789997023.696804:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712844672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997023.696872:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712844672:12345-0@lo:400:kworker.0 Request processed in 71us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997023.696880:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00080000:0.0:1789997023.696902:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997023.696939:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712844672:0@lo:400:kworker.0 00000100:00100000:2.0:1789997023.699891:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997023.703139:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712844416 00000100:00100000:0.0:1789997023.703154:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712844416 00000100:00100000:0.0:1789997023.703248:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:0.0:1789997023.703262:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712844416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997023.703370:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712844416:12345-0@lo:400:kworker.0 Request processed in 112us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997023.703389:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00080000:0.0:1789997023.703415:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997023.703462:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712844416:0@lo:400:kworker.0 00000100:00100000:0.0:1789997023.703505:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712844288 00000100:00100000:0.0:1789997023.703508:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712844288 00000100:00100000:0.0:1789997023.703538:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:0.0:1789997023.703545:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712844288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997023.703581:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712844288:12345-0@lo:400:kworker.0 Request processed in 37us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997023.703587:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:1.0:1789997023.703675:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997023.703702:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712844544 00000100:00100000:1.0:1789997023.703706:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712844544 00000100:00100000:1.0:1789997023.703739:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789997023.703746:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712844544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997023.703783:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712844544:12345-0@lo:400:kworker.0 Request processed in 39us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997023.703789:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789997023.703835:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8037480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712844544:0@lo:400:kworker.0 00000100:00080000:1.0:1789997023.703859:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997024.016560:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997024.398300:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704326784 00000100:00100000:0.0:1789997024.398314:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704326784 00000100:00100000:0.0:1789997024.398391:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 414 00000100:00100000:0.0:1789997024.398402:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:35917:x1876946704326784:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:0.0:1789997024.398426:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997024.398449:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae7e1 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398516:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398531:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398545:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398558:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398575:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398584:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398935:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398945:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.398953:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997024.398976:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:0.0:1789997024.398981:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997024.399000:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.399012:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.399019:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.399026:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.399032:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997024.399037:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.399051:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.399064:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997024.399067:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997024.399072:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.399078:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b13b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400188:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400213:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400220:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400225:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997024.400228:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400234:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400247:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997024.400250:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997024.400254:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400270:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b142 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400311:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7e1 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400331:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7e1 expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997024.400339:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997024.400341:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997024.400344:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997024.400417:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:35917:x1876946704326784:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 2016us (8636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997024.400425:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 414 00000100:00080000:1.0:1789997024.400888:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997024.408231:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997024.431364:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997024.432822:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704327296 00000100:00100000:2.0:1789997024.432833:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704327296 00000100:00100000:2.0:1789997024.432891:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 416 00000100:00100000:2.0:1789997024.432903:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:35917:x1876946704327296:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:2.0:1789997024.432960:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997024.432986:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7e8 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.433004:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:2.0:1789997024.433016:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997024.433058:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b173 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.433072:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.433084:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997024.433233:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000830dd4a7 reply state 0000000054181496 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997024.433243:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997024.433354:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:35917:x1876946704327296:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 453us (1997us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789997024.433361:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 416 00010000:00010000:1.0:1789997024.433742:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.433752:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b15e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.433758:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b15e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.433764:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997024.433770:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b15e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.433777:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b15e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.433789:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff8a38ee49e500) 00010000:00010000:1.0:1789997024.433792:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997024.433796:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b15e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.433803:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b15e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997024.442141:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997024.442177:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704327424 00000100:00100000:2.0:1789997024.442187:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704327424 00000100:00100000:2.0:1789997024.442254:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 417 00000100:00100000:2.0:1789997024.442265:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:35917:x1876946704327424:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997024.442289:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997024.442310:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b17a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae7ef expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.442370:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b17a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7ef expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.442386:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b17a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7ef expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.442406:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997024.442410:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997024.442413:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789997024.442465:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:35917:x1876946704327424:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 202us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997024.442473:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 417 00000100:00100000:2.0:1789997024.455153:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:1.0:1789997024.456397:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997024.460419:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704327808 00000100:00100000:1.0:1789997024.460441:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704327808 00000100:00100000:1.0:1789997024.460500:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:1.0:1789997024.460521:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de237850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:35917:x1876946704327808:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:1.0:1789997024.461178:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de237850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:35917:x1876946704327808:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 657us (921us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1789997024.461186:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 46 00000100:00100000:2.0:1789997024.513521:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:3.0:1789997024.514426:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514443:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997024.514447:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b188 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514465:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b188 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514477:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:3.0:1789997024.514480:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997024.514485:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b188 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514491:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b188 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514507:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b18f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514514:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b18f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514519:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514524:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997024.514527:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b18f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514532:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b18f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514550:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff8a38ee49e200) 00010000:00010000:3.0:1789997024.514553:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997024.514556:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b18f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514562:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b18f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514595:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7f6 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514620:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7f6 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997024.514628:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997024.514631:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997024.514633:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ba00, rc 0) 00000100:00100000:3.0:1789997024.514752:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:35921:x1876946704327936:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 758us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997024.514759:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 418 00000100:00100000:2.0:1789997024.519002:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997024.519152:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704328064 00000100:00100000:1.0:1789997024.519164:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704328064 00000100:00100000:1.0:1789997024.519269:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 212 00000100:00100000:1.0:1789997024.519292:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704328064:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:1.0:1789997024.519310:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997024.519332:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae7fd expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997024.519358:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x6ab12fe0, atime: 0x6ab12fe0, ctime: 0x6ab12fe0, blocks: 0x1 00010000:00010000:1.0:1789997024.519377:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=1213s v=(0 0) 00010000:00010000:1.0:1789997024.519381:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997024.519390:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.519408:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.519421:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997024.519484:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704328064:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 195us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997024.519491:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 212 00000100:00100000:2.0:1789997024.523547:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997024.523783:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704328320 00000100:00100000:3.0:1789997024.523793:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704328320 00000100:00100000:2.0:1789997024.524050:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 419 00000100:00100000:2.0:1789997024.524062:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:35921:x1876946704328320:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:2.0:1789997024.524117:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997024.524145:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7f6 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524170:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b17a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7ef expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524180:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997024.524192:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997024.524228:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524242:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524252:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524266:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524274:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524281:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524377:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524392:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.524398:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997024.525266:0:12471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9088 00000004:00080000:2.0:1789997024.525279:0:12471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1213217624007ns, next at 1214217621561ns, rc = 0 00010000:00010000:2.0:1789997024.525340:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525352:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525361:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525368:0:12471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525375:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525381:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525405:0:12471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997024.525440:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525447:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525460:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525465:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997024.525469:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525477:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525487:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997024.525489:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997024.525493:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525499:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b1b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525515:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525520:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525526:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525530:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997024.525533:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525546:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525552:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:2.0:1789997024.525555:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997024.525557:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997024.525563:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b1a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997024.525571:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4b3e1c6 reply state 000000002a51bf91 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997024.525579:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997024.525696:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:35921:x1876946704328320:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1635us (2158us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1789997024.525705:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 419 00010000:00010000:1.0:1789997024.526461:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997024.526470:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.526478:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997024.526481:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.526488:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.526503:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:1.0:1789997024.526505:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997024.526510:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.526516:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b1b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.526536:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997024.526538:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997024.526540:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997024.527818:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.527832:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.527839:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.527845:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997024.527862:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.527869:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.527883:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff8a38d0bdfa00) 00010000:00010000:1.0:1789997024.527886:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997024.527890:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997024.527896:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b1ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997025.035064:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997025.564963:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997025.564999:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997025.565039:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997025.565064:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997025.565098:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704328576 00000100:00100000:3.0:1789997025.565122:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704328576 00000100:00100000:3.0:1789997025.565187:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 867 00000100:00100000:3.0:1789997025.565199:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2354:x1876946704328576:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997025.565272:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2354:x1876946704328576:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997025.565279:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 867 00000100:00100000:3.0:1789997025.565301:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704328832 00000100:00100000:3.0:1789997025.565304:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704328832 00000100:00100000:3.0:1789997025.565323:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704328704 00000100:00100000:3.0:1789997025.565325:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704328704 00000100:00100000:3.0:1789997025.565349:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 447 00000100:00100000:3.0:1789997025.565355:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704328832:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997025.565380:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704328832:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997025.565386:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 447 00000100:00100000:3.0:1789997025.565397:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 448 00000100:00100000:3.0:1789997025.567167:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704328704:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997025.567247:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704328704:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1843us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997025.567257:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 448 00000100:00100000:3.0:1789997025.567295:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704328448 00000100:00100000:3.0:1789997025.567304:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704328448 00000100:00100000:3.0:1789997025.567354:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 794 00000100:00100000:3.0:1789997025.567364:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704328448:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997025.567392:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704328448:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (2353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997025.568188:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 794 00000100:00080000:2.0:1789997025.568481:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789997025.739071:0:7604:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1214431414994ns, next at 1215431412814ns, rc = 0 00000100:00100000:2.0:1789997025.739140:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712844928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997025.739219:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997025.739328:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712844928 00000100:00100000:0.0:1789997025.739336:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712844928 00000100:00100000:0.0:1789997025.739409:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789997025.739419:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712844928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997025.739465:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997025.739515:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712844928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997025.739523:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00080000:2.0:1789997025.739581:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997025.739644:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712844928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997025.740077:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712845056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997025.740109:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997025.743254:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712845056 00000100:00100000:0.0:1789997025.743270:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712845056 00000100:00100000:0.0:1789997025.743351:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:0.0:1789997025.743361:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712845056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997025.743400:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997025.743486:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712845056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997025.743492:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00080000:0.0:1789997025.743514:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997025.743749:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712845056:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1789997025.772943:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 38 committed 00000001:00080000:0.0:1789997025.772978:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000001:00080000:0.0:1789997025.772989:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967464 is committed 00000004:00080000:0.0:1789997025.772992:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 37 committed 00000100:00100000:1.0:1789997025.773188:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997025.773209:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712845184:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997025.773283:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997025.773461:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712845184 00000100:00100000:2.0:1789997025.773470:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712845184 00000100:00100000:2.0:1789997025.773552:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789997025.773562:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712845184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789997025.773590:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:14 count 1 00010000:00010000:2.0:1789997025.773629:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997025.773651:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997025.773680:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789997025.773685:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997025.773690:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997025.773717:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997025.773731:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 6 pid: 6656 timeout: 1314 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997025.773742:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712845312:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997025.773797:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c33953c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997025.781310:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997025.781383:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704328960 00000100:00100000:1.0:1789997025.781395:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704328960 00010000:00010000:1.0:1789997025.781438:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 7 pid: 6656 timeout: 1314 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997025.781495:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 273 00000100:00100000:1.0:1789997025.781505:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704328960:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997025.781521:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997025.781528:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 7 pid: 6656 timeout: 1314 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.781563:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 7 pid: 6656 timeout: 1314 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.781590:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997025.781595:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997025.781600:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.781609:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.781627:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997025.781709:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704328960:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 205us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997025.781717:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 273 00010000:00010000:2.0:1789997025.782283:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592b19d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7fd expref: 6 pid: 6656 timeout: 1314 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997025.782368:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712845312:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997025.782390:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997025.784000:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997025.784012:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997025.784024:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997025.784033:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997025.784063:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997025.784216:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997025.784225:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.784234:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997025.784238:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.784249:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.784282:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.784290:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5926ff1/0x65b43101d592b1c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997025.784312:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997025.784314:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997025.784316:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997025.785492:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712845184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11925us (12203us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789997025.785516:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000004:00080000:1.0:1789997025.785526:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c6a38700/2, rc 0, transno 4294967324 00000100:00100000:1.0:1789997025.785536:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712845184:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789997026.060562:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997026.262086:0:60461:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff58530d40 20000000:00000080:3.0:1789997026.262104:0:60461:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c8597c00 uarg=0000000000000000 00010000:00010000:3.0:1789997026.262615:0:60461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997026.262648:0:60461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:3.0:1789997026.262674:0:60461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997026.262687:0:60461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae7e1 expref: 5 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997026.262714:0:60461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997026.262731:0:60461:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997026.262745:0:60461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997026.262758:0:60461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b126 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997026.262766:0:60461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997026.262802:0:60461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b126 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997026.262817:0:60461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b126 expref: 18 pid: 5803 timeout: 1364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997026.262831:0:60461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60461:1876946712845440:0@lo:104: 00000100:00100000:3.0:1789997026.262893:0:60461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997026.262953:0:60461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997026.263205:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712845440 00000100:00100000:2.0:1789997026.263213:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712845440 00000100:00100000:2.0:1789997026.263266:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789997026.263275:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:60461:x1876946712845440:12345-0@lo:104: 00010000:00010000:2.0:1789997026.263288:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263360:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997026.263366:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:60461:x1876946712845440:12345-0@lo:104: Request processed in 93us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997026.263373:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00010000:2.0:1789997026.263395:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997026.263401:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263408:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997026.263412:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263420:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997026.263427:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997026.263432:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997026.263457:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263470:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997026.263493:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263500:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592b126 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b12d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263513:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997026.263515:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997026.263517:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997026.263537:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712845568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997026.263568:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997026.263603:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712845568 00000100:00100000:2.0:1789997026.263607:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712845568 00010000:00010000:2.0:1789997026.263625:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b126 expref: 19 pid: 5803 timeout: 1364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997026.263649:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789997026.263686:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712845568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997026.263697:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997026.263702:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b126 expref: 19 pid: 5803 timeout: 1364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263713:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b126 expref: 19 pid: 5803 timeout: 1364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263728:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263747:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263760:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263767:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263774:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263781:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263787:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997026.263790:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263798:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263806:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997026.263815:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997026.263860:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712845568:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997026.263867:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789997026.263915:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712845568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997026.264568:0:60461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592b12d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b126 expref: 18 pid: 5803 timeout: 1364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997026.264581:0:60461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60461:1876946712845440:0@lo:104: 00010000:00010000:1.0:1789997026.264597:0:60461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997026.264606:0:60461:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997026.264613:0:60461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997026.264619:0:60461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b1c7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789997026.869020:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1789997026.869037:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:1.0:1789997027.087333:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997027.723717:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997027.723724:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997027.723729:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997027.723781:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997027.723794:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997027.723806:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997027.723833:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712845696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997027.723999:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997027.724049:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0ccd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997027.724123:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712845696 00000100:00100000:3.0:1789997027.724141:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712845696 00000100:00100000:3.0:1789997027.724197:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1789997027.724205:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712845696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997027.724219:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997027.724232:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b1ce expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997027.724254:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b1ce expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997027.724264:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b1ce expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997027.724274:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997027.724320:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712845696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997027.724328:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1789997027.724506:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712845696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997027.724522:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997027.724531:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997027.724550:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997027.724555:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997027.724563:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997028.107195:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997028.810818:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712846080:0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.810884:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997028.810936:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997028.810943:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712846208:0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.810967:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997028.810999:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712846080 00000100:00100000:2.0:1789997028.811006:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712846080 00000100:00100000:0.0:1789997028.811049:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712845824:0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.811057:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1789997028.811067:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712846080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997028.811082:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997028.811108:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712846336:0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.811135:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712846080:12345-0@lo:400:kworker.0 Request processed in 70us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997028.811142:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1789997028.811147:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997028.811165:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712846208 00000100:00100000:0.0:1789997028.811167:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789997028.811173:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712845952:0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.811174:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712846208 00000100:00100000:0.0:1789997028.811193:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997028.811200:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712846336 00000100:00100000:2.0:1789997028.811202:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712846336 00000100:00100000:0.0:1789997028.811209:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712846464:0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.811223:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1789997028.811227:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997028.811229:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712846208:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997028.811250:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997028.811254:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997028.811257:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712846208:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997028.811262:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00080000:0.0:1789997028.811263:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997028.811273:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1789997028.811275:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712845824 00000100:00100000:2.0:1789997028.811278:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712846336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997028.811279:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712845824 00000100:00100000:0.0:1789997028.811307:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1789997028.811308:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712846336:12345-0@lo:400:kworker.0 Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997028.811314:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1789997028.811314:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712845824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.811331:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712845952 00000100:00100000:2.0:1789997028.811334:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712845952 00000100:00100000:0.0:1789997028.811342:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712845824:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997028.811347:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1789997028.811352:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712846464 00000100:00100000:2.0:1789997028.811354:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712846464 00000100:00100000:2.0:1789997028.811374:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:2.0:1789997028.811379:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712845952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.811478:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712845952:12345-0@lo:400:kworker.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997028.811637:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1789997028.811647:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712846464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997028.811704:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712846464:12345-0@lo:400:kworker.0 Request processed in 59us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997028.811710:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00080000:0.0:1789997028.811736:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997028.811762:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712845952:0@lo:400:kworker.0 00000100:00100000:0.0:1789997028.811774:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712846464:0@lo:400:kworker.0 00000100:00100000:0.0:1789997028.811782:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712845824:0@lo:400:kworker.0 00000100:00100000:0.0:1789997028.811789:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789997028.811793:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c6a38700, transno 4294967324 00000100:00100000:0.0:1789997028.811803:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712846336:0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.812364:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:2.0:1789997028.812587:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712846208:0@lo:400:kworker.0 00000100:00100000:2.0:1789997028.812601:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712846080:0@lo:400:kworker.0 00010000:00010000:2.0:1789997029.132733:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997029.242603:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997029.242727:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704329088 00000100:00100000:1.0:1789997029.242748:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704329088 00000100:00100000:1.0:1789997029.242822:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 420 00000100:00100000:1.0:1789997029.242833:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36009:x1876946704329088:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997029.242853:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997029.242876:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b1dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae804 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.242945:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b1e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.242959:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.242974:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997029.243009:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:1.0:1789997029.243013:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997029.243034:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b1e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.243062:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b1dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae804 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.243087:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b1e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae804 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.243120:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997029.243123:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997029.243128:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997029.243191:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36009:x1876946704329088:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 359us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997029.243198:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 420 00000100:00080000:0.0:1789997029.243414:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997029.260712:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997029.260788:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704329344 00000100:00100000:2.0:1789997029.261045:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704329344 00000100:00100000:0.0:1789997029.261395:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 421 00000100:00100000:0.0:1789997029.261406:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36009:x1876946704329344:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997029.261466:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997029.261492:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b1e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae804 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997029.261511:0:12471:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b149) 00010000:00010000:0.0:1789997029.261515:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:0.0:1789997029.261527:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997029.261688:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997029.261703:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997029.261714:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997029.295957:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967465 is committed 00000004:00010000:0.0:1789997029.296031:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040f3d4ef reply state 00000000be548677 transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997029.296046:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997029.296061:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00080000:0.0:1789997029.296177:0:12471:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997029.296372:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36009:x1876946704329344:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 34963us (35725us total) trans 4294967465 rc 0/0 00000100:00100000:0.0:1789997029.296381:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 421 00010000:00010000:1.0:1789997029.296829:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.296840:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.296848:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.296854:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997029.296859:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.296866:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.296882:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:1.0:1789997029.296885:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997029.296890:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997029.296897:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b1ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789997030.125349:0:60658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3c234900 20000000:00000080:1.0:1789997030.125368:0:60658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4d7fc00 uarg=0000000000000000 00010000:00010000:1.0:1789997030.126350:0:60658:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997030.126366:0:60658:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997030.126380:0:60658:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997030.126399:0:60658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997030.126417:0:60658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b1ce expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997030.126425:0:60658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997030.126466:0:60658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b1ce expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997030.126482:0:60658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b1ce expref: 18 pid: 7594 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997030.127994:0:60658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60658:1876946712846592:0@lo:104: 00000100:00100000:1.0:1789997030.128069:0:60658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997030.128174:0:60658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d399d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997030.128223:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789997030.128237:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712846592 00000100:00100000:0.0:1789997030.128244:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712846592 00000100:00100000:0.0:1789997030.128329:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789997030.128339:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:60658:x1876946712846592:12345-0@lo:104: 00010000:00010000:0.0:1789997030.128364:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997030.128437:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997030.128444:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:60658:x1876946712846592:12345-0@lo:104: Request processed in 107us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997030.128451:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00010000:00010000:2.0:1789997030.128537:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997030.128545:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997030.128553:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997030.128558:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997030.128566:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997030.128574:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997030.128581:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997030.128619:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997030.128625:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997030.128645:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997030.128683:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592b1ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b1d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997030.128956:0:60658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60658:1876946712846592:0@lo:104: 00010000:00010000:3.0:1789997030.128979:0:60658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997030.129028:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997030.129031:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997030.129033:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997030.129056:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712846720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997030.129107:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997030.129199:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712846720 00000100:00100000:3.0:1789997030.129203:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712846720 00010000:00010000:3.0:1789997030.129226:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b1ce expref: 19 pid: 7594 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997030.129272:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789997030.129280:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712846720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997030.129292:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997030.129297:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b1ce expref: 19 pid: 7594 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129307:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b1ce expref: 19 pid: 7594 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129321:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052aa00/0x65b43101d592b1d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b1ce expref: 19 pid: 7594 timeout: 1368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129336:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129344:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129358:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129365:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129371:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129377:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129393:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997030.129397:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129405:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129418:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129427:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997030.129460:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712846720:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997030.129466:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00010000:3.0:1789997030.129488:0:60658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129510:0:60658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997030.129516:0:60658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b1f1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997030.131593:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712846720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997030.157795:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997030.682717:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997030.682762:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997030.682804:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997030.682832:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997030.683342:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704329600 00000100:00100000:1.0:1789997030.683354:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704329600 00000100:00100000:1.0:1789997030.683411:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 871 00000100:00100000:1.0:1789997030.683420:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704329600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997030.683496:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704329600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 77us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997030.683530:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 871 00000100:00100000:1.0:1789997030.683688:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704329472 00000100:00100000:1.0:1789997030.683693:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704329472 00000100:00100000:1.0:1789997030.683721:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 797 00000100:00100000:1.0:1789997030.683728:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704329472:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997030.683757:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704329472:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997030.683764:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 797 00000100:00100000:0.0:1789997030.684163:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704329856 00000100:00100000:0.0:1789997030.684168:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704329856 00000100:00100000:0.0:1789997030.684226:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704329728 00000100:00100000:0.0:1789997030.684230:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704329728 00000100:00100000:0.0:1789997030.684254:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 451 00000100:00100000:0.0:1789997030.684262:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704329856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997030.684301:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704329856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997030.684307:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 451 00000100:00100000:0.0:1789997030.684319:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 452 00000100:00100000:0.0:1789997030.684326:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704329728:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997030.684348:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704329728:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 23us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997030.684353:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 452 00000100:00080000:1.0:1789997030.684638:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997030.684642:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997030.859388:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712846848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997030.859453:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997030.860200:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712846848 00000100:00100000:0.0:1789997030.860217:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712846848 00000100:00100000:0.0:1789997030.860279:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1789997030.860289:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712846848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997030.860337:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997030.860417:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712846848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997030.860425:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:0.0:1789997030.860480:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712846848:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997030.860689:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997030.860895:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997030.860905:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712846976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997030.860937:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997030.860972:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712846976 00000100:00100000:0.0:1789997030.860976:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712846976 00000100:00100000:0.0:1789997030.861007:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1789997030.861013:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712846976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997030.861032:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997030.861085:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712846976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997030.861090:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00080000:0.0:1789997030.861104:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997030.861123:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712846976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997031.184506:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997032.075304:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997032.075312:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997032.075316:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997032.075361:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997032.075389:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997032.075407:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997032.075613:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712847104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997032.075711:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997032.075757:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b510c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997032.075831:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712847104 00000100:00100000:2.0:1789997032.075841:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712847104 00000100:00100000:2.0:1789997032.075889:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1789997032.075899:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712847104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997032.075913:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997032.075926:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b1f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997032.075948:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997032.075958:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997032.075967:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997032.076009:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712847104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997032.076016:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1789997032.078566:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712847104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997032.078594:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997032.078608:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997032.078671:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997032.078678:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997032.078685:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997032.205374:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997033.008719:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997033.009109:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704329984 00000100:00100000:3.0:1789997033.009121:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704329984 00000100:00100000:3.0:1789997033.009197:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 422 00000100:00100000:3.0:1789997033.009208:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36086:x1876946704329984:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997033.009229:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997033.009253:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b206 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae80b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009455:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009469:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009483:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009496:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009517:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009525:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009979:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b21b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009989:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.009996:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997033.010017:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:3.0:1789997033.010021:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997033.010052:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010064:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010071:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010078:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010084:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997033.010088:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010103:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010114:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:3.0:1789997033.010117:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997033.010122:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010128:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b20d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010141:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010147:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010153:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010158:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997033.010161:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010166:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010172:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38ee49e600) 00010000:00010000:3.0:1789997033.010174:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997033.010176:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010191:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b214 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010224:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b206 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae80b expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010238:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b21b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae80b expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997033.010245:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997033.010248:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997033.010250:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00080000:0.0:1789997033.010641:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997033.016570:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36086:x1876946704329984:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 7351us (7847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997033.016595:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 422 00010000:00010000:3.0:1789997033.226822:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997033.931041:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712847616:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931107:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997033.931164:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789997033.931169:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712847232:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931217:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997033.931238:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712847744:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931256:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997033.931276:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712847360:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931297:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997033.931312:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712847872:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931327:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997033.931339:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997033.931343:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712847488:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931358:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997033.931383:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712847616 00000100:00100000:0.0:1789997033.931390:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712847616 00000100:00100000:0.0:1789997033.931431:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712847744 00000100:00100000:0.0:1789997033.931433:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712847744 00000100:00100000:0.0:1789997033.931450:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789997033.931457:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712847616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931500:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712847616:12345-0@lo:400:kworker.0 Request processed in 43us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997033.931506:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789997033.931520:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789997033.931525:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712847744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931548:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712847744:12345-0@lo:400:kworker.0 Request processed in 23us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997033.931554:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789997033.931571:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712847232 00000100:00100000:0.0:1789997033.931574:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712847232 00000100:00100000:0.0:1789997033.931602:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1789997033.931608:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712847232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931634:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712847232:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997033.931640:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1789997033.931688:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712847360 00000100:00100000:0.0:1789997033.931691:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712847360 00000100:00100000:0.0:1789997033.931711:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712847872 00000100:00100000:0.0:1789997033.931713:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712847872 00000100:00100000:0.0:1789997033.931727:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712847488 00000100:00100000:0.0:1789997033.931729:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712847488 00000100:00100000:0.0:1789997033.931745:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1789997033.931750:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712847360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931779:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712847360:12345-0@lo:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997033.931784:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1789997033.931793:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1789997033.931798:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712847872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931817:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712847872:12345-0@lo:400:kworker.0 Request processed in 19us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997033.931822:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1789997033.931830:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:0.0:1789997033.931834:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712847488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931853:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712847488:12345-0@lo:400:kworker.0 Request processed in 18us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997033.931858:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00080000:0.0:1789997033.931917:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997033.931927:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997033.931929:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997033.931975:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712847488:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931984:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712847360:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.931992:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712847872:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.932032:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712847232:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.932041:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712847744:0@lo:400:kworker.0 00000100:00100000:0.0:1789997033.932050:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712847616:0@lo:400:kworker.0 00010000:00010000:3.0:1789997034.250830:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997034.731800:0:60905:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8c7cf4e0 20000000:00000080:3.0:1789997034.731826:0:60905:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c0a800 uarg=0000000000000000 00010000:00010000:3.0:1789997034.732604:0:60905:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997034.732647:0:60905:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997034.732823:0:60905:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997034.732836:0:60905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b21b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae80b expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997034.732860:0:60905:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997034.732876:0:60905:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997034.732897:0:60905:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997034.732911:0:60905:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997034.732919:0:60905:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997034.732955:0:60905:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997034.732969:0:60905:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 18 pid: 5804 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997034.732984:0:60905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60905:1876946712848000:0@lo:104: 00000100:00100000:3.0:1789997034.733059:0:60905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997034.733243:0:60905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c11ca780 going to sleep for 11 seconds 00000100:00100000:2.0:1789997034.733629:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712848000 00000100:00100000:2.0:1789997034.733637:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712848000 00000100:00100000:3.0:1789997034.733916:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789997034.733927:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:60905:x1876946712848000:12345-0@lo:104: 00010000:00010000:3.0:1789997034.733941:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997034.734025:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997034.734032:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:60905:x1876946712848000:12345-0@lo:104: Request processed in 107us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997034.734039:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789997034.734120:0:60905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60905:1876946712848000:0@lo:104: 00010000:00010000:1.0:1789997034.734142:0:60905:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997034.734251:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997034.734259:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997034.734266:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997034.734270:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997034.734279:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997034.734287:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997034.734293:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997034.734332:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997034.734339:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997034.734371:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997034.734378:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592b1f8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b1ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997034.734395:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997034.734397:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997034.734398:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997034.734479:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712848128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997034.734517:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997034.734614:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712848128 00000100:00100000:1.0:1789997034.734619:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712848128 00010000:00010000:1.0:1789997034.734641:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 19 pid: 5804 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997034.734694:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789997034.734701:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712848128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997034.734711:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997034.734716:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 19 pid: 5804 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734726:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 19 pid: 5804 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734745:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592b1ff lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b1f8 expref: 19 pid: 5804 timeout: 1373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734757:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734765:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734778:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734785:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734791:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734797:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734803:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997034.734808:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734814:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734836:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997034.734855:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997034.734883:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712848128:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997034.734890:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789997034.735031:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712848128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997034.735055:0:60905:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997034.735063:0:60905:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997034.735068:0:60905:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b222 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60905 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997035.277829:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997035.813431:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997035.813472:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997035.813504:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704330240 00000100:00100000:0.0:1789997035.813515:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704330240 00000100:00100000:0.0:1789997035.813576:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 875 00000100:00100000:0.0:1789997035.813588:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704330240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997035.813700:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704330240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 114us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997035.813708:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 875 00000100:00100000:0.0:1789997035.813731:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704330112 00000100:00100000:0.0:1789997035.813734:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704330112 00000100:00100000:0.0:1789997035.813757:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 800 00000100:00100000:0.0:1789997035.813763:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704330112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997035.813788:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704330112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997035.813795:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 800 00000100:00080000:0.0:1789997035.813820:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997035.829196:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997035.829455:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704330368 00000100:00100000:0.0:1789997035.829469:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704330368 00000100:00100000:0.0:1789997035.829540:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 214 00000100:00100000:0.0:1789997035.829551:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704330368:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:0.0:1789997035.829582:0:8169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592b085 00000100:00080000:0.0:1789997035.829593:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38c859f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789997035.829635:0:8169:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967322 00000100:00100000:0.0:1789997035.829937:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704330368:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 386us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997035.829947:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 214 00010000:00010000:0.0:1789997035.830046:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789997035.830057:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997035.830150:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997035.830171:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704330496 00000100:00100000:1.0:1789997035.830176:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704330496 00000100:00100000:1.0:1789997035.830275:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 455 00000100:00100000:1.0:1789997035.830285:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704330496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997035.830535:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704330496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 252us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997035.830542:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 455 00000100:00080000:1.0:1789997035.830564:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997035.978815:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712848256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997035.978954:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997035.979048:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712848256 00000100:00100000:0.0:1789997035.979062:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712848256 00000100:00100000:0.0:1789997035.979117:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1789997035.979125:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712848256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997035.979159:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997035.979409:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712848256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 283us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997035.979490:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1789997035.979545:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712848256:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997035.981794:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997035.981806:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997035.981835:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712848384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997035.981908:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997035.983359:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712848384 00000100:00100000:0.0:1789997035.983383:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712848384 00000100:00100000:0.0:1789997035.983467:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1789997035.983478:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712848384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997035.983519:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997035.983600:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712848384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997035.983608:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1789997035.983696:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712848384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997035.984052:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1789997036.178036:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997036.178045:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997036.178050:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997036.178092:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997036.178104:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997036.178116:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997036.178155:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712848512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997036.178227:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997036.178284:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59600 going to sleep for 11 seconds 00000100:00100000:1.0:1789997036.178375:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712848512 00000100:00100000:1.0:1789997036.178384:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712848512 00000100:00100000:1.0:1789997036.178436:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1789997036.178445:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712848512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997036.178457:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997036.178469:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b229 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997036.178500:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b229 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997036.178509:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b229 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997036.178519:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997036.178554:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712848512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997036.178560:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:0.0:1789997036.178759:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712848512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997036.178775:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997036.178783:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997036.178800:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997036.178805:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997036.178813:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997036.298833:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789997037.080867:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997037.080874:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a38c859e000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:3.0:1789997037.080959:0:40741:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38c859e000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:3.0:1789997037.081010:0:40741:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38c859f800 for lustre-OST0000 00010000:00010000:3.0:1789997037.323191:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997037.654052:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997037.655123:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704330624 00000100:00100000:2.0:1789997037.655136:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704330624 00000100:00100000:2.0:1789997037.655290:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 423 00000100:00100000:2.0:1789997037.655363:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36173:x1876946704330624:12345-192.168.204.4@tcp:101:chmod.0 00000100:00080000:3.0:1789997037.655440:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789997037.655509:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997037.655533:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b237 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae812 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997037.655600:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b23e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997037.655614:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997037.655627:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997037.655679:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:2.0:1789997037.655684:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997037.655703:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997037.655753:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae812 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997037.655774:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae812 expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997037.655783:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997037.655786:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997037.655789:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997037.655859:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36173:x1876946704330624:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 560us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997037.655867:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 423 00000100:00100000:2.0:1789997037.660003:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997037.660066:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704330880 00000100:00100000:3.0:1789997037.660078:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704330880 00000100:00100000:3.0:1789997037.660142:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 424 00000100:00100000:3.0:1789997037.660153:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36173:x1876946704330880:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997037.660318:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997037.660346:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b23e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae812 expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.660362:0:5810:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b21b) 00010000:00010000:3.0:1789997037.660367:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997037.660378:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997037.660403:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.660417:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.660427:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997037.666883:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013c603d4 reply state 000000006ca4b78a transno 4294967466 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997037.666904:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997037.666919:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000100:00100000:2.0:1789997037.667324:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36173:x1876946704330880:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 7168us (7326us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789997037.667336:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 424 00010000:00010000:3.0:1789997037.672437:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.672454:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.672462:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.672480:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997037.672485:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.672493:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.672508:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997037.672512:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997037.672516:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997037.672522:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592b245 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997038.346912:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997038.552143:0:61101:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe9f419990 20000000:00000080:3.0:1789997038.552278:0:61101:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c08400 uarg=0000000000000000 00010000:00010000:3.0:1789997038.552598:0:61101:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997038.552614:0:61101:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997038.552628:0:61101:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997038.552648:0:61101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997038.552931:0:61101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b229 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997038.552941:0:61101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997038.553065:0:61101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b229 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997038.553091:0:61101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b229 expref: 18 pid: 7594 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997038.553107:0:61101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61101:1876946712848640:0@lo:104: 00000100:00100000:3.0:1789997038.553301:0:61101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997038.553408:0:61101:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c35fb000 going to sleep for 11 seconds 00000100:00100000:1.0:1789997038.553453:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712848640 00000100:00100000:1.0:1789997038.553540:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712848640 00000100:00100000:1.0:1789997038.553643:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789997038.553836:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:61101:x1876946712848640:12345-0@lo:104: 00010000:00010000:1.0:1789997038.553850:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997038.554025:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997038.554031:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:61101:x1876946712848640:12345-0@lo:104: Request processed in 380us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997038.554039:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00010000:2.0:1789997038.554187:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997038.554194:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554202:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997038.554205:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554223:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997038.554230:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997038.554236:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997038.554273:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554280:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997038.554312:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554320:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592b229 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b230 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554342:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997038.554344:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997038.554346:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997038.554353:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997038.554364:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712848768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997038.554400:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997038.554440:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712848768 00000100:00100000:2.0:1789997038.554444:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712848768 00010000:00010000:2.0:1789997038.554480:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b229 expref: 19 pid: 7594 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997038.554503:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789997038.554517:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712848768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997038.554527:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997038.554532:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b229 expref: 19 pid: 7594 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554543:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b229 expref: 19 pid: 7594 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554561:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554569:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554585:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554592:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554599:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554605:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554611:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997038.554615:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554624:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554640:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997038.554650:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997038.554703:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712848768:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997038.554709:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789997038.554755:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712848768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997038.555309:0:61101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b230 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b229 expref: 18 pid: 7594 timeout: 1377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997038.555323:0:61101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61101:1876946712848640:0@lo:104: 00010000:00010000:3.0:1789997038.555339:0:61101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997038.555349:0:61101:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997038.555356:0:61101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997038.555362:0:61101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b400/0x65b43101d592b24c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997039.051292:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712848896:0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.051366:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997039.051417:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712849408:0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.051439:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997039.051479:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997039.051486:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712849280:0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.051512:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997039.051760:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712848896 00000100:00100000:1.0:1789997039.051768:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712848896 00000100:00100000:1.0:1789997039.051813:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712849408 00000100:00100000:1.0:1789997039.051816:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712849408 00000100:00100000:1.0:1789997039.051851:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1789997039.051859:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712848896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.051934:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712848896:12345-0@lo:400:kworker.0 Request processed in 75us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997039.051941:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1789997039.051959:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1789997039.051965:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712849408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.052003:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712849408:12345-0@lo:400:kworker.0 Request processed in 38us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997039.052009:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:1.0:1789997039.052029:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712849152:0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.052068:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997039.052094:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997039.052099:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712849024:0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.052116:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997039.052141:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712849024 00000100:00100000:1.0:1789997039.052145:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712849024 00000100:00100000:1.0:1789997039.052169:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:1.0:1789997039.052174:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712849024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.052203:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712849024:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997039.052215:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00080000:1.0:1789997039.052231:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997039.052266:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712849024:0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.052291:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712848896:0@lo:400:kworker.0 00000100:00100000:1.0:1789997039.052299:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712849408:0@lo:400:kworker.0 00000100:00100000:0.0:1789997039.052752:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712849280 00000100:00100000:0.0:1789997039.052757:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712849280 00000100:00100000:0.0:1789997039.052789:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712849152 00000100:00100000:0.0:1789997039.052792:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712849152 00000100:00100000:0.0:1789997039.052810:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789997039.052817:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712849280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997039.052863:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712849280:12345-0@lo:400:kworker.0 Request processed in 46us (1349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997039.052954:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789997039.052967:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1789997039.053092:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712849152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997039.053130:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712849152:12345-0@lo:400:kworker.0 Request processed in 157us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997039.053136:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:0.0:1789997039.053160:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997039.053163:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997039.053185:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712849152:0@lo:400:kworker.0 00000100:00100000:0.0:1789997039.053213:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712849280:0@lo:400:kworker.0 00010000:00010000:3.0:1789997039.376533:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997039.626313:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967466 is committed 00010000:00010000:1.0:1789997040.395839:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997040.522718:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997040.522727:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997040.522732:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997040.522787:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997040.522801:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997040.522814:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997040.522842:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712849536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997040.522940:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997040.522994:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712849536 00000100:00100000:1.0:1789997040.523003:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712849536 00000100:00100000:0.0:1789997040.523008:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e0d99180 going to sleep for 11 seconds 00000100:00100000:1.0:1789997040.523076:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1789997040.523086:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712849536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997040.523099:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997040.523113:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b253 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997040.523138:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b253 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997040.523149:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b253 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997040.523159:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997040.523205:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712849536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997040.523212:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:0.0:1789997040.523301:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712849536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997040.523331:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997040.523340:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997040.523360:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997040.523364:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997040.523371:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997040.919289:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997040.919330:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997040.919421:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997040.919647:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704331136 00000100:00100000:3.0:1789997040.919687:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704331136 00000100:00100000:3.0:1789997040.919756:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 879 00000100:00100000:3.0:1789997040.919767:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704331136:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997040.919787:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704331008 00000100:00100000:1.0:1789997040.919791:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704331008 00000100:00100000:1.0:1789997040.919834:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 803 00000100:00100000:1.0:1789997040.919840:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704331008:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997040.919844:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704331136:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997040.919857:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 879 00000100:00100000:1.0:1789997040.919886:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704331008:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997040.919892:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 803 00000100:00080000:2.0:1789997040.920085:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997040.927161:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704331264 00000100:00100000:0.0:1789997040.927178:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704331264 00000100:00100000:0.0:1789997040.927269:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 458 00000100:00100000:0.0:1789997040.927280:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704331264:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997040.927375:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704331264:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 98us (8044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997040.927383:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 458 00000100:00080000:3.0:1789997040.927595:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997041.099084:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997041.099116:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712849664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997041.099182:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997041.099258:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712849664 00000100:00100000:0.0:1789997041.099266:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712849664 00000100:00100000:0.0:1789997041.099320:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1789997041.099329:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712849664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997041.099379:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997041.099436:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712849664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997041.099444:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1789997041.099499:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712849664:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997041.099599:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997041.099902:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712849792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997041.099937:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997041.106107:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712849792 00000100:00100000:3.0:1789997041.106125:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712849792 00000100:00100000:3.0:1789997041.106320:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:3.0:1789997041.106334:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712849792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997041.106378:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997041.106481:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712849792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (6542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997041.106488:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00080000:0.0:1789997041.106548:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997041.111175:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712849792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997041.419515:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997041.605519:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997041.605952:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704331392 00000100:00100000:1.0:1789997041.605963:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704331392 00000100:00100000:1.0:1789997041.606040:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 425 00000100:00100000:1.0:1789997041.606051:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704331392:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997041.606163:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704331392:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 113us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997041.606171:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 425 00000100:00100000:0.0:1789997041.608806:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997041.608912:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704331520 00000100:00100000:1.0:1789997041.608921:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704331520 00000100:00100000:1.0:1789997041.608965:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 215 00000100:00100000:1.0:1789997041.608973:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876946704331520:12345-192.168.204.4@tcp:8:lfs.60003 00010000:00080000:1.0:1789997041.609005:0:6659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1230 last 0 00000020:00000080:1.0:1789997041.609141:0:6659:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592b261 00002000:00100000:1.0:1789997041.609154:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38c53de000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789997041.609167:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789997041.609401:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789997041.609577:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c53da000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789997041.610228:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704331520:12345-192.168.204.4@tcp:8:lfs.60003 Request processed in 679us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997041.610255:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 215 00000100:00100000:2.0:1789997041.611925:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997041.612165:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704331648 00000100:00100000:0.0:1789997041.612174:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704331648 00000100:00100000:0.0:1789997041.612282:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 216 00000100:00100000:0.0:1789997041.612292:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36257:x1876946704331648:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997041.612717:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36257:x1876946704331648:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 425us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997041.612725:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 216 00000100:00080000:3.0:1789997041.613767:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997041.615641:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997041.615830:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704331776 00000100:00100000:0.0:1789997041.615839:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704331776 00000100:00100000:0.0:1789997041.615953:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 217 00000100:00100000:0.0:1789997041.615964:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704331776:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997041.616457:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704331776:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 493us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997041.616465:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 217 00000100:00100000:2.0:1789997041.619589:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997041.619831:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704331904 00000100:00100000:1.0:1789997041.619842:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704331904 00000100:00100000:1.0:1789997041.619941:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 426 00000100:00100000:1.0:1789997041.619951:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704331904:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997041.620696:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704331904:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 743us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997041.620707:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 426 00000100:00100000:2.0:1789997041.631544:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997041.631795:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704332032 00000100:00100000:3.0:1789997041.631806:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704332032 00000100:00100000:3.0:1789997041.632116:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 427 00000100:00100000:3.0:1789997041.632128:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704332032:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997041.632233:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704332032:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 106us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997041.632240:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 427 00000100:00100000:2.0:1789997041.636717:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997041.637235:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704332160 00000100:00100000:0.0:1789997041.637246:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704332160 00000100:00100000:0.0:1789997041.637355:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 218 00000100:00100000:0.0:1789997041.637367:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36257:x1876946704332160:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997041.637816:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36257:x1876946704332160:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 450us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997041.637975:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 218 00000100:00100000:2.0:1789997041.640632:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997041.642220:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704332288 00000100:00100000:1.0:1789997041.642236:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704332288 00000100:00100000:1.0:1789997041.642296:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 219 00000100:00100000:1.0:1789997041.642307:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704332288:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997041.642754:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704332288:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 447us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997041.642762:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 219 00000100:00100000:2.0:1789997041.649311:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997041.649499:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704332416 00000100:00100000:1.0:1789997041.649512:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704332416 00000100:00100000:1.0:1789997041.649572:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 428 00000100:00100000:1.0:1789997041.649584:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704332416:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997041.650323:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36257:x1876946704332416:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 738us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997041.650333:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 428 00000100:00100000:2.0:1789997041.702013:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997041.705166:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704332544 00000100:00100000:0.0:1789997041.705184:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704332544 00000100:00100000:0.0:1789997041.705255:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 429 00000100:00100000:0.0:1789997041.705267:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36261:x1876946704332544:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997041.705289:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997041.705312:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b268 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae819 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705377:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705393:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705406:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705422:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705429:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705436:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705841:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b27d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705857:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705877:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997041.705902:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:0.0:1789997041.705906:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997041.705925:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b27d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705938:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705944:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705951:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705957:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997041.705961:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705968:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.705980:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997041.705983:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997041.705988:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706004:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b26f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706027:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706034:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706039:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706045:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997041.706048:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706054:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706061:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997041.706064:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997041.706067:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706074:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b276 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706105:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b268 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae819 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706136:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b27d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae819 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.706143:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997041.706146:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997041.706148:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997041.706280:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36261:x1876946704332544:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 1015us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997041.706288:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 429 00000100:00100000:1.0:1789997041.713800:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997041.713886:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704332800 00000100:00100000:0.0:1789997041.713898:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704332800 00000100:00100000:0.0:1789997041.714273:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 430 00000100:00100000:0.0:1789997041.714285:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36261:x1876946704332800:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997041.714307:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997041.714329:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b284 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae820 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.714638:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.714692:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.714705:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.714721:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.714740:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.714748:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997041.715515:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xe:0x0], index 0: 0 00010000:00010000:1.0:1789997041.715843:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b299 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716139:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716151:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b299 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716206:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716214:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716220:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716227:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997041.716231:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716239:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716251:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:1.0:1789997041.716254:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997041.716260:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716266:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592b28b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997041.716295:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a0345d6 reply state 0000000052853550 transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997041.716310:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997041.716352:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b284 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae820 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716370:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b299 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae820 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997041.716378:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:1.0:1789997041.716380:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997041.716383:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997041.716530:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:36261:x1876946704332800:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 2246us (2739us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789997041.716539:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 430 00010000:00010000:3.0:1789997041.721054:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997041.721071:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997041.721096:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997041.721103:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997041.721107:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997041.721116:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997041.721131:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff8a38c28e9200) 00010000:00010000:3.0:1789997041.721135:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997041.721140:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997041.721146:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b292 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997041.722010:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997041.722105:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704332928 00000100:00100000:0.0:1789997041.722115:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704332928 00000100:00100000:0.0:1789997041.722276:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 220 00000100:00100000:0.0:1789997041.722287:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36261:x1876946704332928:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997041.722304:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997041.722388:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae827 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997041.722418:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789997041.722441:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=1230s v=(0 0) 00010000:00010000:0.0:1789997041.722446:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997041.722455:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.722481:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997041.722493:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997041.722553:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36261:x1876946704332928:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 267us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997041.722572:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 220 00000100:00100000:2.0:1789997041.741814:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997041.742029:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704333056 00000100:00100000:0.0:1789997041.742040:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704333056 00002000:00100000:0.0:1789997041.742094:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xe:0x0] (0->1048575) req@ffff8a38ffdfb800 x1876946704333056/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:17/0 lens 488/0 e 0 to 0 dl 1789997052 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997041.742105:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38ffdfb800 with x1876946704333056 ext(0->1048575) 00002000:00010000:0.0:1789997041.742110:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38ffdfb800 00000100:00100000:1.0:1789997041.742244:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1789997041.742256:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704333056:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:0.0:1789997041.743780:0:6663:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789997041.743793:0:6663:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000001:00100000:2.0:1789997041.833353:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000001:00080000:2.0:1789997041.878003:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:1.0:1789997041.878308:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704333056:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 136046us (136494us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789997041.878321:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00002000:00100000:1.0:1789997041.878337:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xe:0x0] (0->1048575) req@ffff8a38ffdfb800 x1876946704333056/t4294967323(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:17/0 lens 488/448 e 0 to 0 dl 1789997052 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789997041.878348:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38ffdfb800 with x1876946704333056 ext(0->1048575) 00002000:00010000:1.0:1789997041.878355:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38ffdfb800 00000100:00100000:3.0:1789997041.881928:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997041.882079:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704333184 00000100:00100000:2.0:1789997041.882193:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704333184 00000100:00100000:2.0:1789997041.882301:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 431 00000100:00100000:2.0:1789997041.882323:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36261:x1876946704333184:12345-192.168.204.4@tcp:44:dd.60003 00000100:00100000:3.0:1789997041.929232:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36261:x1876946704333184:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 46899us (47302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997041.929248:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 431 00000100:00100000:2.0:1789997041.933415:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997041.933692:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704333312 00000100:00100000:1.0:1789997041.933718:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704333312 00000100:00100000:1.0:1789997041.933775:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 221 00000100:00100000:1.0:1789997041.933786:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704333312:12345-192.168.204.4@tcp:16:dd.60003 00000100:00100000:1.0:1789997041.933914:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704333312:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 129us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997041.933922:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 221 00000001:00080000:0.0:1789997041.936421:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967467 is committed 00000100:00100000:1.0:1789997041.945007:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997041.945102:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704333568 00000100:00100000:3.0:1789997041.945112:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704333568 00000100:00100000:3.0:1789997041.945168:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 47 00000100:00100000:3.0:1789997041.945179:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36261:x1876946704333568:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:3.0:1789997041.945693:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36261:x1876946704333568:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 478us (668us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789997041.945718:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 47 00010000:00010000:3.0:1789997042.443777:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997042.940342:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967468 is committed 00010000:00010000:0.0:1789997043.466853:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997044.020118:0:61348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1232712461484ns, next at 1185735516222ns, rc = 0 00000004:00080000:1.0:1789997044.020221:0:61348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1232712566248ns, next at 1215431412814ns, rc = 0 00000004:00080000:2.0:1789997044.023809:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 39 committed 00000004:00080000:2.0:1789997044.023846:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 37 committed 00000100:00100000:1.0:1789997044.171535:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712850304:0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.171602:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997044.171755:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997044.171762:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712850176:0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.171791:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997044.171945:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712850048:0@lo:400:kworker.0 00000100:00100000:0.0:1789997044.171975:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997044.172001:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712850560:0@lo:400:kworker.0 00000100:00100000:0.0:1789997044.172021:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997044.172040:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789997044.172047:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712849920:0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.172075:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712850176 00000100:00100000:0.0:1789997044.172075:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997044.172082:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712850176 00000100:00100000:1.0:1789997044.172133:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712850048 00000100:00100000:1.0:1789997044.172137:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712850048 00000100:00100000:1.0:1789997044.172154:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712850560 00000100:00100000:1.0:1789997044.172157:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712850560 00000100:00100000:1.0:1789997044.172181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1789997044.172189:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712850176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.172408:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712850176:12345-0@lo:400:kworker.0 Request processed in 218us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997044.172416:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1789997044.172436:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1789997044.172448:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712850048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.172494:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712850048:12345-0@lo:400:kworker.0 Request processed in 46us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997044.172500:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1789997044.172515:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1789997044.172521:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712850560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.172547:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712850560:12345-0@lo:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997044.172552:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00080000:1.0:1789997044.172571:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997044.172611:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712850176:0@lo:400:kworker.0 00000100:00100000:0.0:1789997044.173583:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712850432:0@lo:400:kworker.0 00000100:00100000:0.0:1789997044.174494:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997044.174547:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712850048:0@lo:400:kworker.0 00000100:00100000:0.0:1789997044.174561:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712850560:0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.175015:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712849920 00000100:00100000:1.0:1789997044.175022:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712849920 00000100:00100000:1.0:1789997044.175068:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1789997044.175076:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712849920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.175129:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712849920:12345-0@lo:400:kworker.0 Request processed in 54us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997044.175137:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1789997044.175796:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712850304 00000100:00100000:2.0:1789997044.175802:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712850304 00000100:00100000:2.0:1789997044.175906:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712850432 00000100:00100000:2.0:1789997044.175911:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712850432 00000100:00100000:1.0:1789997044.177405:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789997044.177480:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712850304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.177561:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712850304:12345-0@lo:400:kworker.0 Request processed in 89us (5958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997044.177569:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789997044.177591:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789997044.177598:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712850432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997044.177640:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712850432:12345-0@lo:400:kworker.0 Request processed in 43us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997044.177647:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789997044.177948:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712850304:0@lo:400:kworker.0 00000100:00080000:2.0:1789997044.178205:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997044.178211:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997044.178238:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712849920:0@lo:400:kworker.0 00000100:00100000:0.0:1789997044.178255:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712850432:0@lo:400:kworker.0 00010000:00010000:2.0:1789997044.491975:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997045.273921:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997045.274057:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704333696 00000100:00100000:0.0:1789997045.274068:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704333696 00000100:00100000:0.0:1789997045.274144:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 432 00000100:00100000:0.0:1789997045.274156:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36454:x1876946704333696:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997045.274258:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36454:x1876946704333696:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 104us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997045.274266:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 432 00000100:00080000:3.0:1789997045.274421:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997045.276804:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997045.278767:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704333824 00000100:00100000:3.0:1789997045.278784:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704333824 00000100:00100000:3.0:1789997045.278891:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 222 00000100:00100000:3.0:1789997045.278903:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36454:x1876946704333824:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997045.279285:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36454:x1876946704333824:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 383us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997045.279294:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 222 00000100:00080000:0.0:1789997045.279536:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997045.285946:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997045.286088:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704333952 00000100:00100000:3.0:1789997045.286099:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704333952 00000100:00100000:3.0:1789997045.286170:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 223 00000100:00100000:3.0:1789997045.286181:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36454:x1876946704333952:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997045.286564:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36454:x1876946704333952:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 383us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997045.286572:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 223 00000100:00080000:0.0:1789997045.286788:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997045.300154:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997045.301066:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704334080 00000100:00100000:2.0:1789997045.301078:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704334080 00000100:00100000:2.0:1789997045.301139:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 433 00000100:00100000:2.0:1789997045.301150:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36454:x1876946704334080:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997045.301558:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36454:x1876946704334080:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 408us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997045.301566:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 433 00000100:00100000:0.0:1789997045.325249:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997045.325602:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704334208 00000100:00100000:3.0:1789997045.325613:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704334208 00000100:00100000:3.0:1789997045.325686:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 434 00000100:00100000:3.0:1789997045.325697:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36454:x1876946704334208:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997045.325808:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36454:x1876946704334208:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 112us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997045.325826:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 434 00000100:00100000:0.0:1789997045.328989:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997045.329026:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704334336 00000100:00100000:0.0:1789997045.329035:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704334336 00000100:00100000:0.0:1789997045.329085:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 224 00000100:00100000:0.0:1789997045.329095:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36454:x1876946704334336:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997045.329463:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36454:x1876946704334336:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 368us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997045.329472:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 224 00000100:00100000:1.0:1789997045.335976:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997045.336802:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704334464 00000100:00100000:3.0:1789997045.336814:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704334464 00000100:00100000:3.0:1789997045.336868:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 225 00000100:00100000:3.0:1789997045.336879:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36454:x1876946704334464:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997045.338546:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36454:x1876946704334464:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1660us (2572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997045.338559:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 225 00000100:00100000:0.0:1789997045.342987:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997045.343130:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704334592 00000100:00100000:1.0:1789997045.343141:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704334592 00000100:00100000:1.0:1789997045.343233:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 435 00000100:00100000:1.0:1789997045.343246:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36454:x1876946704334592:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997045.343746:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36454:x1876946704334592:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 501us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997045.343756:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 435 00000100:00100000:0.0:1789997045.394502:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997045.394592:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704334848 00000100:00100000:2.0:1789997045.394603:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704334848 00000100:00100000:2.0:1789997045.394696:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 436 00000100:00100000:2.0:1789997045.394706:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36458:x1876946704334848:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:2.0:1789997045.394754:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997045.394781:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae820 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.394812:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:2.0:1789997045.394823:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997045.394858:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.394871:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.394880:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.394894:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.394901:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.394907:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.395235:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.395244:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.395250:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997045.396099:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9088 00000004:00080000:2.0:1789997045.396110:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1234088455582ns, next at 1235088453406ns, rc = 0 00010000:00010000:2.0:1789997045.396207:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396219:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396235:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396243:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396250:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396255:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396271:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997045.396294:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396301:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396308:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396313:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997045.396317:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396324:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396334:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997045.396337:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997045.396349:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396355:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b2bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396372:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396378:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396383:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396388:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997045.396390:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396395:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396402:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:2.0:1789997045.396404:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997045.396407:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997045.396412:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b2ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997045.396421:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f80887ab reply state 00000000f4403f8c transno 4294967469 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997045.396439:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997045.396528:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36458:x1876946704334848:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1819us (2032us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789997045.396535:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 436 00010000:00010000:0.0:1789997045.396975:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997045.396982:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.397001:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997045.397012:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.397020:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.397031:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:0.0:1789997045.397034:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997045.397037:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.397043:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b2c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.397058:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997045.397060:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997045.397062:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997045.399353:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.399368:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.399376:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.399382:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997045.399386:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.399394:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.399437:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x93c5647 (ffff8a38d0bdf200) 00010000:00010000:0.0:1789997045.399440:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997045.399446:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.399452:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b2b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997045.514891:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997046.041552:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997046.041598:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997046.041621:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704334976 00000100:00100000:1.0:1789997046.041632:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704334976 00000100:00100000:0.0:1789997046.041676:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997046.041710:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997046.041715:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 805 00000100:00100000:1.0:1789997046.041728:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704334976:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997046.041738:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704335232 00000100:00100000:0.0:1789997046.041743:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704335232 00000100:00100000:0.0:1789997046.041785:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704335360 00000100:00100000:0.0:1789997046.041790:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704335360 00000100:00100000:0.0:1789997046.041813:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 461 00000100:00100000:0.0:1789997046.041822:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704335232:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997046.041830:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704334976:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997046.041839:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 805 00000100:00100000:0.0:1789997046.041859:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704335232:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997046.041867:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 461 00000100:00100000:1.0:1789997046.041886:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 462 00000100:00100000:1.0:1789997046.041905:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704335360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997046.041934:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704335360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997046.042320:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704335104 00000100:00100000:3.0:1789997046.042326:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704335104 00000100:00100000:3.0:1789997046.042378:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 883 00000100:00100000:3.0:1789997046.042387:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704335104:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997046.042423:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704335104:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997046.042430:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 883 00000100:00100000:1.0:1789997046.042491:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 462 00000100:00100000:1.0:1789997046.219801:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997046.219826:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712850688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997046.219902:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997046.220433:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712850688 00000100:00100000:2.0:1789997046.220444:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712850688 00000100:00080000:3.0:1789997046.220496:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997046.220521:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1789997046.220535:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712850688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997046.220578:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789997046.220691:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712850688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997046.220700:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1789997046.220805:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712850688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997046.221485:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997046.221501:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712850816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997046.221557:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997046.221631:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712850816 00000100:00100000:2.0:1789997046.221637:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712850816 00000100:00100000:2.0:1789997046.221758:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1789997046.221767:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712850816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997046.221798:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997046.221851:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712850816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997046.221857:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:2.0:1789997046.221897:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712850816:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997046.224750:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997046.538894:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997047.264850:0:61494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1235957193769ns, next at 1235088453406ns, rc = 0 00000001:00080000:2.0:1789997047.295869:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967469 is committed 00000004:00080000:2.0:1789997047.295882:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 38 committed 00000004:00080000:2.0:1789997047.295906:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 39 committed 00000100:00100000:0.0:1789997047.296251:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997047.296405:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712850944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997047.296477:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997047.296762:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712850944 00000100:00100000:1.0:1789997047.296771:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712850944 00000100:00100000:1.0:1789997047.296858:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789997047.296869:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712850944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789997047.296894:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:14 count 1 00010000:00010000:1.0:1789997047.296918:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997047.296939:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997047.296948:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xe:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1789997047.296952:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997047.296957:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 4/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997047.296996:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997047.297012:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 5 pid: 6656 timeout: 1335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997047.297142:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946712851072:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997047.297316:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997047.307690:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997047.307713:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946712851072:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997047.307742:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997047.307829:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704335488 00000100:00100000:2.0:1789997047.307837:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704335488 00010000:00010000:2.0:1789997047.307893:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 6 pid: 6656 timeout: 1335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997047.307945:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 278 00000100:00100000:2.0:1789997047.307956:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704335488:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997047.307972:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997047.307978:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 6 pid: 6656 timeout: 1335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.307989:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 6 pid: 6656 timeout: 1335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.308011:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592b2a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae827 expref: 6 pid: 6656 timeout: 1335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.308040:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997047.308045:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997047.308051:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.308060:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.308089:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997047.308139:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704335488:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 186us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997047.308162:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 278 00010000:00010000:1.0:1789997047.308392:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997047.308402:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997047.308411:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997047.308419:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997047.308445:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789997047.309068:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712850944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12199us (12589us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789997047.309077:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00010000:2.0:1789997047.309173:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997047.309180:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.309189:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997047.309193:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.309203:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.309220:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.309228:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f51dc662/0x65b43101d592b2ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997047.309246:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997047.309249:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997047.309250:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789997047.309458:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789997047.309613:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c7f55500/2, rc 0, transno 4294967324 00000100:00100000:0.0:1789997047.309635:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712850944:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789997047.309948:0:61494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1236002293265ns, next at 1215431412814ns, rc = 0 00000004:00080000:0.0:1789997047.320135:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 40 committed 00010000:00010000:0.0:1789997047.562894:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997048.586927:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997049.291132:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712851456:0@lo:400:kworker.0 00000100:00100000:0.0:1789997049.291216:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997049.291288:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789997049.291295:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712851328:0@lo:400:kworker.0 00000100:00100000:3.0:1789997049.291500:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712851456 00000100:00100000:3.0:1789997049.291510:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712851456 00000100:00100000:3.0:1789997049.291571:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1789997049.291582:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712851456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997049.291639:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712851456:12345-0@lo:400:kworker.0 Request processed in 60us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997049.291687:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:3.0:1789997049.291725:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997049.291790:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997049.291827:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712851840:0@lo:400:kworker.0 00000100:00100000:0.0:1789997049.291854:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997049.291892:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712851456:0@lo:400:kworker.0 00000100:00100000:3.0:1789997049.291962:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712851328 00000100:00100000:3.0:1789997049.291966:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712851328 00000100:00100000:3.0:1789997049.291996:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712851840 00000100:00100000:3.0:1789997049.291999:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712851840 00000100:00100000:3.0:1789997049.292025:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1789997049.292031:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712851328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997049.292079:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712851328:12345-0@lo:400:kworker.0 Request processed in 48us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997049.292085:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1789997049.292097:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:3.0:1789997049.292102:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712851840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997049.292129:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712851840:12345-0@lo:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997049.292135:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00080000:3.0:1789997049.292152:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997049.292264:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712851200:0@lo:400:kworker.0 00000100:00100000:2.0:1789997049.292300:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997049.292536:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712851712:0@lo:400:kworker.0 00000100:00100000:2.0:1789997049.292576:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997049.292603:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997049.292610:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712851584:0@lo:400:kworker.0 00000100:00100000:2.0:1789997049.292631:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997049.292678:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712851712 00000100:00100000:2.0:1789997049.292683:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712851712 00000100:00100000:2.0:1789997049.292740:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712851584 00000100:00100000:2.0:1789997049.292744:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712851584 00000100:00100000:2.0:1789997049.292768:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1789997049.292775:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712851712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997049.292816:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712851712:12345-0@lo:400:kworker.0 Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997049.292821:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:2.0:1789997049.292833:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789997049.292840:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712851584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997049.292866:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712851584:12345-0@lo:400:kworker.0 Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997049.292871:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00080000:2.0:1789997049.292888:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997049.292892:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997049.292923:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712851584:0@lo:400:kworker.0 00000100:00100000:2.0:1789997049.292935:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712851712:0@lo:400:kworker.0 00000100:00100000:3.0:1789997049.293008:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712851200 00000100:00100000:3.0:1789997049.293014:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712851200 00000100:00100000:3.0:1789997049.293051:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1789997049.293059:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712851200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997049.293107:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712851200:12345-0@lo:400:kworker.0 Request processed in 49us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997049.293112:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1789997049.293392:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712851200:0@lo:400:kworker.0 00000100:00100000:0.0:1789997049.293483:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712851328:0@lo:400:kworker.0 00000100:00100000:0.0:1789997049.293494:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712851840:0@lo:400:kworker.0 00010000:00010000:2.0:1789997049.611126:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997050.381498:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:0.0:1789997050.634902:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997051.158766:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997051.158808:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997051.158897:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704335744 00000100:00100000:3.0:1789997051.158919:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704335744 00000100:00100000:3.0:1789997051.159023:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 887 00000100:00100000:3.0:1789997051.159034:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704335744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997051.159107:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704335744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997051.159115:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 887 00000100:00100000:0.0:1789997051.159376:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997051.159412:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997051.159454:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704335616 00000100:00100000:3.0:1789997051.159459:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704335616 00000100:00100000:3.0:1789997051.159491:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 807 00000100:00100000:3.0:1789997051.159498:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704335616:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997051.159534:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704335616:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997051.159551:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 807 00000100:00080000:1.0:1789997051.159872:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997051.166672:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704336000 00000100:00100000:2.0:1789997051.166699:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704336000 00000100:00100000:2.0:1789997051.166861:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704335872 00000100:00100000:2.0:1789997051.166865:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704335872 00000100:00100000:0.0:1789997051.166917:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 465 00000100:00100000:0.0:1789997051.166930:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704336000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997051.167009:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704336000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (8200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997051.167021:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 465 00000100:00080000:1.0:1789997051.169931:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997051.169941:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997051.170798:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 466 00000100:00100000:2.0:1789997051.170814:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704335872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997051.170889:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704335872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 80us (11476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997051.170897:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 466 00000100:00100000:2.0:1789997051.338971:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712851968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997051.339016:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712852096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997051.339048:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997051.339084:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712851968 00000100:00100000:0.0:1789997051.339092:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712851968 00000100:00080000:2.0:1789997051.339134:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997051.339151:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1789997051.339162:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712851968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997051.339197:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997051.339254:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712851968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997051.339261:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1789997051.339294:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997051.339335:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712852096 00000100:00100000:0.0:1789997051.339339:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712852096 00000100:00100000:0.0:1789997051.339365:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1789997051.339370:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712852096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997051.339388:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997051.339420:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712852096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997051.339426:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1789997051.339458:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789997051.339464:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c7f55500, transno 4294967324 00000100:00100000:0.0:1789997051.339479:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712852096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997051.339839:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997051.339958:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712851968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997051.659403:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997052.682975:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997053.707250:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997054.411749:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712852352:0@lo:400:kworker.0 00000100:00100000:0.0:1789997054.411845:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997054.411910:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712852864:0@lo:400:kworker.0 00000100:00100000:0.0:1789997054.411932:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997054.411960:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997054.411966:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712852480:0@lo:400:kworker.0 00000100:00100000:0.0:1789997054.411988:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997054.412029:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712852352 00000100:00100000:0.0:1789997054.412037:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712852352 00000100:00100000:0.0:1789997054.412078:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712852864 00000100:00100000:0.0:1789997054.412081:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712852864 00000100:00100000:0.0:1789997054.412105:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712852480 00000100:00100000:0.0:1789997054.412114:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712852480 00000100:00100000:0.0:1789997054.412137:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1789997054.412145:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712852352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997054.412197:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712852352:12345-0@lo:400:kworker.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997054.412203:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:0.0:1789997054.412221:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1789997054.412227:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712852864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997054.412254:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712852864:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997054.412260:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:0.0:1789997054.412272:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1789997054.412277:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712852480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997054.412301:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712852480:12345-0@lo:400:kworker.0 Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997054.412317:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00080000:0.0:1789997054.412341:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997054.412371:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712852480:0@lo:400:kworker.0 00000100:00100000:0.0:1789997054.412382:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712852352:0@lo:400:kworker.0 00000100:00100000:0.0:1789997054.412602:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712852864:0@lo:400:kworker.0 00000100:00100000:1.0:1789997054.412987:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712852608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997054.413027:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997054.413066:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789997054.413073:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712852224:0@lo:400:kworker.0 00000100:00100000:1.0:1789997054.413107:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997054.413126:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712852736:0@lo:400:kworker.0 00000100:00100000:1.0:1789997054.413144:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997054.413212:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712852608 00000100:00100000:3.0:1789997054.413217:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712852608 00000100:00100000:2.0:1789997054.413227:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712852224 00000100:00100000:2.0:1789997054.413231:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712852224 00000100:00100000:2.0:1789997054.413258:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1789997054.413259:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712852736 00000100:00100000:3.0:1789997054.413262:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712852736 00000100:00100000:2.0:1789997054.413265:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712852224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997054.413280:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1789997054.413286:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712852608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997054.413302:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712852224:12345-0@lo:400:kworker.0 Request processed in 38us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997054.413308:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1789997054.413318:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712852608:12345-0@lo:400:kworker.0 Request processed in 32us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997054.413323:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1789997054.413333:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1789997054.413339:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712852736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997054.413342:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712852224:0@lo:400:kworker.0 00000100:00100000:2.0:1789997054.413351:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712852608:0@lo:400:kworker.0 00000100:00100000:3.0:1789997054.413364:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712852736:12345-0@lo:400:kworker.0 Request processed in 26us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997054.413365:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712852736:0@lo:400:kworker.0 00000100:00100000:3.0:1789997054.413369:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00080000:0.0:1789997054.416887:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997054.416897:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997054.731072:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997055.757684:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997056.279484:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997056.279525:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997056.279562:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997056.279619:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997056.279620:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704336128 00000100:00100000:3.0:1789997056.279632:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704336128 00000100:00100000:0.0:1789997056.279700:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704336384 00000100:00100000:0.0:1789997056.279706:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704336384 00000100:00100000:3.0:1789997056.279718:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 809 00000100:00100000:3.0:1789997056.279730:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704336128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997056.279748:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704336512 00000100:00100000:0.0:1789997056.279752:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704336512 00000100:00100000:3.0:1789997056.279800:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704336128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997056.279809:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 809 00000100:00100000:0.0:1789997056.279862:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 469 00000100:00100000:0.0:1789997056.279872:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704336384:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997056.279905:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704336384:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997056.279911:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 469 00000100:00100000:0.0:1789997056.279925:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 470 00000100:00100000:0.0:1789997056.279933:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704336512:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997056.279964:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704336512:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997056.279969:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 470 00000100:00080000:0.0:1789997056.280012:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997056.280017:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997056.281894:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704336256 00000100:00100000:1.0:1789997056.281910:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704336256 00000100:00100000:1.0:1789997056.282000:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 891 00000100:00100000:1.0:1789997056.282010:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704336256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997056.282102:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704336256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 94us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997056.282110:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 891 00000100:00080000:0.0:1789997056.283331:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997056.458957:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997056.458981:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712852992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997056.459058:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997056.459387:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997056.459400:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712853120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997056.459434:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997056.459516:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712852992 00000100:00100000:3.0:1789997056.459524:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712852992 00000100:00080000:0.0:1789997056.459592:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997056.459601:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712853120 00000100:00100000:3.0:1789997056.459605:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712853120 00000100:00100000:0.0:1789997056.459612:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1789997056.459625:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712852992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997056.459635:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789997056.459645:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712853120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997056.459690:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00002000:00000024:3.0:1789997056.459695:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997056.459761:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712853120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997056.459769:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1789997056.459828:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712852992:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997056.460980:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997056.461033:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712853120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997056.468524:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712852992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8890us (9454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997056.468540:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00010000:00010000:0.0:1789997056.779162:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997057.802874:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997058.827579:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997059.531038:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712853248:0@lo:400:kworker.0 00000100:00100000:3.0:1789997059.531043:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712853376:0@lo:400:kworker.0 00000100:00100000:0.0:1789997059.531131:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712853504:0@lo:400:kworker.0 00000100:00100000:1.0:1789997059.531146:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712853632:0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.535461:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997059.535535:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712853760:0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.535574:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997059.535627:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712853248 00000100:00100000:2.0:1789997059.535636:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712853248 00000100:00100000:2.0:1789997059.535768:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1789997059.535778:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712853248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.535906:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712853248:12345-0@lo:400:kworker.0 Request processed in 129us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997059.535913:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1789997059.535970:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712853248:0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.536776:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712853760 00000100:00100000:2.0:1789997059.536783:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712853760 00000100:00100000:2.0:1789997059.538059:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1789997059.538073:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712853760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.538272:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712853760:12345-0@lo:400:kworker.0 Request processed in 203us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997059.538281:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00080000:2.0:1789997059.538309:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997059.538354:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712853760:0@lo:400:kworker.0 00000100:00100000:3.0:1789997059.539481:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997059.539617:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712853376 00000100:00100000:3.0:1789997059.539624:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712853888:0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.539636:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712853376 00000100:00100000:3.0:1789997059.539685:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997059.539697:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712853888 00000100:00100000:2.0:1789997059.539701:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712853888 00000100:00100000:2.0:1789997059.539728:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1789997059.539737:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712853376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.539780:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712853376:12345-0@lo:400:kworker.0 Request processed in 45us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997059.539786:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1789997059.539897:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1789997059.539905:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712853888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.539931:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712853888:12345-0@lo:400:kworker.0 Request processed in 29us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997059.539937:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00080000:2.0:1789997059.539953:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997059.540192:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712853376:0@lo:400:kworker.0 00000100:00100000:3.0:1789997059.540206:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712853888:0@lo:400:kworker.0 00000100:00100000:0.0:1789997059.540822:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997059.540823:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997059.540983:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712853632 00000100:00100000:2.0:1789997059.540989:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712853632 00000100:00100000:2.0:1789997059.541046:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789997059.541059:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712853632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.541114:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712853632:12345-0@lo:400:kworker.0 Request processed in 60us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997059.541120:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789997059.541141:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712853504 00000100:00100000:2.0:1789997059.541144:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712853504 00000100:00100000:2.0:1789997059.541182:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1789997059.541189:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712853504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997059.541223:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712853504:12345-0@lo:400:kworker.0 Request processed in 35us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997059.541244:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1789997059.541420:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712853632:0@lo:400:kworker.0 00000100:00080000:0.0:1789997059.546827:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997059.546840:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997059.546902:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712853504:0@lo:400:kworker.0 00010000:00010000:0.0:1789997059.850995:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997060.874805:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997061.398613:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997061.398687:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997061.398741:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997061.398786:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997061.398816:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704337024 00000100:00100000:0.0:1789997061.398825:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704337024 00000100:00100000:0.0:1789997061.398878:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704336896 00000100:00100000:0.0:1789997061.398882:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704336896 00000100:00100000:0.0:1789997061.398923:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 473 00000100:00100000:0.0:1789997061.398933:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704337024:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997061.399005:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704337024:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997061.399013:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 473 00000100:00100000:0.0:1789997061.399033:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 474 00000100:00100000:0.0:1789997061.399040:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704336896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997061.399063:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704336896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997061.399070:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 474 00000100:00080000:0.0:1789997061.399086:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997061.399090:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997061.399388:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704336768 00000100:00100000:3.0:1789997061.399392:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704336768 00000100:00100000:3.0:1789997061.399446:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 895 00000100:00100000:3.0:1789997061.399455:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704336768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997061.399502:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704336768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997061.399508:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 895 00000100:00100000:3.0:1789997061.399526:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704336640 00000100:00100000:3.0:1789997061.399530:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704336640 00000100:00100000:3.0:1789997061.399554:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 811 00000100:00100000:3.0:1789997061.399561:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704336640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997061.399585:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704336640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997061.399591:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 811 00000100:00080000:0.0:1789997061.400682:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997061.579150:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712854016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997061.579229:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997061.579383:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712854016 00000100:00100000:1.0:1789997061.579391:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712854016 00000100:00100000:1.0:1789997061.579448:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1789997061.579458:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712854016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997061.579502:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789997061.581597:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997061.582765:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712854144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997061.582833:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997061.584581:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712854144 00000100:00100000:0.0:1789997061.584602:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712854144 00000100:00100000:0.0:1789997061.584708:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1789997061.584718:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712854144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997061.584753:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997061.584824:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712854144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997061.584830:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00080000:3.0:1789997061.585194:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997061.585251:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712854144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997061.587883:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712854016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8417us (8644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997061.587897:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:2.0:1789997061.598038:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712854016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789997061.901565:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997062.353581:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997062.353680:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704337152 00000100:00100000:2.0:1789997062.353691:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704337152 00000100:00100000:2.0:1789997062.353753:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 437 00000100:00100000:2.0:1789997062.353769:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36675:x1876946704337152:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997062.353875:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36675:x1876946704337152:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 112us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997062.353882:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 437 00000100:00100000:3.0:1789997062.356552:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997062.358333:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704337280 00000100:00100000:0.0:1789997062.358350:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704337280 00000100:00100000:0.0:1789997062.358419:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 227 00000100:00100000:0.0:1789997062.358431:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36675:x1876946704337280:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997062.358861:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36675:x1876946704337280:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 431us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997062.358870:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 227 00000100:00100000:0.0:1789997062.369329:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997062.369573:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704337408 00000100:00100000:3.0:1789997062.369583:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704337408 00000100:00100000:3.0:1789997062.369644:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 228 00000100:00100000:3.0:1789997062.369680:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36675:x1876946704337408:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997062.370066:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36675:x1876946704337408:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 412us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997062.370082:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 228 00000100:00100000:3.0:1789997062.374743:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997062.374896:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704337536 00000100:00100000:2.0:1789997062.374907:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704337536 00000100:00100000:2.0:1789997062.374962:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 438 00000100:00100000:2.0:1789997062.374997:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36675:x1876946704337536:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997062.376602:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36675:x1876946704337536:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 1623us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997062.376614:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 438 00000100:00100000:2.0:1789997062.387783:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997062.388078:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704337664 00000100:00100000:0.0:1789997062.388089:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704337664 00000100:00100000:0.0:1789997062.388151:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 439 00000100:00100000:0.0:1789997062.388163:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36675:x1876946704337664:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997062.388256:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36675:x1876946704337664:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 95us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997062.388264:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 439 00000100:00100000:3.0:1789997062.392709:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997062.393069:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704337792 00000100:00100000:0.0:1789997062.393079:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704337792 00000100:00100000:0.0:1789997062.393149:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 229 00000100:00100000:0.0:1789997062.393158:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36675:x1876946704337792:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997062.393562:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36675:x1876946704337792:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 403us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997062.393571:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 229 00000100:00100000:3.0:1789997062.404843:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997062.405350:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704337920 00000100:00100000:0.0:1789997062.405361:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704337920 00000100:00100000:0.0:1789997062.405416:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 230 00000100:00100000:0.0:1789997062.405428:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36675:x1876946704337920:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997062.405899:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36675:x1876946704337920:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 471us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997062.405908:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 230 00000100:00100000:3.0:1789997062.408425:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997062.408509:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704338048 00000100:00100000:0.0:1789997062.408518:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704338048 00000100:00100000:0.0:1789997062.408574:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 440 00000100:00100000:0.0:1789997062.408584:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36675:x1876946704338048:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997062.409091:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36675:x1876946704338048:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 508us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997062.409099:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 440 00000100:00100000:3.0:1789997062.436588:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997062.436715:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704338176 00000100:00100000:2.0:1789997062.436725:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704338176 00000100:00100000:2.0:1789997062.436774:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 441 00000100:00100000:2.0:1789997062.436786:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36676:x1876946704338176:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997062.436823:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997062.436847:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae82e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.436922:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b2d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.436937:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.436952:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997062.436996:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:2.0:1789997062.437001:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997062.437020:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.437049:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae82e expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.437077:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae82e expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.437085:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:2.0:1789997062.437088:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997062.437092:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3000, rc 0) 00000100:00100000:2.0:1789997062.437150:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36676:x1876946704338176:12345-192.168.204.4@tcp:101:rm.0 Request processed in 366us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997062.437157:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 441 00000100:00100000:3.0:1789997062.440879:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997062.441142:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704338432 00000100:00100000:1.0:1789997062.441154:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704338432 00000100:00100000:1.0:1789997062.441312:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 442 00000100:00100000:1.0:1789997062.441333:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36676:x1876946704338432:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997062.441357:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997062.441382:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b2df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae835 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997062.441486:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00010000:1.0:1789997062.441762:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b2df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae835 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997062.441777:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997062.441780:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789997062.441787:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b2df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae835 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997062.441805:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997062.441865:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36676:x1876946704338432:12345-192.168.204.4@tcp:101:rm.0 Request processed in 536us (995us total) trans 4294967470 rc 301/301 00000100:00100000:1.0:1789997062.441872:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 442 00000100:00100000:3.0:1789997062.446742:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997062.446801:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704338560 00000100:00100000:1.0:1789997062.446812:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704338560 00000100:00100000:1.0:1789997062.446923:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:1.0:1789997062.446935:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36676:x1876946704338560:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:0.0:1789997062.458424:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36676:x1876946704338560:12345-192.168.204.4@tcp:37:rm.0 Request processed in 11483us (11682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997062.458438:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 48 00000100:00100000:3.0:1789997062.467624:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997062.467821:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704338816 00000100:00100000:1.0:1789997062.467832:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704338816 00000100:00100000:1.0:1789997062.467920:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:1.0:1789997062.467930:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36676:x1876946704338816:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:1.0:1789997062.468449:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:36676:x1876946704338816:12345-192.168.204.4@tcp:35:rm.0 Request processed in 519us (833us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789997062.468481:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 49 00000100:00100000:1.0:1789997062.474771:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997062.475363:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704339072 00000100:00100000:2.0:1789997062.475375:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704339072 00000100:00100000:2.0:1789997062.475441:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 443 00000100:00100000:2.0:1789997062.475451:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:36676:x1876946704339072:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997062.475518:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789997062.475545:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b2d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae82e expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.475563:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b27d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae819 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.475578:0:11799:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592aed3) 00010000:00010000:2.0:1789997062.475582:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:2.0:1789997062.475593:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997062.475619:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.475632:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.475642:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.475675:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.475683:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.475690:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477379:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477398:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477409:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477468:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477477:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477484:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477489:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997062.477494:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477501:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477512:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:2.0:1789997062.477516:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997062.477520:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477526:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b2fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477550:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477556:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477561:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477566:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997062.477568:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477574:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477580:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997062.477582:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997062.477585:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477590:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b2ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477599:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477604:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477609:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477618:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997062.477621:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477627:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477634:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997062.477636:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997062.477639:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997062.477645:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b2f4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997062.477762:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36676:x1876946704339072:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2310us (2999us total) trans 0 rc -13/-13 00000100:00100000:2.0:1789997062.477771:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 443 00000001:00080000:2.0:1789997062.670988:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967471 is committed 00010000:00010000:1.0:1789997062.923334:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997063.949079:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997064.651014:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712854400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997064.651085:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997064.651137:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712854912:0@lo:400:kworker.0 00000100:00100000:2.0:1789997064.651159:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997064.651185:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997064.651191:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712854528:0@lo:400:kworker.0 00000100:00100000:2.0:1789997064.651212:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997064.651260:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712854400 00000100:00100000:2.0:1789997064.651267:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712854400 00000100:00100000:2.0:1789997064.651307:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712854912 00000100:00100000:2.0:1789997064.651310:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712854912 00000100:00100000:2.0:1789997064.651336:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712854528 00000100:00100000:2.0:1789997064.651338:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712854528 00000100:00100000:2.0:1789997064.651361:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1789997064.651370:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712854400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997064.651435:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712854400:12345-0@lo:400:kworker.0 Request processed in 66us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997064.651444:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1789997064.651461:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:2.0:1789997064.651467:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712854912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997064.651495:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712854912:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997064.651594:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:2.0:1789997064.651607:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1789997064.651613:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712854528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997064.651644:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712854528:12345-0@lo:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997064.651649:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00080000:2.0:1789997064.651709:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997064.651752:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712854528:0@lo:400:kworker.0 00000100:00100000:2.0:1789997064.651765:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712854400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997064.651776:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712854912:0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.651861:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712854656:0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.651895:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997064.651930:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789997064.651937:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712854272:0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.651964:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997064.651988:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712854784:0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.652009:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997064.652038:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712854272 00000100:00100000:0.0:1789997064.652042:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712854272 00000100:00100000:0.0:1789997064.652071:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1789997064.652078:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712854272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.652111:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712854272:12345-0@lo:400:kworker.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997064.652118:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1789997064.652144:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712854656 00000100:00100000:0.0:1789997064.652148:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712854656 00000100:00100000:0.0:1789997064.652187:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712854784 00000100:00100000:0.0:1789997064.652190:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712854784 00000100:00100000:0.0:1789997064.652208:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1789997064.652214:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712854656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.652246:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712854656:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997064.652252:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:0.0:1789997064.652264:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1789997064.652269:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712854784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.652297:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712854784:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997064.652302:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00080000:0.0:1789997064.652325:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997064.652328:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997064.652344:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712854272:0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.652355:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712854784:0@lo:400:kworker.0 00000100:00100000:0.0:1789997064.652362:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712854656:0@lo:400:kworker.0 00010000:00010000:2.0:1789997064.970913:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997065.179620:0:61816:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc9a6ca50 20000000:00000080:0.0:1789997065.179637:0:61816:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c7d1b400 uarg=0000000000000000 00010000:00010000:0.0:1789997065.180334:0:61816:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997065.180350:0:61816:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997065.180364:0:61816:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997065.180384:0:61816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997065.180402:0:61816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b253 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997065.180430:0:61816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997065.180466:0:61816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b253 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997065.180482:0:61816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b253 expref: 18 pid: 5804 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997065.180496:0:61816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61816:1876946712855040:0@lo:104: 00000100:00100000:0.0:1789997065.180557:0:61816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997065.180610:0:61816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789997065.180708:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712855040 00000100:00100000:3.0:1789997065.180717:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712855040 00000100:00100000:3.0:1789997065.180764:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789997065.180774:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:61816:x1876946712855040:12345-0@lo:104: 00010000:00010000:3.0:1789997065.180786:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.180848:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997065.180854:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:61816:x1876946712855040:12345-0@lo:104: Request processed in 82us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997065.180861:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00010000:00010000:3.0:1789997065.180881:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997065.180886:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.180893:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997065.180897:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.180916:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997065.180923:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997065.180929:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997065.180952:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.180959:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997065.180978:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.180985:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b253 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b25a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181009:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997065.181011:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997065.181013:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997065.181029:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712855168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997065.181058:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997065.181093:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712855168 00000100:00100000:3.0:1789997065.181098:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712855168 00010000:00010000:3.0:1789997065.181116:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b253 expref: 19 pid: 5804 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997065.181138:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789997065.181145:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712855168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997065.181163:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997065.181168:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b253 expref: 19 pid: 5804 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181179:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b253 expref: 19 pid: 5804 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181195:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181202:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181215:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181223:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181231:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181236:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181241:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997065.181245:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181252:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181272:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997065.181282:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997065.181310:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712855168:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997065.181316:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789997065.181348:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712855168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997065.181441:0:61816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b25a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b253 expref: 18 pid: 5804 timeout: 1403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997065.181452:0:61816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61816:1876946712855040:0@lo:104: 00010000:00010000:1.0:1789997065.181465:0:61816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997065.181473:0:61816:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997065.181479:0:61816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997065.181485:0:61816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b302 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997065.995424:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997066.027690:0:61864:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd188b1000 20000000:00000080:1.0:1789997066.027710:0:61864:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba1000 uarg=0000000000000000 10000000:01000000:1.0:1789997066.027757:0:61864:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997066.027778:0:61864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027794:0:61864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027804:0:61864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027824:0:61864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027832:0:61864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027840:0:61864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027846:0:61864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997066.027851:0:61864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027861:0:61864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027875:0:61864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027884:0:61864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997066.027890:0:61864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b309 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997066.518121:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997066.518164:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997066.518198:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997066.518226:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704339200 00000100:00100000:2.0:1789997066.518233:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997066.518240:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704339200 00000100:00100000:2.0:1789997066.518260:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704339456 00000100:00100000:2.0:1789997066.518265:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704339456 00000100:00100000:3.0:1789997066.518295:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 813 00000100:00100000:3.0:1789997066.518308:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704339200:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997066.518311:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704339584 00000100:00100000:2.0:1789997066.518316:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704339584 00000100:00100000:2.0:1789997066.518345:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 477 00000100:00100000:2.0:1789997066.518354:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704339456:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997066.518393:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704339200:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997066.518401:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704339456:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997066.518405:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 813 00000100:00100000:2.0:1789997066.518415:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 477 00000100:00100000:2.0:1789997066.518433:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 478 00000100:00100000:2.0:1789997066.518441:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704339584:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997066.518468:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704339584:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997066.518474:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 478 00000100:00080000:2.0:1789997066.518494:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997066.518497:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997066.518543:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704339328 00000100:00100000:1.0:1789997066.518548:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704339328 00000100:00100000:1.0:1789997066.518601:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 899 00000100:00100000:1.0:1789997066.518609:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704339328:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997066.518649:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704339328:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997066.518680:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 899 00000100:00080000:2.0:1789997066.518978:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997066.699009:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997066.699031:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712855296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997066.699108:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997066.699172:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712855296 00000100:00100000:2.0:1789997066.699179:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712855296 00000100:00100000:2.0:1789997066.699236:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1789997066.699245:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712855296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997066.699287:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997066.699335:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712855296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997066.699343:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00080000:2.0:1789997066.699365:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997066.699424:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712855296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997066.703673:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997066.703697:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712855424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997066.703780:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997066.703848:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712855424 00000100:00100000:1.0:1789997066.703855:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712855424 00000100:00100000:1.0:1789997066.703916:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789997066.703924:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712855424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997066.703958:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997066.704006:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712855424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997066.704013:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:1.0:1789997066.704058:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712855424:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997066.709177:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1789997066.954790:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997066.954799:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997066.954805:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997066.954867:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997066.954879:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997066.954891:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997066.954917:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712855552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997066.955009:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997066.955090:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997066.955175:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712855552 00000100:00100000:0.0:1789997066.955184:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712855552 00000100:00100000:0.0:1789997066.955248:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1789997066.955258:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712855552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997066.955270:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997066.955283:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b310 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997066.955306:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b310 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997066.955318:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b310 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997066.955327:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997066.955394:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712855552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997066.955401:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:3.0:1789997066.955564:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712855552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997066.955580:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997066.955589:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997066.955617:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997066.955622:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997066.955629:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997067.020450:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997068.042762:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997068.859725:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997068.859911:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704339712 00000100:00100000:0.0:1789997068.859922:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704339712 00000100:00100000:0.0:1789997068.859993:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 444 00000100:00100000:0.0:1789997068.860002:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36789:x1876946704339712:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997068.860023:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997068.860046:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b31e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae83c expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.860108:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b325 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.860122:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.860136:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997068.860171:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789997068.860175:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997068.860196:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.860219:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b31e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae83c expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.860246:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae83c expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.860274:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:0.0:1789997068.860278:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997068.860282:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997068.860554:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36789:x1876946704339712:12345-192.168.204.4@tcp:101:rm.0 Request processed in 551us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997068.860627:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 444 00000100:00080000:2.0:1789997068.860749:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997068.863649:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997068.863905:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704339840 00000100:00100000:2.0:1789997068.863915:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704339840 00000100:00100000:2.0:1789997068.863977:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 445 00000100:00100000:2.0:1789997068.863988:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36789:x1876946704339840:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997068.864007:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997068.864028:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae843 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.864091:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.864107:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.864119:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.864133:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.864159:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.864166:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865001:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865013:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865022:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997068.865055:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00000004:00200000:2.0:1789997068.865059:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997068.865081:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865092:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865099:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865107:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865113:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997068.865118:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865133:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865147:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:2.0:1789997068.865151:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997068.865156:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865163:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b333 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865175:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865181:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865187:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865193:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997068.865196:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865201:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865208:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997068.865211:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997068.865214:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865230:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b33a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865263:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae843 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865278:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae843 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997068.865285:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:2.0:1789997068.865287:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997068.865290:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997068.866203:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36789:x1876946704339840:12345-192.168.204.4@tcp:101:rm.0 Request processed in 2211us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997068.866212:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 445 00000100:00100000:3.0:1789997068.877351:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997068.877457:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704340096 00000100:00100000:1.0:1789997068.877468:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704340096 00000100:00100000:1.0:1789997068.877528:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 446 00000100:00100000:1.0:1789997068.877538:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36789:x1876946704340096:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997068.877574:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997068.877595:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae84a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997068.877724:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00010000:1.0:1789997068.878003:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b348 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae84a expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.878038:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:1.0:1789997068.878041:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789997068.878048:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae84a expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.878061:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997068.878133:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36789:x1876946704340096:12345-192.168.204.4@tcp:101:rm.0 Request processed in 596us (803us total) trans 4294967472 rc 301/301 00000100:00100000:1.0:1789997068.878141:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 446 00000100:00100000:3.0:1789997068.890703:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997068.890955:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704340224 00000100:00100000:1.0:1789997068.890967:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704340224 00000100:00100000:1.0:1789997068.891033:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:1.0:1789997068.891044:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36789:x1876946704340224:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:1.0:1789997068.902081:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36789:x1876946704340224:12345-192.168.204.4@tcp:37:rm.0 Request processed in 11025us (11412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997068.902097:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 50 00000100:00100000:3.0:1789997068.907998:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997068.908148:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704340480 00000100:00100000:0.0:1789997068.908159:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704340480 00000100:00100000:0.0:1789997068.908239:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:0.0:1789997068.908250:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de235c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36789:x1876946704340480:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:0.0:1789997068.908506:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de235c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:36789:x1876946704340480:12345-192.168.204.4@tcp:35:rm.0 Request processed in 257us (516us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789997068.908514:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 51 00000100:00100000:3.0:1789997068.916860:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997068.917264:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704340736 00000100:00100000:1.0:1789997068.917275:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704340736 00000100:00100000:1.0:1789997068.917349:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 447 00000100:00100000:1.0:1789997068.917361:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:36789:x1876946704340736:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997068.917418:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997068.917447:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae843 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.917469:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:1.0:1789997068.917508:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b325 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae83c expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.917529:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:1.0:1789997068.917536:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997068.917571:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.917585:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.917596:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.917608:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.917824:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.917834:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.918140:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.918150:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.918157:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997068.920810:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1f:0x0]: returning size 16384 00010000:00010000:1.0:1789997068.920857:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920867:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920875:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920880:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997068.920884:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920892:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920908:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997068.920911:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997068.920916:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920922:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b364 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920948:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920953:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920959:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920973:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997068.920976:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920983:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.920991:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789997068.920993:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997068.920996:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997068.921001:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b356 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997068.921013:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f894a2c9 reply state 000000006304f19b transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997068.921022:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997068.921328:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:36789:x1876946704340736:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3965us (4474us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789997068.921349:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 447 00010000:00010000:3.0:1789997068.928434:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997068.928456:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997068.928466:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997068.928571:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997068.928576:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997068.928583:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997068.928599:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38e062da00) 00010000:00010000:3.0:1789997068.928602:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997068.928607:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997068.928922:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b35d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997068.989814:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997068.992163:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704340864 00000100:00100000:0.0:1789997068.992178:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704340864 00000100:00100000:0.0:1789997068.992253:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 448 00000100:00100000:0.0:1789997068.992264:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:36793:x1876946704340864:12345-192.168.204.4@tcp:101:mkdir.0 00010000:00010000:0.0:1789997068.992290:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997068.992312:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b36b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae851 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.992386:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b372 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.992400:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.992728:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997068.992769:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789997068.992773:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997068.992794:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b372 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.992817:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b36b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae851 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.992848:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b372 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae851 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997068.992857:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997068.992861:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997068.992865:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997068.993212:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:36793:x1876946704340864:12345-192.168.204.4@tcp:101:mkdir.0 Request processed in 948us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997068.993220:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 448 00000100:00100000:3.0:1789997069.002016:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997069.002063:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997069.002134:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704340992 00000100:00100000:1.0:1789997069.002144:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704340992 00000100:00100000:1.0:1789997069.002190:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704341248 00000100:00100000:1.0:1789997069.002194:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704341248 00000100:00100000:1.0:1789997069.002215:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 449 00000100:00100000:1.0:1789997069.002225:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2355:x1876946704340992:12345-192.168.204.4@tcp:41:mkdir.0 00000004:00000024:1.0:1789997069.002270:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789997069.002522:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 450 00000100:00100000:0.0:1789997069.002531:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:36793:x1876946704341248:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:0.0:1789997069.002580:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997069.002607:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b372 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae851 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.002648:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997069.002686:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997069.002761:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.002774:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.002785:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.002797:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.002805:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.002812:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997069.004080:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:0.0:1789997069.004094:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.004103:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.004110:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.004116:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997069.004120:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.004140:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.004153:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997069.004156:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997069.004161:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.004167:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b379 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997069.004185:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000545bb904 reply state 00000000c3b66035 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997069.004194:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997069.004787:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:2355:x1876946704340992:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 2558us (2776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997069.004798:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 449 00000100:00100000:0.0:1789997069.004893:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:36793:x1876946704341248:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 2363us (2829us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789997069.004899:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 450 00010000:00010000:0.0:1789997069.006915:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.006930:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.006947:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.006953:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997069.006958:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.006982:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.006998:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38c28e9700) 00010000:00010000:0.0:1789997069.007001:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997069.007006:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.007013:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b380 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997069.068894:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997069.070327:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704341376 00000100:00100000:2.0:1789997069.070350:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704341376 00000100:00100000:2.0:1789997069.070442:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 451 00000100:00100000:2.0:1789997069.070453:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:36797:x1876946704341376:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1789997069.070477:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997069.070500:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae858 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.070568:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592b38e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.070582:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592b38e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.070610:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592b38e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997069.070647:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789997069.070651:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997069.070712:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592b38e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.070737:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae858 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.070738:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997069.070755:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592b38e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae858 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.070763:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997069.070766:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997069.070770:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997069.070847:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:36797:x1876946704341376:12345-192.168.204.4@tcp:101:chown.0 Request processed in 396us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997069.070855:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 451 00000100:00100000:3.0:1789997069.075833:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997069.076116:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704341504 00000100:00100000:1.0:1789997069.076128:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704341504 00000100:00100000:1.0:1789997069.076233:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 452 00000100:00100000:1.0:1789997069.076243:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:36797:x1876946704341504:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:1.0:1789997069.076263:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997069.076283:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b395 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae85f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076371:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076386:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076402:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076427:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076435:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076443:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076542:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b3aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076564:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b3aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076572:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b3aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997069.076604:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:1.0:1789997069.076607:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997069.076626:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b3aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076638:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076644:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076651:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076692:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997069.076697:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076704:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076716:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:1.0:1789997069.076719:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997069.076724:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076741:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b39c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076754:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076761:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076767:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076772:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997069.076775:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076781:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076790:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38e062db00) 00010000:00010000:1.0:1789997069.076792:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997069.076795:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076800:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b3a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076829:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b395 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae85f expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076843:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b3aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae85f expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997069.076857:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997069.076860:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997069.076862:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997069.076928:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:36797:x1876946704341504:12345-192.168.204.4@tcp:101:chown.0 Request processed in 686us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997069.076940:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 452 00000100:00100000:1.0:1789997069.079887:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997069.080068:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704341760 00000100:00100000:0.0:1789997069.080079:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704341760 00000100:00100000:0.0:1789997069.080137:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 453 00000100:00100000:0.0:1789997069.080147:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:36797:x1876946704341760:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:0.0:1789997069.080195:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997069.080221:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b3aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae85f expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.080241:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:0.0:1789997069.080252:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997069.080275:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.080289:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997069.080299:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997069.124100:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967476 is committed 00000004:00010000:1.0:1789997069.124203:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039088737 reply state 000000003a5120e1 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997069.124218:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997069.124234:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00080000:1.0:1789997069.124434:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789997069.124457:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36797:x1876946704341760:12345-192.168.204.4@tcp:36:chown.0 Request processed in 44307us (44574us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789997069.124466:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 453 00010000:00010000:2.0:1789997069.124644:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.124690:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.124699:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.124722:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997069.124726:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.124734:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.124750:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38c28e9700) 00010000:00010000:2.0:1789997069.124754:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997069.124759:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997069.124765:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997069.780749:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712855936:0@lo:400:kworker.0 00000100:00100000:0.0:1789997069.780819:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997069.780882:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997069.780888:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712856064:0@lo:400:kworker.0 00000100:00100000:0.0:1789997069.780915:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997069.780948:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712855936 00000100:00100000:0.0:1789997069.780955:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712855936 00000100:00100000:0.0:1789997069.781015:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1789997069.781025:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712855936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997069.781076:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712855936:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997069.781083:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1789997069.781107:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712856064 00000100:00100000:0.0:1789997069.781111:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712856064 00000100:00100000:0.0:1789997069.781138:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1789997069.781144:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712856064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997069.781176:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712856064:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997069.781188:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00080000:0.0:1789997069.781205:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997069.781209:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997069.781245:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712856064:0@lo:400:kworker.0 00000100:00100000:0.0:1789997069.781255:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712855936:0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781468:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712855680:0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781505:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997069.781537:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712856192:0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781560:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997069.781580:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789997069.781585:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712855808:0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781605:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997069.781621:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712856320:0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781642:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997069.781697:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712856192 00000100:00100000:2.0:1789997069.781701:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712856192 00000100:00100000:2.0:1789997069.781731:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1789997069.781738:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712856192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781786:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712856192:12345-0@lo:400:kworker.0 Request processed in 49us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997069.781793:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1789997069.781811:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712855808 00000100:00100000:2.0:1789997069.781815:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712855808 00000100:00100000:2.0:1789997069.781832:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712856320 00000100:00100000:2.0:1789997069.781834:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712856320 00000100:00100000:2.0:1789997069.781851:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1789997069.781857:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712855808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781886:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712855808:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997069.781891:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1789997069.781902:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1789997069.781908:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712856320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781933:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712856320:12345-0@lo:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997069.781939:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1789997069.781975:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712855808:0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781985:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712856320:0@lo:400:kworker.0 00000100:00100000:2.0:1789997069.781994:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712856192:0@lo:400:kworker.0 00000100:00100000:0.0:1789997069.782423:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712855680 00000100:00100000:0.0:1789997069.782430:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712855680 00000100:00100000:0.0:1789997069.782476:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1789997069.782483:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712855680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997069.782527:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712855680:12345-0@lo:400:kworker.0 Request processed in 45us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997069.782533:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1789997069.782569:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712855680:0@lo:400:kworker.0 00000100:00080000:0.0:1789997069.782591:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997069.782596:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789997070.080750:0:62062:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2356c340 20000000:00000080:3.0:1789997070.080768:0:62062:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c85adc00 uarg=0000000000000000 00010000:00010000:3.0:1789997070.082427:0:62062:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997070.083323:0:62062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997070.083330:0:62062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997070.083341:0:62062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592b38e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae858 expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997070.083371:0:62062:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997070.083418:0:62062:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997070.083434:0:62062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997070.083447:0:62062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b310 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997070.083761:0:62062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997070.083811:0:62062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b310 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997070.083827:0:62062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b310 expref: 18 pid: 5804 timeout: 1408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997070.083842:0:62062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62062:1876946712856448:0@lo:104: 00000100:00100000:3.0:1789997070.083921:0:62062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997070.084157:0:62062:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789997070.085089:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712856448 00000100:00100000:1.0:1789997070.085099:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712856448 00000100:00100000:1.0:1789997070.085150:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789997070.085160:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62062:x1876946712856448:12345-0@lo:104: 00010000:00010000:1.0:1789997070.085174:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.085327:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997070.085334:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62062:x1876946712856448:12345-0@lo:104: Request processed in 176us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997070.085341:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789997070.085518:0:62062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62062:1876946712856448:0@lo:104: 00010000:00010000:3.0:1789997070.085541:0:62062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997070.088849:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997070.088940:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997070.088953:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997070.088976:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997070.088987:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997070.088995:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997070.089003:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997070.090778:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997070.091835:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.091850:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789997070.091930:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789997070.091953:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.091962:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b310 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b317 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.091984:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997070.091986:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997070.091988:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997070.096116:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712856576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997070.096200:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997070.099768:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712856576 00000100:00100000:1.0:1789997070.099782:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712856576 00010000:00010000:1.0:1789997070.099833:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b310 expref: 19 pid: 5804 timeout: 1408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997070.099883:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789997070.099892:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712856576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997070.099907:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997070.099912:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b310 expref: 19 pid: 5804 timeout: 1408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.099924:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b310 expref: 19 pid: 5804 timeout: 1408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.099941:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b317 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b310 expref: 19 pid: 5804 timeout: 1408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.099958:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.099966:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.099983:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.099990:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.099998:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.100023:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.100030:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997070.100034:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.100042:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.100063:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997070.100073:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997070.100132:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712856576:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (3932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997070.100139:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00010000:0.0:1789997070.100262:0:62062:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.100271:0:62062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.100277:0:62062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592b3b8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997070.101341:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712856576:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789997070.847508:0:62110:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea4b9b1f0 20000000:00000080:0.0:1789997070.847592:0:62110:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c7d1a400 uarg=0000000000000000 10000000:01000000:0.0:1789997070.847643:0:62110:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997070.847807:0:62110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847826:0:62110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847838:0:62110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847844:0:62110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847851:0:62110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847858:0:62110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847865:0:62110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997070.847869:0:62110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847876:0:62110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847890:0:62110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847911:0:62110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997070.847917:0:62110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3bf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997071.115692:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997071.498813:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997071.498822:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997071.498828:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997071.498882:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997071.498894:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997071.498929:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997071.498956:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712856704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997071.499025:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997071.499135:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa55a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997071.501778:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712856704 00000100:00100000:0.0:1789997071.501861:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712856704 00000100:00100000:0.0:1789997071.501990:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1789997071.502003:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712856704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997071.502021:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997071.502041:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b3c6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997071.502070:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997071.502081:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997071.502091:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789997071.502178:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712856704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (3152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997071.502185:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1789997071.502278:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712856704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997071.502310:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997071.502320:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997071.502341:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997071.502347:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997071.502355:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997071.643156:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997071.643187:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997071.643228:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997071.643248:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997071.643384:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704342016 00000100:00100000:0.0:1789997071.643395:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704342016 00000100:00100000:0.0:1789997071.643463:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 903 00000100:00100000:0.0:1789997071.643475:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704342016:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997071.643572:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704342016:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 100us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997071.643581:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 903 00000100:00100000:0.0:1789997071.643606:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704341888 00000100:00100000:0.0:1789997071.643610:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704341888 00000100:00100000:0.0:1789997071.643635:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 817 00000100:00100000:0.0:1789997071.643643:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704341888:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997071.643691:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704341888:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997071.643697:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 817 00000100:00100000:0.0:1789997071.643727:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704342272 00000100:00100000:0.0:1789997071.643730:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704342272 00000100:00100000:0.0:1789997071.643760:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704342144 00000100:00100000:0.0:1789997071.643763:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704342144 00000100:00100000:0.0:1789997071.643784:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 481 00000100:00100000:0.0:1789997071.643790:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704342272:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997071.643816:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704342272:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997071.643822:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 481 00000100:00100000:0.0:1789997071.643833:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 482 00000100:00100000:0.0:1789997071.643839:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704342144:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997071.643863:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704342144:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997071.643868:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 482 00000100:00080000:0.0:1789997071.643881:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997071.643906:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997071.643908:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997071.819728:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997071.819757:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712856832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997071.820273:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997071.822903:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712856832 00000100:00100000:0.0:1789997071.822916:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712856832 00000100:00100000:0.0:1789997071.823057:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:0.0:1789997071.823069:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712856832:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997071.823094:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00000024:0.0:1789997071.823108:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997071.823112:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712856960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997071.823267:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997071.825069:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712856832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1997us (4792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997071.825082:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1789997071.826872:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712856832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997071.827067:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997071.827132:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712856960 00000100:00100000:2.0:1789997071.827140:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712856960 00000100:00100000:2.0:1789997071.827196:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1789997071.827205:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712856960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997071.827241:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997071.829934:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712856960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2723us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997071.829947:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00080000:2.0:1789997071.829982:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997071.830400:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712856960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789997072.139742:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997073.164294:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997073.869510:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997073.869769:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704342400 00000100:00100000:0.0:1789997073.869780:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704342400 00000100:00100000:0.0:1789997073.869863:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00100000:0.0:1789997073.869875:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:6036:x1876946704342400:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789997073.869892:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997073.869895:0:5797:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b38e) 00010000:00010000:0.0:1789997073.869898:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997073.869960:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:6036:x1876946704342400:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 88us (460us total) trans 0 rc 116/116 00000100:00100000:0.0:1789997073.869968:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 8 00000100:00080000:2.0:1789997073.870212:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789997074.193074:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997074.891119:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712857472:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.891194:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997074.891278:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789997074.891286:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712857088:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.891325:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997074.891348:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712857600:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.891423:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997074.891455:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712857216:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.891494:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997074.891512:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712857728:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.891530:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997074.891547:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997074.891551:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712857344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.891571:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997074.891614:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712857472 00000100:00100000:3.0:1789997074.891622:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712857472 00000100:00100000:3.0:1789997074.891750:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712857600 00000100:00100000:3.0:1789997074.891754:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712857600 00000100:00100000:0.0:1789997074.891758:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1789997074.891773:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712857472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.891782:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789997074.891791:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712857600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997074.891836:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712857472:12345-0@lo:400:kworker.0 Request processed in 68us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997074.891844:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1789997074.892147:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712857600:12345-0@lo:400:kworker.0 Request processed in 356us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997074.892154:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789997074.892175:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712857088 00000100:00100000:3.0:1789997074.892179:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712857088 00000100:00100000:3.0:1789997074.892211:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1789997074.892228:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712857088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892259:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712857088:12345-0@lo:400:kworker.0 Request processed in 42us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997074.892265:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:3.0:1789997074.892308:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712857216 00000100:00100000:3.0:1789997074.892316:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712857216 00000100:00100000:3.0:1789997074.892341:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712857728 00000100:00100000:3.0:1789997074.892344:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712857728 00000100:00100000:3.0:1789997074.892373:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712857344 00000100:00100000:3.0:1789997074.892376:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712857344 00000100:00100000:3.0:1789997074.892399:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1789997074.892406:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712857216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892649:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712857216:12345-0@lo:400:kworker.0 Request processed in 244us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997074.892678:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1789997074.892693:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:3.0:1789997074.892699:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712857728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892727:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712857728:12345-0@lo:400:kworker.0 Request processed in 29us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997074.892733:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:3.0:1789997074.892743:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1789997074.892748:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712857344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892767:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712857344:12345-0@lo:400:kworker.0 Request processed in 20us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997074.892772:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00080000:3.0:1789997074.892792:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997074.892796:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997074.892798:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997074.892873:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712857344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892883:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712857216:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892891:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712857728:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892934:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712857088:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892943:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712857600:0@lo:400:kworker.0 00000100:00100000:3.0:1789997074.892951:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712857472:0@lo:400:kworker.0 00010000:00010000:2.0:1789997075.211835:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997075.503036:0:62355:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe892e6100 20000000:00000080:1.0:1789997075.503059:0:62355:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba1800 uarg=0000000000000000 00010000:00010000:1.0:1789997075.506482:0:62355:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997075.506506:0:62355:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997075.506523:0:62355:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997075.506544:0:62355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997075.506563:0:62355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997075.506572:0:62355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997075.506614:0:62355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997075.506632:0:62355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 18 pid: 5804 timeout: 1414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997075.506647:0:62355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62355:1876946712857856:0@lo:104: 00000100:00100000:1.0:1789997075.506756:0:62355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997075.506922:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712857856 00000100:00100000:3.0:1789997075.506929:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712857856 00000100:00100000:3.0:1789997075.506976:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789997075.506986:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62355:x1876946712857856:12345-0@lo:104: 00010000:00010000:3.0:1789997075.506999:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997075.507052:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997075.507059:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62355:x1876946712857856:12345-0@lo:104: Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997075.507065:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00010000:0.0:1789997075.507213:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997075.507233:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.507241:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997075.507245:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.507254:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997075.507262:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997075.507268:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997075.507300:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.507307:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997075.507331:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.507339:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592b3c6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b3cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.507367:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997075.507369:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997075.507371:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997075.507383:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712857984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997075.507415:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997075.507615:0:62355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e0d99600 going to sleep for 11 seconds 00000100:00100000:1.0:1789997075.507639:0:62355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62355:1876946712857856:0@lo:104: 00010000:00010000:1.0:1789997075.507682:0:62355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997075.508102:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712857984 00000100:00100000:1.0:1789997075.508115:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712857984 00010000:00010000:0.0:1789997075.508213:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 19 pid: 5804 timeout: 1414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997075.508281:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789997075.508413:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712857984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997075.508427:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997075.508432:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 19 pid: 5804 timeout: 1414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508507:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 19 pid: 5804 timeout: 1414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508525:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592b3cd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b3c6 expref: 19 pid: 5804 timeout: 1414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508551:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508561:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508576:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508584:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508592:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508599:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508615:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997075.508619:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.508628:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997075.508829:0:62355:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997075.508839:0:62355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.509972:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.509988:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b3d4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997075.510006:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997075.510081:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712857984:12345-0@lo:103:ldlm_bl.0 Request processed in 1791us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997075.510091:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789997075.510164:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712857984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997076.235801:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997076.760078:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997076.760135:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997076.760160:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997076.760192:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997076.760217:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704342784 00000100:00100000:2.0:1789997076.760227:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704342784 00000100:00100000:2.0:1789997076.760277:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704342912 00000100:00100000:2.0:1789997076.760280:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704342912 00000100:00100000:2.0:1789997076.760304:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 485 00000100:00100000:2.0:1789997076.760316:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704342784:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997076.760388:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704342784:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997076.760396:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 485 00000100:00100000:2.0:1789997076.760413:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 486 00000100:00100000:2.0:1789997076.760420:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704342912:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997076.760444:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704342912:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997076.760450:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 486 00000100:00100000:3.0:1789997076.761313:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704342528 00000100:00100000:3.0:1789997076.761321:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704342528 00000100:00100000:3.0:1789997076.761367:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 819 00000100:00100000:3.0:1789997076.761375:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704342528:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997076.761434:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704342528:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 59us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997076.761452:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 819 00000100:00100000:3.0:1789997076.761484:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704342656 00000100:00100000:3.0:1789997076.761494:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704342656 00000100:00100000:3.0:1789997076.761530:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 907 00000100:00100000:3.0:1789997076.761537:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704342656:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997076.761573:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704342656:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997076.761579:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 907 00000100:00080000:3.0:1789997076.761598:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997076.761602:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997076.761605:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1789997076.940991:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997076.941001:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997076.941006:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997076.941049:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997076.941061:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997076.941072:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997076.941097:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712858112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997076.941161:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997076.941227:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997076.941338:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712858112 00000100:00100000:0.0:1789997076.941347:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712858112 00000100:00100000:0.0:1789997076.941391:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1789997076.941399:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712858112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997076.941412:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997076.941424:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b3db expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997076.941446:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b3db expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997076.941457:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b3db expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997076.941474:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997076.941514:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712858112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997076.941520:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1789997076.944943:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712858368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997076.945015:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997076.945055:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997076.945062:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712858240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997076.945084:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997076.945117:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712858368 00000100:00100000:2.0:1789997076.945126:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712858368 00000100:00100000:2.0:1789997076.947006:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712858240 00000100:00100000:2.0:1789997076.947019:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712858240 00000100:00100000:2.0:1789997076.947048:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789997076.947073:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712858368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997076.947112:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997076.947198:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712858368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997076.947205:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789997076.947228:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1789997076.947235:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712858240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997076.947319:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997076.947408:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712858240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (2263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997076.947415:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1789997076.947782:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712858240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997076.947992:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712858368:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997076.948195:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997076.948200:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997076.948537:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712858112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997076.948560:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997076.948583:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997076.948603:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997076.948609:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997076.948617:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.259339:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997077.880127:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997077.880199:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704343040 00000100:00100000:3.0:1789997077.880210:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704343040 00000100:00100000:3.0:1789997077.880271:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 454 00000100:00100000:3.0:1789997077.880280:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:36975:x1876946704343040:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997077.880298:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997077.880318:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b3e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae866 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.880376:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b3f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.880389:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.880401:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997077.880435:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997077.880445:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997077.880466:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.880488:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b3e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae866 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.880502:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae866 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.880510:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997077.880513:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997077.880517:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997077.880569:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36975:x1876946704343040:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 290us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997077.880576:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 454 00000100:00100000:3.0:1789997077.883417:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997077.883490:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704343168 00000100:00100000:0.0:1789997077.883500:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704343168 00000100:00100000:0.0:1789997077.883554:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 455 00000100:00100000:0.0:1789997077.883565:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:36975:x1876946704343168:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997077.883585:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997077.883605:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b3f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae86d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.883696:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.883710:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.883720:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.883734:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.883741:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.883758:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884062:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b40c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884072:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884079:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997077.884109:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:0.0:1789997077.884114:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997077.884133:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884145:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884151:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884169:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884176:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997077.884180:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884187:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884206:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:0.0:1789997077.884209:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997077.884216:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884222:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b3fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884235:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884241:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884247:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884252:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997077.884255:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884261:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884268:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997077.884270:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997077.884274:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884280:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b405 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884330:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b3f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae86d expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884349:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b40c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae86d expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997077.884357:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997077.884360:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997077.884363:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789997077.884422:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36975:x1876946704343168:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 859us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997077.884429:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 455 00000100:00100000:3.0:1789997077.889968:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997077.890009:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704343424 00000100:00100000:3.0:1789997077.890018:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704343424 00000100:00100000:3.0:1789997077.890076:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 456 00000100:00100000:3.0:1789997077.890086:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36975:x1876946704343424:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997077.890136:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997077.890313:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b40c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae86d expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.890339:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:3.0:1789997077.890351:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997077.890388:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.890403:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997077.890413:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789997077.948734:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967477 is committed 00000004:00010000:0.0:1789997077.948891:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0af4b47 reply state 00000000dddca741 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997077.948906:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997077.948924:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00080000:0.0:1789997077.949028:0:12471:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997077.949046:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:36975:x1876946704343424:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 58957us (59081us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789997077.949055:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 456 00010000:00010000:2.0:1789997077.949267:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997077.949277:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997077.949285:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997077.949291:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997077.949295:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997077.949302:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997077.949330:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:2.0:1789997077.949333:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997077.949338:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997077.949344:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b413 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.286322:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997078.690120:0:62551:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf85caec0 20000000:00000080:1.0:1789997078.690137:0:62551:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba1800 uarg=0000000000000000 00010000:00010000:1.0:1789997078.690867:0:62551:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997078.690903:0:62551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:1.0:1789997078.690906:0:62551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997078.690918:0:62551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b3f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae866 expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.690941:0:62551:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997078.690956:0:62551:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997078.690970:0:62551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.690984:0:62551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b3db expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.690991:0:62551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.691029:0:62551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b3db expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.691042:0:62551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b3db expref: 18 pid: 5805 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997078.691056:0:62551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62551:1876946712858496:0@lo:104: 00000100:00100000:1.0:1789997078.691121:0:62551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997078.691262:0:62551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b51cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997078.691356:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712858496 00000100:00100000:0.0:1789997078.691365:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712858496 00000100:00100000:0.0:1789997078.691471:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789997078.691480:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62551:x1876946712858496:12345-0@lo:104: 00010000:00010000:0.0:1789997078.691493:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.691581:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997078.691587:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62551:x1876946712858496:12345-0@lo:104: Request processed in 108us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997078.691594:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789997078.691681:0:62551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62551:1876946712858496:0@lo:104: 00010000:00010000:2.0:1789997078.691683:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997078.691692:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.691700:0:62551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997078.691701:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997078.691709:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997078.691720:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997078.691727:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997078.691733:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997078.691771:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997078.691778:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997078.691819:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997078.691836:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592b3db lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b3e2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997078.691848:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789997078.691852:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997078.691856:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997078.691858:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997078.691861:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712858624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997078.691891:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997078.693764:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712858624 00000100:00100000:2.0:1789997078.693778:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712858624 00010000:00010000:2.0:1789997078.693833:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b3db expref: 19 pid: 5805 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997078.693909:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789997078.693921:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712858624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997078.693934:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997078.693940:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b3db expref: 19 pid: 5805 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.693952:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b3db expref: 19 pid: 5805 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.693969:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b3e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b3db expref: 19 pid: 5805 timeout: 1417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.693985:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.693994:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.694011:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.694017:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.694023:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.694041:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.694048:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997078.694052:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.694060:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.694292:0:62551:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997078.694302:0:62551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.695584:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.695599:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592b41a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997078.695617:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997078.695718:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712858624:12345-0@lo:103:ldlm_bl.0 Request processed in 1796us (3822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997078.695727:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789997078.695823:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712858624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997079.307752:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997079.754958:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997079.754966:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997079.754972:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997079.755019:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997079.755032:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997079.755043:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997079.755069:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712858752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997079.755154:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997079.755224:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789997079.755319:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712858752 00000100:00100000:3.0:1789997079.755329:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712858752 00000100:00100000:3.0:1789997079.755386:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1789997079.755397:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712858752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997079.755410:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997079.755423:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b421 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997079.755447:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b421 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997079.755458:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b421 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997079.755468:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997079.755523:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712858752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997079.755530:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1789997079.755577:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712858752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997079.755592:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997079.755608:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997079.755627:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997079.755632:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997079.755640:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997080.014315:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712859264:0@lo:400:kworker.0 00000100:00100000:2.0:1789997080.014389:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997080.014452:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712859264 00000100:00100000:2.0:1789997080.014458:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789997080.014463:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712859264 00000100:00100000:2.0:1789997080.014466:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712858880:0@lo:400:kworker.0 00000100:00100000:2.0:1789997080.014494:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997080.014517:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712859392:0@lo:400:kworker.0 00000100:00100000:3.0:1789997080.014534:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1789997080.014540:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997080.014548:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712859264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997080.014568:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712859008:0@lo:400:kworker.0 00000100:00100000:2.0:1789997080.014605:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997080.014621:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712859264:12345-0@lo:400:kworker.0 Request processed in 77us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997080.014628:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1789997080.014673:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997080.014682:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712859136:0@lo:400:kworker.0 00000100:00100000:2.0:1789997080.014704:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997080.014758:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712859136 00000100:00100000:3.0:1789997080.014763:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712859136 00000100:00100000:3.0:1789997080.014789:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1789997080.014796:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712859136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997080.014829:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712859136:12345-0@lo:400:kworker.0 Request processed in 33us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997080.014835:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1789997080.015918:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712859136:0@lo:400:kworker.0 00000100:00100000:2.0:1789997080.015960:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712858880 00000100:00100000:2.0:1789997080.015964:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712858880 00000100:00100000:2.0:1789997080.016018:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712859392 00000100:00100000:2.0:1789997080.016022:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712859392 00000100:00100000:3.0:1789997080.016034:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712859008 00000100:00100000:3.0:1789997080.016041:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712859008 00000100:00100000:2.0:1789997080.016051:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1789997080.016061:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712858880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997080.016079:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:3.0:1789997080.016098:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712859392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997080.016127:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712858880:12345-0@lo:400:kworker.0 Request processed in 57us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997080.016135:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:2.0:1789997080.016153:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1789997080.016160:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712859392:12345-0@lo:400:kworker.0 Request processed in 64us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997080.016164:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712859008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997080.016173:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:2.0:1789997080.016208:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712859008:12345-0@lo:400:kworker.0 Request processed in 47us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997080.016216:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1789997080.016220:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712858880:0@lo:400:kworker.0 00000100:00100000:3.0:1789997080.016236:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712859392:0@lo:400:kworker.0 00000100:00100000:3.0:1789997080.016251:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712859264:0@lo:400:kworker.0 00000100:00100000:2.0:1789997080.016262:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712859008:0@lo:400:kworker.0 00000100:00080000:0.0:1789997080.016403:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997080.016408:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997080.016411:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997080.330830:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997081.136734:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997081.136776:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704343552 00000100:00100000:2.0:1789997081.136787:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704343552 00000100:00100000:2.0:1789997081.136855:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 457 00000100:00100000:2.0:1789997081.136867:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37051:x1876946704343552:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997081.136893:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997081.136917:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b42f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae874 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.136987:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.137003:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.137027:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.137042:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.137050:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.137057:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138823:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138843:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138854:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997081.138893:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789997081.138898:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997081.138919:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138933:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138938:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138959:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138965:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997081.138970:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138977:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.138989:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997081.138992:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997081.138997:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139003:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139015:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139022:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139028:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139033:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997081.139036:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139053:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139062:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997081.139065:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997081.139068:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139074:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b43d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139127:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b42f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae874 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139147:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae874 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.139156:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997081.139158:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997081.139160:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997081.142443:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37051:x1876946704343552:12345-192.168.204.4@tcp:101:touch.0 Request processed in 5562us (5700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997081.142457:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 457 00000100:00080000:2.0:1789997081.142513:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997081.145216:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997081.145436:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704343808 00000100:00100000:3.0:1789997081.145448:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704343808 00000100:00100000:3.0:1789997081.145514:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 458 00000100:00100000:3.0:1789997081.145527:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37051:x1876946704343808:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997081.145551:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997081.145573:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b44b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae87b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.145906:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.145923:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.145936:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.145953:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.145960:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.145975:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997081.148951:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf:0x0], index 1: 0 00010000:00010000:3.0:1789997081.151486:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.151510:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.151525:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.151571:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.151578:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.151585:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.151590:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997081.151596:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.151603:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.151616:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:3.0:1789997081.151619:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997081.151639:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.152977:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b452 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997081.153000:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe855cfa reply state 000000000e10b9b4 transno 4294967478 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997081.153011:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997081.153061:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b44b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae87b expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.153078:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae87b expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.153088:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997081.153091:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997081.153104:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997081.154216:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37051:x1876946704343808:12345-192.168.204.4@tcp:101:touch.0 Request processed in 8686us (9005us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789997081.154228:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 458 00010000:00010000:1.0:1789997081.172532:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.172552:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.172561:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.172569:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997081.172574:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.172583:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.172602:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38ee49e700) 00010000:00010000:1.0:1789997081.172606:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997081.172611:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.172618:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b459 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997081.174327:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997081.175453:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704344064 00000100:00100000:1.0:1789997081.175467:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704344064 00000100:00100000:1.0:1789997081.175542:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 459 00000100:00100000:1.0:1789997081.175556:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:37051:x1876946704344064:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:1.0:1789997081.175623:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997081.175682:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae87b expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.175718:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:1.0:1789997081.175733:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997081.175780:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.175793:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.175802:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997081.175937:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e01c1ae5 reply state 000000003e1fd883 transno 4294967479 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997081.175947:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997081.176050:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37051:x1876946704344064:12345-192.168.204.4@tcp:36:touch.0 Request processed in 497us (1730us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789997081.176058:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 459 00000100:00100000:2.0:1789997081.183469:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:0.0:1789997081.183749:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997081.183762:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997081.183772:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704344192 00000100:00100000:3.0:1789997081.183785:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704344192 00010000:00010000:0.0:1789997081.183788:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997081.183795:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997081.183801:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997081.183809:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997081.183826:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:0.0:1789997081.183829:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997081.183834:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997081.183842:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b46e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997081.183846:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 460 00000100:00100000:3.0:1789997081.183862:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37051:x1876946704344192:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997081.183890:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997081.183911:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae882 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.183992:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae882 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.184008:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b475 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae882 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.184028:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997081.184031:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997081.184034:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997081.184113:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37051:x1876946704344192:12345-192.168.204.4@tcp:101:touch.0 Request processed in 255us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997081.184121:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 460 00000100:00100000:3.0:1789997081.186998:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997081.187114:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704344320 00000100:00100000:2.0:1789997081.187126:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704344320 00000100:00100000:2.0:1789997081.187241:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 231 00000100:00100000:2.0:1789997081.187254:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704344320:12345-192.168.204.4@tcp:2:touch.0 00000100:00080000:0.0:1789997081.187351:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997081.187968:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704344320:12345-192.168.204.4@tcp:2:touch.0 Request processed in 715us (978us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789997081.187977:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 231 00000100:00100000:0.0:1789997081.194546:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997081.195031:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704344576 00000100:00100000:1.0:1789997081.195042:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704344576 00000100:00100000:1.0:1789997081.195114:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:1.0:1789997081.195126:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37051:x1876946704344576:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:1.0:1789997081.195994:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:37051:x1876946704344576:12345-192.168.204.4@tcp:35:touch.0 Request processed in 865us (1456us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789997081.196003:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 52 00000100:00100000:0.0:1789997081.260436:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997081.260536:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704344704 00000100:00100000:2.0:1789997081.260547:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704344704 00000100:00100000:2.0:1789997081.260613:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 461 00000100:00100000:2.0:1789997081.260625:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:37055:x1876946704344704:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997081.260687:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997081.260710:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b47c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae889 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260790:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260807:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260819:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260833:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260841:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260847:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260956:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260967:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.260973:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997081.261008:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x26:0x0]: returning size 0 00000004:00200000:2.0:1789997081.261014:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997081.261035:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261047:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261054:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261059:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261065:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261071:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997081.261076:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261082:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261113:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997081.261116:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997081.261122:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261128:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b483 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261143:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261149:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261154:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261159:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997081.261162:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261167:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261173:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997081.261176:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997081.261178:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261183:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592b48a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261225:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b47c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae889 expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261239:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae889 expref: 11 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.261246:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:2.0:1789997081.261248:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997081.261250:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997081.261328:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:37055:x1876946704344704:12345-192.168.204.4@tcp:101:rm.0 Request processed in 704us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997081.261335:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 461 00000100:00100000:2.0:1789997081.268903:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997081.269106:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704344832 00000100:00100000:3.0:1789997081.269121:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704344832 00000100:00100000:3.0:1789997081.269177:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 232 00000100:00100000:3.0:1789997081.269188:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704344832:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997081.269209:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997081.269233:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae890 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997081.269266:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x6ab13019, atime: 0x6ab13019, ctime: 0x6ab13019, blocks: 0x1 00010000:00010000:3.0:1789997081.269288:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=1269s v=(0 0) 00010000:00010000:3.0:1789997081.269293:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997081.269303:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.269356:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997081.269372:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b600, rc 0) 00000100:00100000:3.0:1789997081.269454:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704344832:12345-192.168.204.4@tcp:101:rm.0 Request processed in 268us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997081.269462:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 232 00000100:00100000:0.0:1789997081.275992:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997081.276108:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704345088 00000100:00100000:1.0:1789997081.276122:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704345088 00000100:00100000:1.0:1789997081.276205:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 462 00000100:00100000:1.0:1789997081.276217:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:37055:x1876946704345088:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997081.276291:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997081.276323:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae889 expref: 11 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276347:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae882 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276359:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:1.0:1789997081.276370:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997081.276395:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276409:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276421:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276437:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276443:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276449:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276547:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276562:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.276570:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997081.277200:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 64 off9152 00000004:00080000:1.0:1789997081.277212:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1269969557581ns, next at 1270969555105ns, rc = 0 00010000:00010000:1.0:1789997081.277266:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277277:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277284:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277292:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277298:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277304:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277326:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997081.277347:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277353:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.277361:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997081.277370:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.277373:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277381:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997081.277389:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997081.277390:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.277396:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277401:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.277409:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277415:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789997081.277420:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997081.277424:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.277679:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:2.0:1789997081.277682:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997081.277686:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.277703:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997081.277717:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997081.277719:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997081.277721:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997081.277907:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b4ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277928:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277935:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277941:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277946:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997081.277949:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277967:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277976:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:1.0:1789997081.277979:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997081.277982:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.277988:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592b49f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997081.277999:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aab822ff reply state 00000000cacf77a0 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997081.278008:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997081.278111:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:37055:x1876946704345088:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1894us (2130us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789997081.278121:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 462 00010000:00010000:1.0:1789997081.283075:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.283104:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.283112:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.283118:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997081.283123:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.283151:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.283169:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997081.283172:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997081.283358:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997081.283366:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997081.354956:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997081.878896:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997081.878948:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997081.879417:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704345216 00000100:00100000:3.0:1789997081.879430:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704345216 00000100:00100000:3.0:1789997081.879491:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 822 00000100:00100000:3.0:1789997081.879503:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704345216:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997081.879590:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704345216:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 90us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997081.879598:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 822 00000100:00100000:2.0:1789997081.879732:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704345344 00000100:00100000:2.0:1789997081.879736:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704345344 00000100:00100000:2.0:1789997081.879787:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 489 00000100:00100000:2.0:1789997081.879795:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704345344:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997081.879830:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704345344:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997081.879836:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 489 00000100:00080000:0.0:1789997081.879897:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997082.066224:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712859520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997082.067801:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997082.067878:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997082.067889:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712859648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997082.067932:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997082.068256:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712859520 00000100:00100000:1.0:1789997082.068265:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712859520 00000100:00100000:1.0:1789997082.068384:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712859648 00000100:00100000:1.0:1789997082.068388:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712859648 00000100:00100000:1.0:1789997082.068409:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789997082.068418:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712859520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997082.068450:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997082.068498:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712859520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997082.068504:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789997082.068520:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789997082.068525:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712859648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997082.068542:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997082.068565:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712859648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997082.068571:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00080000:2.0:1789997082.069263:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997082.069268:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997082.069392:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712859648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997082.069412:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712859520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997082.378815:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997082.743542:0:62795:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe87a0ce60 20000000:00000080:1.0:1789997082.743562:0:62795:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c62ed400 uarg=0000000000000000 00010000:00010000:1.0:1789997082.743893:0:62795:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997082.743930:0:62795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:1.0:1789997082.743935:0:62795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997082.743947:0:62795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae874 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997082.743971:0:62795:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997082.743989:0:62795:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997082.744004:0:62795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997082.744018:0:62795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b421 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997082.744026:0:62795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997082.744310:0:62795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b421 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997082.744331:0:62795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b421 expref: 18 pid: 7594 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997082.744346:0:62795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62795:1876946712859776:0@lo:104: 00000100:00100000:1.0:1789997082.744409:0:62795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997082.744473:0:62795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c2a52540 going to sleep for 11 seconds 00000100:00100000:3.0:1789997082.744595:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789997082.744609:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712859776 00000100:00100000:3.0:1789997082.744627:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712859776 00000100:00100000:3.0:1789997082.744702:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789997082.744711:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd8f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62795:x1876946712859776:12345-0@lo:104: 00010000:00010000:3.0:1789997082.744724:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.744793:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997082.744800:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd8f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62795:x1876946712859776:12345-0@lo:104: Request processed in 91us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997082.744821:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00010000:0.0:1789997082.744830:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997082.744837:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997082.744853:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997082.744857:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997082.744866:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997082.744873:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997082.744878:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997082.744918:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997082.744925:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997082.744947:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997082.744954:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592b421 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b428 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997082.744989:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997082.744991:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997082.744992:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997082.745004:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712859904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997082.745036:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997082.745300:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712859904 00000100:00100000:3.0:1789997082.745305:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712859904 00010000:00010000:3.0:1789997082.745325:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b421 expref: 19 pid: 7594 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997082.745348:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789997082.745356:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712859904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997082.745365:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997082.745370:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b421 expref: 19 pid: 7594 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745381:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b421 expref: 19 pid: 7594 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745397:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745405:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745418:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745424:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745431:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745448:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745454:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997082.745458:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745465:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745474:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997082.745485:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997082.745525:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712859904:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997082.745532:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00010000:00010000:1.0:1789997082.746937:0:62795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592b428 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b421 expref: 18 pid: 7594 timeout: 1421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997082.746975:0:62795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62795:1876946712859776:0@lo:104: 00010000:00010000:1.0:1789997082.746999:0:62795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997082.747009:0:62795:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997082.747016:0:62795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997082.747022:0:62795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b4bb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997082.749362:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712859904:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1789997083.142000:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967481 is committed 00000004:00080000:2.0:1789997083.142013:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 41 committed 00000100:00100000:2.0:1789997083.142163:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712860032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997083.142244:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997083.142750:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712860032 00000100:00100000:3.0:1789997083.142759:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712860032 00000100:00100000:3.0:1789997083.142824:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789997083.142834:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712860032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789997083.142864:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:15 count 1 00010000:00010000:3.0:1789997083.142889:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.142909:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.142930:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789997083.142934:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997083.142939:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.142967:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.144027:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 6 pid: 6659 timeout: 1371 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997083.144050:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712860160:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997083.144194:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32bcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789997083.147242:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997083.147395:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704345472 00000100:00100000:1.0:1789997083.147405:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704345472 00010000:00010000:1.0:1789997083.147460:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 7 pid: 6659 timeout: 1371 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997083.147508:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 284 00000100:00100000:1.0:1789997083.147519:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704345472:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997083.147534:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997083.147540:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 7 pid: 6659 timeout: 1371 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997083.147553:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 7 pid: 6659 timeout: 1371 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997083.147597:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997083.147600:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592b498 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae890 expref: 7 pid: 6659 timeout: 1371 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997083.147603:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997083.147615:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997083.147625:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712860160:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997083.147628:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.147651:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997083.147680:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997083.147700:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.147710:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.147728:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997083.147737:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704345472:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 218us (502us total) trans 0 rc 0/0 00010000:00010000:3.0:1789997083.147740:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997083.147752:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 284 00010000:00010000:3.0:1789997083.147766:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1789997083.148129:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997083.148409:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712860032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5574us (6163us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789997083.148418:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00010000:3.0:1789997083.148445:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997083.148452:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.148462:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997083.148467:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.148477:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.148493:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997083.148500:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000845b71bd/0x65b43101d592b4c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997083.148522:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c80b6680/2, rc 0, transno 4294967326 00010000:00010000:3.0:1789997083.148528:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997083.148532:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997083.148533:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712860032:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789997083.148535:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997083.404371:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997084.428926:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997084.428934:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997084.428939:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997084.428986:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997084.428997:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997084.429008:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997084.429047:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712860288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997084.429127:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997084.429190:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c8018540 going to sleep for 11 seconds 00000100:00100000:2.0:1789997084.429263:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712860288 00000100:00100000:2.0:1789997084.429271:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712860288 00000100:00100000:2.0:1789997084.429330:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1789997084.429340:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712860288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997084.429353:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997084.429366:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b4c9 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997084.429396:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997084.429409:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997084.429418:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997084.429462:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712860288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997084.429469:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1789997084.429514:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712860288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997084.429528:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997084.429537:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997084.429565:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997084.429570:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997084.429593:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997084.436851:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997085.136533:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712860416:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.136606:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997085.136734:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712860416 00000100:00100000:3.0:1789997085.136744:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712860416 00000100:00100000:3.0:1789997085.136789:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1789997085.136797:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712860416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997085.139497:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712860416:12345-0@lo:400:kworker.0 Request processed in 2688us (2880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997085.139512:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1789997085.144834:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712860416:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.144870:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712860928:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.144923:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997085.144954:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997085.144962:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712860544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.144984:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997085.145036:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712860672:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.145063:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997085.145082:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997085.145089:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712860800:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.145112:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997085.145145:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712860928 00000100:00100000:2.0:1789997085.145151:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712860928 00000100:00100000:2.0:1789997085.145335:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712860544 00000100:00100000:2.0:1789997085.145339:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712860544 00000100:00100000:2.0:1789997085.145366:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1789997085.145377:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712860928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.145861:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712860928:12345-0@lo:400:kworker.0 Request processed in 60us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997085.145870:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1789997085.145892:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:2.0:1789997085.145899:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712860544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.145932:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712860544:12345-0@lo:400:kworker.0 Request processed in 34us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997085.145937:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:2.0:1789997085.145980:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712860672 00000100:00100000:2.0:1789997085.145985:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712860672 00000100:00100000:2.0:1789997085.146011:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712860800 00000100:00100000:2.0:1789997085.146013:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712860800 00000100:00100000:2.0:1789997085.146051:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1789997085.146058:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712860672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.146093:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712860672:12345-0@lo:400:kworker.0 Request processed in 35us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997085.146100:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1789997085.146111:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1789997085.146117:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712860800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.146143:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712860800:12345-0@lo:400:kworker.0 Request processed in 26us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997085.146148:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00080000:2.0:1789997085.146167:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997085.146170:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997085.146173:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997085.147434:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712860800:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.147470:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712860672:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.147513:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712860544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997085.147525:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712860928:0@lo:400:kworker.0 00010000:00010000:3.0:1789997085.450752:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997086.168916:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997086.168951:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704345600 00000100:00100000:1.0:1789997086.169022:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704345600 00000100:00100000:1.0:1789997086.169116:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 463 00000100:00100000:1.0:1789997086.169126:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37143:x1876946704345600:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997086.169387:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997086.169411:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae897 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789997086.169864:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789997086.170824:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997086.170846:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997086.170861:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997086.170908:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:1.0:1789997086.170912:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997086.170932:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997086.170963:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b4d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae897 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997086.170990:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae897 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997086.171008:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997086.171023:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997086.171028:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997086.171097:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37143:x1876946704345600:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 1972us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997086.171105:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 463 00000100:00100000:2.0:1789997086.178822:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997086.178858:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704345856 00000100:00100000:2.0:1789997086.178869:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704345856 00000100:00100000:2.0:1789997086.178916:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 464 00000100:00100000:2.0:1789997086.178925:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37143:x1876946704345856:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997086.178975:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997086.179023:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b4de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae897 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997086.179039:0:5811:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b444) 00010000:00010000:2.0:1789997086.179044:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:2.0:1789997086.179055:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997086.179082:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997086.179096:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997086.179107:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997086.229459:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1789997086.229476:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00000004:00010000:2.0:1789997086.234014:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002da0d8a9 reply state 0000000032279437 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997086.234055:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997086.234074:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:2.0:1789997086.234184:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37143:x1876946704345856:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 55254us (55362us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789997086.234193:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 464 00000001:00080000:2.0:1789997086.234250:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967482 is committed 00010000:00010000:0.0:1789997086.234523:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997086.234535:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997086.234544:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997086.234550:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997086.234555:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997086.234564:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997086.234580:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:0.0:1789997086.234584:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997086.234591:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997086.234598:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b4e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997086.480215:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997087.002296:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997087.002343:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997087.002479:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704345984 00000100:00100000:3.0:1789997087.002490:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704345984 00000100:00100000:3.0:1789997087.002549:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 824 00000100:00100000:3.0:1789997087.002560:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704345984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997087.002637:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704345984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997087.002644:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 824 00000100:00100000:1.0:1789997087.002748:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704346112 00000100:00100000:1.0:1789997087.002752:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704346112 00000100:00100000:1.0:1789997087.002792:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 914 00000100:00100000:1.0:1789997087.002800:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704346112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997087.002835:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704346112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997087.002841:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 914 00000100:00100000:1.0:1789997087.013736:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997087.013798:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997087.013870:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704346240 00000100:00100000:0.0:1789997087.013883:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704346240 00000100:00100000:0.0:1789997087.013944:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704346368 00000100:00100000:0.0:1789997087.013948:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704346368 00000100:00100000:0.0:1789997087.013969:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 492 00000100:00100000:0.0:1789997087.013979:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704346368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997087.014078:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704346368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997087.014085:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 492 00000100:00100000:0.0:1789997087.014103:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 234 00000100:00100000:0.0:1789997087.014109:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704346240:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:0.0:1789997087.014128:0:8169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592b261 00000100:00080000:0.0:1789997087.014137:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38c53da000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789997087.014170:0:8169:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789997087.014425:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704346240:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 315us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997087.014432:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 234 00010000:00010000:0.0:1789997087.014459:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789997087.015092:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997087.015098:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997087.180200:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712861056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997087.180286:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997087.180452:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712861056 00000100:00100000:0.0:1789997087.180461:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712861056 00000100:00100000:0.0:1789997087.180526:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1789997087.180536:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712861056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997087.180571:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997087.180616:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712861056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997087.180623:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00080000:2.0:1789997087.180757:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997087.180791:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1789997087.180796:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c80b6680, transno 4294967326 00000100:00100000:2.0:1789997087.180819:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712861056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997087.181535:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712861184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997087.181577:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997087.182327:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712861184 00000100:00100000:1.0:1789997087.182337:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712861184 00000100:00100000:1.0:1789997087.182409:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789997087.182419:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712861184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997087.182449:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997087.182510:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712861184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997087.182518:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789997087.182571:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712861184:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997087.182723:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789997087.214274:0:62993:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd07b58ba0 20000000:00000080:3.0:1789997087.214295:0:62993:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c85af000 uarg=0000000000000000 00010000:00010000:3.0:1789997087.215483:0:62993:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997087.215504:0:62993:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997087.215519:0:62993:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997087.215538:0:62993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997087.215568:0:62993:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997087.215576:0:62993:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997087.215617:0:62993:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997087.215632:0:62993:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 18 pid: 7594 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997087.215647:0:62993:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62993:1876946712861312:0@lo:104: 00000100:00100000:3.0:1789997087.216160:0:62993:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997087.216271:0:62993:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d057b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789997087.216502:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712861312 00000100:00100000:0.0:1789997087.216510:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712861312 00000100:00100000:0.0:1789997087.216564:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789997087.216575:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62993:x1876946712861312:12345-0@lo:104: 00010000:00010000:0.0:1789997087.216588:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.217742:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997087.217758:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:62993:x1876946712861312:12345-0@lo:104: Request processed in 1180us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997087.217769:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00010000:00010000:1.0:1789997087.217913:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997087.217923:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997087.217933:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997087.217937:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997087.217948:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997087.217956:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997087.217962:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997087.218021:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997087.218028:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997087.218058:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997087.218066:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b4c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b4d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997087.218084:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997087.218086:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997087.218088:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997087.218096:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997087.218110:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712861440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997087.218181:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997087.218390:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712861440 00000100:00100000:0.0:1789997087.218398:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712861440 00010000:00010000:0.0:1789997087.218425:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 19 pid: 7594 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997087.218461:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789997087.218470:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712861440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997087.218484:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997087.218490:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 19 pid: 7594 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218501:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 19 pid: 7594 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218520:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218530:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997087.218538:0:62993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592b4d0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b4c9 expref: 19 pid: 7594 timeout: 1425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218548:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997087.218552:0:62993:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62993:1876946712861312:0@lo:104: 00010000:00010000:0.0:1789997087.218563:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218619:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218626:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997087.218630:0:62993:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218632:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997087.218639:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997087.218645:0:62993:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218649:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997087.218672:0:62993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218692:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218700:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592b4ec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997087.218717:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997087.218753:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712861440:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997087.218760:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789997087.219099:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712861440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997087.499834:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997088.331042:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997088.331051:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997088.331055:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997088.331101:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997088.331114:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997088.331125:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997088.331163:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712861568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997088.331249:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997088.331303:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee545300 going to sleep for 11 seconds 00000100:00100000:0.0:1789997088.331524:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712861568 00000100:00100000:0.0:1789997088.331533:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712861568 00000100:00100000:0.0:1789997088.331586:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:0.0:1789997088.331594:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712861568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997088.331617:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997088.331632:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b4f3 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997088.331677:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997088.331688:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997088.331698:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997088.332063:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712861568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 467us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997088.332070:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:0.0:1789997088.332128:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712861568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997088.332144:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997088.332154:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997088.332173:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997088.332179:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997088.332261:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997088.527103:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997089.547850:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997090.250861:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712861824:0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.250951:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997090.251092:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712861696:0@lo:400:kworker.0 00000100:00100000:1.0:1789997090.251127:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997090.251173:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712861696 00000100:00100000:1.0:1789997090.251181:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712861696 00000100:00100000:1.0:1789997090.251229:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1789997090.251238:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712861696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997090.251288:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712861696:12345-0@lo:400:kworker.0 Request processed in 52us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997090.251295:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1789997090.251492:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712862336:0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.251519:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997090.251558:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712861952:0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.251582:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997090.251606:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712862080:0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.251630:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997090.251686:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712861824 00000100:00100000:3.0:1789997090.251691:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712861824 00000100:00100000:3.0:1789997090.251721:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712862336 00000100:00100000:3.0:1789997090.251724:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712862336 00000100:00100000:3.0:1789997090.251751:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712861952 00000100:00100000:3.0:1789997090.251754:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712861952 00000100:00100000:3.0:1789997090.251773:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1789997090.251780:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712861824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.251820:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712861824:12345-0@lo:400:kworker.0 Request processed in 40us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997090.251826:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1789997090.251841:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1789997090.251847:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712862336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.251874:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712862336:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997090.251880:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1789997090.251891:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:3.0:1789997090.251897:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712861952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.251939:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712861952:12345-0@lo:400:kworker.0 Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997090.251956:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:3.0:1789997090.251978:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712862080 00000100:00100000:3.0:1789997090.251982:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712862080 00000100:00100000:3.0:1789997090.252277:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:3.0:1789997090.252285:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712862080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.252324:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712862080:12345-0@lo:400:kworker.0 Request processed in 41us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997090.252331:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00080000:3.0:1789997090.252353:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997090.252358:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997090.254759:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712861696:0@lo:400:kworker.0 00000100:00100000:1.0:1789997090.254778:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712862208:0@lo:400:kworker.0 00000100:00100000:1.0:1789997090.254843:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997090.255010:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712862336:0@lo:400:kworker.0 00000100:00100000:2.0:1789997090.255023:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712862208 00000100:00100000:2.0:1789997090.255032:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712862208 00000100:00100000:3.0:1789997090.255035:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712861824:0@lo:400:kworker.0 00000100:00080000:3.0:1789997090.255062:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997090.255180:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1789997090.255191:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712862208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997090.255242:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712862208:12345-0@lo:400:kworker.0 Request processed in 54us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997090.255248:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1789997090.255752:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712861952:0@lo:400:kworker.0 00000100:00100000:1.0:1789997090.255783:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712862208:0@lo:400:kworker.0 00000100:00100000:3.0:1789997090.255833:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712862080:0@lo:400:kworker.0 00000100:00100000:2.0:1789997090.340048:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997090.340089:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704346496 00000100:00100000:2.0:1789997090.340098:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704346496 00000100:00100000:2.0:1789997090.340158:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 465 00000100:00100000:2.0:1789997090.340169:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37219:x1876946704346496:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997090.340189:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997090.340211:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae89e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340274:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340289:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340302:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340330:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340338:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340346:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340635:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340645:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340672:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997090.340696:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789997090.340700:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997090.340720:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340732:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340740:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340748:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340764:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997090.340769:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340778:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340791:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:2.0:1789997090.340795:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997090.340799:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340806:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340820:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340825:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340831:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340837:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997090.340840:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340862:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340882:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997090.340885:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997090.340888:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340895:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592b50f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340938:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae89e expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340955:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae89e expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.340964:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997090.340966:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997090.340969:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997090.341030:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37219:x1876946704346496:12345-192.168.204.4@tcp:101:touch.0 Request processed in 862us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997090.341038:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 465 00000100:00080000:2.0:1789997090.341163:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997090.356862:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997090.356946:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704346752 00000100:00100000:1.0:1789997090.356956:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704346752 00000100:00100000:1.0:1789997090.357019:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 466 00000100:00100000:1.0:1789997090.357030:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37219:x1876946704346752:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997090.357062:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997090.357084:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b51d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8a5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357182:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357198:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357210:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357224:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357231:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357238:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997090.357253:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:1.0:1789997090.357273:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357281:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357288:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357294:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997090.357298:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357316:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357330:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:1.0:1789997090.357334:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997090.357340:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357348:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b524 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357361:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357368:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357374:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357380:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997090.357383:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357390:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357397:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38e062de00) 00010000:00010000:1.0:1789997090.357400:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997090.357403:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357419:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b52b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357453:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b51d lrc: 1/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8a5 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357463:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:1.0:1789997090.357466:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997090.357469:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b51d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8a5 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.357478:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997090.357537:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37219:x1876946704346752:12345-192.168.204.4@tcp:101:touch.0 Request processed in 508us (695us total) trans 0 rc 301/301 00000100:00100000:1.0:1789997090.357544:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 466 00000100:00100000:1.0:1789997090.367601:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997090.367638:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704346880 00000100:00100000:1.0:1789997090.367649:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704346880 00000100:00100000:1.0:1789997090.367716:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 467 00000100:00100000:1.0:1789997090.367725:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37219:x1876946704346880:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997090.367747:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997090.367773:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b532 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8ac expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367843:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367888:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367903:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367931:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367939:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367945:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367966:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367974:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367981:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.367988:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997090.367993:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368001:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368013:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:1.0:1789997090.368022:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997090.368027:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368033:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592b539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368046:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368052:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368058:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368063:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997090.368066:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368072:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368079:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38e062d000) 00010000:00010000:1.0:1789997090.368081:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997090.368084:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368090:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368123:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b532 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8ac expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368140:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:1.0:1789997090.368143:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997090.368147:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592b532 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8ac expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997090.368157:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997090.368223:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37219:x1876946704346880:12345-192.168.204.4@tcp:101:touch.0 Request processed in 498us (633us total) trans 0 rc 301/301 00000100:00100000:1.0:1789997090.368231:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 467 00000100:00100000:0.0:1789997090.376197:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997090.381252:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704347008 00000100:00100000:2.0:1789997090.381268:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704347008 00000100:00100000:2.0:1789997090.381340:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 468 00000100:00100000:2.0:1789997090.381352:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37219:x1876946704347008:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997090.381374:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997090.381398:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b547 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8b3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381482:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381497:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381509:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381524:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381531:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381538:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381560:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381567:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381573:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381579:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997090.381584:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381602:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381615:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997090.381619:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997090.381624:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381631:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592b54e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381644:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381683:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381691:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381697:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997090.381700:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381707:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381715:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997090.381718:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997090.381721:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381738:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381772:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b547 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8b3 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381783:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997090.381785:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997090.381789:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b547 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8b3 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997090.381799:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997090.381886:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37219:x1876946704347008:12345-192.168.204.4@tcp:101:touch.0 Request processed in 536us (5699us total) trans 0 rc 301/301 00000100:00100000:2.0:1789997090.381892:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 468 00010000:00010000:1.0:1789997090.571646:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789997091.388104:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997091.388115:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a38c53de000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997091.388145:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38c53de000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:0.0:1789997091.388189:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38c53da000 for lustre-OST0000 00010000:00010000:0.0:1789997091.612940:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997092.126199:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997092.126254:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997092.126283:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997092.126309:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704347136 00000100:00100000:0.0:1789997092.126318:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704347136 00000100:00100000:0.0:1789997092.126368:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 827 00000100:00100000:0.0:1789997092.126377:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704347136:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997092.126444:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704347136:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997092.126451:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 827 00000100:00100000:3.0:1789997092.127062:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704347264 00000100:00100000:3.0:1789997092.127068:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704347264 00000100:00100000:3.0:1789997092.127142:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 918 00000100:00100000:3.0:1789997092.127150:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704347264:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997092.127194:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704347264:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997092.127201:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 918 00000100:00100000:3.0:1789997092.127220:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704347392 00000100:00100000:3.0:1789997092.127224:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704347392 00000100:00100000:3.0:1789997092.127250:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 495 00000100:00100000:3.0:1789997092.127256:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704347392:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997092.127294:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704347392:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997092.127301:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 495 00000100:00080000:0.0:1789997092.128376:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997092.128384:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997092.299344:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712862464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997092.299413:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997092.299480:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712862464 00000100:00100000:1.0:1789997092.299501:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712862464 00000100:00100000:1.0:1789997092.299554:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1789997092.299563:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712862464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997092.299610:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997092.299679:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712862464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997092.299857:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00080000:1.0:1789997092.299893:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997092.299929:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712862464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997092.300075:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997092.300084:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712862592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997092.300126:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997092.300153:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712862592 00000100:00100000:0.0:1789997092.300157:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712862592 00000100:00100000:0.0:1789997092.300189:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:0.0:1789997092.300195:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712862592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997092.300216:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997092.300252:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712862592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997092.300259:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00080000:0.0:1789997092.300272:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997092.300294:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712862592:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1789997092.479448:0:63239:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb6108fe0 20000000:00000080:3.0:1789997092.479465:0:63239:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c12aa800 uarg=0000000000000000 00010000:00010000:3.0:1789997092.480206:0:63239:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997092.480247:0:63239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:3.0:1789997092.480251:0:63239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997092.480263:0:63239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae89e expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997092.480285:0:63239:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997092.480304:0:63239:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997092.480318:0:63239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997092.480331:0:63239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997092.480339:0:63239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997092.480375:0:63239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997092.480388:0:63239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 18 pid: 7594 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997092.480402:0:63239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63239:1876946712862720:0@lo:104: 00000100:00100000:3.0:1789997092.480470:0:63239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997092.483793:0:63239:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789997092.493737:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712862720 00000100:00100000:0.0:1789997092.493753:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712862720 00000100:00100000:0.0:1789997092.493859:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789997092.493870:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:63239:x1876946712862720:12345-0@lo:104: 00010000:00010000:0.0:1789997092.493900:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997092.493988:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997092.493994:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:63239:x1876946712862720:12345-0@lo:104: Request processed in 127us (13524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997092.494001:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00010000:1.0:1789997092.494088:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997092.494095:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494122:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997092.494127:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494135:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997092.494141:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997092.494147:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997092.494183:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494190:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997092.494216:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494224:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592b4f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b4fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494241:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997092.494242:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997092.494244:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997092.494270:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712862848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997092.494312:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997092.494363:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712862848 00000100:00100000:1.0:1789997092.494367:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712862848 00010000:00010000:1.0:1789997092.494388:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 19 pid: 7594 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997092.494420:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789997092.494426:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712862848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997092.494437:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997092.494442:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 19 pid: 7594 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494452:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 19 pid: 7594 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494470:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494478:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494510:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494517:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494524:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494530:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494536:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997092.494540:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494554:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494563:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997092.494573:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997092.494609:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712862848:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997092.494617:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789997092.494674:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712862848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997092.497819:0:63239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b4fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b4f3 expref: 18 pid: 7594 timeout: 1431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997092.497841:0:63239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63239:1876946712862720:0@lo:104: 00010000:00010000:2.0:1789997092.497867:0:63239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997092.497887:0:63239:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997092.497894:0:63239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997092.497919:0:63239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b600/0x65b43101d592b55c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997092.621380:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997093.644018:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997093.773131:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997093.773138:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997093.773143:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997093.773189:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997093.773202:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997093.773216:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997093.773244:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712862976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997093.773318:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997093.773743:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789997093.773765:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712862976 00000100:00100000:2.0:1789997093.773772:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712862976 00000100:00100000:2.0:1789997093.773820:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1789997093.773829:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712862976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997093.773842:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997093.773867:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b563 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997093.773891:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b563 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997093.773911:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b563 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997093.773921:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2200, rc 0) 00000100:00100000:2.0:1789997093.774308:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712862976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 478us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997093.774315:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1789997093.774368:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712862976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997093.774384:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997093.774393:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997093.774415:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997093.774421:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997093.774429:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997094.668918:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997095.371131:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712863360:0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.371205:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997095.371279:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789997095.371286:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712863232:0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.371310:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997095.371327:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712863744:0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.371360:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997095.371391:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712863360 00000100:00100000:1.0:1789997095.371398:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712863360 00000100:00100000:1.0:1789997095.371446:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712863232 00000100:00100000:1.0:1789997095.371450:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712863232 00000100:00100000:1.0:1789997095.371465:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712863744 00000100:00100000:1.0:1789997095.371468:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712863744 00000100:00100000:1.0:1789997095.371490:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1789997095.371500:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712863360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.371555:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712863360:12345-0@lo:400:kworker.0 Request processed in 56us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997095.371581:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1789997095.371603:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1789997095.371609:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712863232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.371641:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712863232:12345-0@lo:400:kworker.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997095.371647:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1789997095.371700:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:1.0:1789997095.371707:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712863744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.371736:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712863744:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997095.371742:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1789997095.371920:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712863104:0@lo:400:kworker.0 00000100:00100000:3.0:1789997095.371962:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997095.371991:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712863616:0@lo:400:kworker.0 00000100:00100000:3.0:1789997095.372019:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997095.372040:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997095.372047:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712863488:0@lo:400:kworker.0 00000100:00100000:3.0:1789997095.372067:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997095.372098:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712863104 00000100:00100000:3.0:1789997095.372102:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712863104 00000100:00100000:3.0:1789997095.372131:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1789997095.372137:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712863104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997095.372169:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712863104:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997095.372175:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1789997095.372202:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712863616 00000100:00100000:3.0:1789997095.372206:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712863616 00000100:00100000:3.0:1789997095.372228:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712863488 00000100:00100000:3.0:1789997095.372231:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712863488 00000100:00100000:3.0:1789997095.372249:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1789997095.372255:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712863616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997095.372286:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712863616:12345-0@lo:400:kworker.0 Request processed in 31us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997095.372292:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1789997095.372302:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1789997095.372308:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712863488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997095.372344:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712863488:12345-0@lo:400:kworker.0 Request processed in 37us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997095.372351:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1789997095.372399:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712863488:0@lo:400:kworker.0 00000100:00100000:3.0:1789997095.372410:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712863104:0@lo:400:kworker.0 00000100:00100000:3.0:1789997095.372418:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712863616:0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.372493:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712863232:0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.372503:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712863744:0@lo:400:kworker.0 00000100:00100000:1.0:1789997095.372512:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712863360:0@lo:400:kworker.0 00000100:00080000:0.0:1789997095.372799:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997095.372803:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997095.372806:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997095.621946:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997095.622080:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704347520 00000100:00100000:3.0:1789997095.622091:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704347520 00000100:00100000:3.0:1789997095.622162:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 469 00000100:00100000:3.0:1789997095.622172:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37306:x1876946704347520:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997095.622193:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997095.622215:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8ba expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997095.622280:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997095.622296:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997095.622312:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997095.622351:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:3.0:1789997095.622355:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997095.622389:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997095.622429:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8ba expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997095.622451:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8ba expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997095.622460:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997095.622463:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997095.622467:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997095.622524:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37306:x1876946704347520:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 352us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997095.622531:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 469 00000100:00080000:0.0:1789997095.622647:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997095.626983:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997095.627326:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704347776 00000100:00100000:1.0:1789997095.627337:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704347776 00000100:00100000:1.0:1789997095.627530:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 470 00000100:00100000:1.0:1789997095.627542:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37306:x1876946704347776:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997095.627596:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997095.627624:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8ba expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.627643:0:5812:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b516) 00010000:00010000:1.0:1789997095.627647:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:1.0:1789997095.627697:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997095.627726:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.627739:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.627748:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997095.628141:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a0e0db0 reply state 000000007e543ec4 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997095.628151:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997095.628160:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:1.0:1789997095.628243:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37306:x1876946704347776:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 703us (1270us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789997095.628250:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 470 00010000:00010000:1.0:1789997095.635325:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.635343:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.635351:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.635357:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997095.635362:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.635369:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.635406:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789997095.635409:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997095.635415:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997095.635422:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b57f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997095.691866:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997096.424783:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967483 is committed 00000020:00000080:0.0:1789997096.459298:0:63436:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebb05c010 20000000:00000080:0.0:1789997096.459316:0:63436:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd792000 uarg=0000000000000000 00010000:00010000:0.0:1789997096.462626:0:63436:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997096.462649:0:63436:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997096.462817:0:63436:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997096.462839:0:63436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997096.462864:0:63436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b563 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997096.462873:0:63436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997096.462915:0:63436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b563 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997096.462929:0:63436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b563 expref: 18 pid: 5805 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997096.463192:0:63436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63436:1876946712863872:0@lo:104: 00000100:00100000:0.0:1789997096.463258:0:63436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997096.463322:0:63436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997096.463906:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712863872 00000100:00100000:1.0:1789997096.463916:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712863872 00000100:00100000:1.0:1789997096.464046:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789997096.464057:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:63436:x1876946712863872:12345-0@lo:104: 00010000:00010000:1.0:1789997096.464073:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997096.464144:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997096.464149:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:63436:x1876946712863872:12345-0@lo:104: Request processed in 95us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997096.464156:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00010000:00010000:2.0:1789997096.464204:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997096.464211:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.464231:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997096.464235:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.464242:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997096.464249:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997096.464254:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997096.464293:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.464299:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997096.464322:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.464329:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592b563 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b56a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.464463:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997096.464466:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997096.464468:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997096.464483:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712864000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997096.464524:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997096.464573:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712864000 00000100:00100000:2.0:1789997096.464578:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712864000 00010000:00010000:2.0:1789997096.464599:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b563 expref: 19 pid: 5805 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997096.464629:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789997096.464636:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712864000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997096.464647:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789997096.465165:0:63436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63436:1876946712863872:0@lo:104: 00010000:00010000:3.0:1789997096.465192:0:63436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465812:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b563 expref: 19 pid: 5805 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465830:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b563 expref: 19 pid: 5805 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465847:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592b56a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b563 expref: 19 pid: 5805 timeout: 1435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465863:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465873:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465891:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465898:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465905:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465912:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.465932:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997096.465937:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.466271:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.466295:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997096.466307:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997096.466491:0:63436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997096.466501:0:63436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997096.466508:0:63436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592b586 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997096.468581:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712864000:12345-0@lo:103:ldlm_bl.0 Request processed in 3935us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997096.468595:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789997096.476168:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712864000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997096.716845:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997097.246580:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997097.246621:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997097.246647:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997097.246692:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704348032 00000100:00100000:1.0:1789997097.246701:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704348032 00000100:00100000:1.0:1789997097.246759:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 922 00000100:00100000:1.0:1789997097.246771:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704348032:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997097.246887:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704348032:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 119us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997097.246896:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 922 00000100:00100000:1.0:1789997097.246920:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704347904 00000100:00100000:1.0:1789997097.246924:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704347904 00000100:00100000:1.0:1789997097.246947:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 830 00000100:00100000:1.0:1789997097.246954:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704347904:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997097.246980:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704347904:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997097.246986:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 830 00000100:00100000:1.0:1789997097.247023:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704348160 00000100:00100000:1.0:1789997097.247026:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704348160 00000100:00100000:1.0:1789997097.247053:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 498 00000100:00100000:1.0:1789997097.247059:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704348160:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997097.247084:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704348160:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997097.247090:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 498 00000100:00080000:1.0:1789997097.247106:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997097.247110:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997097.423847:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997097.423871:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712864128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997097.423957:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997097.424023:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712864128 00000100:00100000:3.0:1789997097.424031:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712864128 00000100:00100000:3.0:1789997097.424086:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1789997097.424095:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712864128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997097.424132:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997097.424178:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712864128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997097.424185:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00080000:3.0:1789997097.424205:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997097.424239:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712864128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997097.429052:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712864256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997097.429133:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997097.429235:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712864256 00000100:00100000:1.0:1789997097.429243:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712864256 00000100:00100000:1.0:1789997097.429302:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1789997097.429310:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712864256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997097.429345:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997097.438799:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712864256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9463us (9640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997097.438827:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1789997097.452561:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712864256:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997097.452991:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:1.0:1789997097.547791:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997097.547799:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997097.547804:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997097.547848:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997097.547860:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997097.547872:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997097.547898:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712864384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997097.547957:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997097.548026:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789997097.548158:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712864384 00000100:00100000:0.0:1789997097.548165:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712864384 00000100:00100000:0.0:1789997097.548216:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1789997097.548225:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712864384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997097.548238:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997097.548250:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b58d expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997097.548275:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b58d expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997097.548287:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b58d expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997097.548302:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997097.548337:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712864384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997097.548344:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1789997097.548398:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712864384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997097.548412:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997097.548421:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997097.548439:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997097.548444:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997097.548452:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997097.738906:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997098.773058:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997099.396878:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997099.397070:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704348288 00000100:00100000:3.0:1789997099.397081:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704348288 00000100:00100000:3.0:1789997099.397207:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 471 00000100:00100000:3.0:1789997099.397217:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704348288:12345-192.168.204.4@tcp:48:lfs.0 00000100:00080000:0.0:1789997099.397263:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997099.397338:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704348288:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 122us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997099.397346:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 471 00000100:00100000:1.0:1789997099.400173:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997099.400802:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704348416 00000100:00100000:3.0:1789997099.400811:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704348416 00000100:00100000:3.0:1789997099.401108:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 235 00000100:00100000:3.0:1789997099.401131:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876946704348416:12345-192.168.204.4@tcp:8:lfs.0 00010000:00080000:3.0:1789997099.401165:0:8169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1288 last 0 00000020:00000080:3.0:1789997099.401195:0:8169:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592b59b 00002000:00100000:3.0:1789997099.401207:0:8169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38fadac000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789997099.401231:0:8169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789997099.401642:0:8169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789997099.401707:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38fada8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789997099.401793:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7414c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704348416:12345-192.168.204.4@tcp:8:lfs.0 Request processed in 662us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997099.401801:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 235 00000100:00100000:0.0:1789997099.404134:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997099.404367:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704348544 00000100:00100000:1.0:1789997099.404379:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704348544 00000100:00100000:1.0:1789997099.404490:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 236 00000100:00100000:1.0:1789997099.404501:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37391:x1876946704348544:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997099.405257:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37391:x1876946704348544:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 755us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997099.405266:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 236 00000100:00080000:0.0:1789997099.406151:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997099.410517:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997099.410621:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704348672 00000100:00100000:0.0:1789997099.410632:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704348672 00000100:00100000:0.0:1789997099.410779:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 237 00000100:00100000:0.0:1789997099.410791:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704348672:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997099.411212:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704348672:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 422us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997099.411232:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 237 00000100:00080000:3.0:1789997099.413355:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997099.426717:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997099.426916:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704348800 00000100:00100000:1.0:1789997099.426927:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704348800 00000100:00100000:1.0:1789997099.426991:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 472 00000100:00100000:1.0:1789997099.427017:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704348800:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997099.427509:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704348800:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 494us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997099.427518:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 472 00000100:00100000:2.0:1789997099.436046:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997099.436781:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704348928 00000100:00100000:1.0:1789997099.436794:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704348928 00000100:00100000:1.0:1789997099.436864:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 473 00000100:00100000:1.0:1789997099.436876:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704348928:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997099.437110:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704348928:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 234us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997099.437119:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 473 00000100:00100000:2.0:1789997099.440772:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997099.440910:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704349056 00000100:00100000:3.0:1789997099.440922:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704349056 00000100:00100000:3.0:1789997099.441125:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 238 00000100:00100000:3.0:1789997099.441137:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37391:x1876946704349056:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997099.443470:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37391:x1876946704349056:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 2328us (2806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997099.443482:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 238 00000100:00100000:2.0:1789997099.456848:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997099.456995:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704349184 00000100:00100000:0.0:1789997099.457005:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704349184 00000100:00100000:0.0:1789997099.457067:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 239 00000100:00100000:0.0:1789997099.457277:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704349184:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997099.457645:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704349184:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 568us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997099.457698:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 239 00000100:00100000:2.0:1789997099.460593:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997099.460700:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704349312 00000100:00100000:1.0:1789997099.460710:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704349312 00000100:00100000:1.0:1789997099.460777:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 474 00000100:00100000:1.0:1789997099.460788:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704349312:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997099.461442:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37391:x1876946704349312:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 653us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997099.461450:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 474 00000100:00100000:2.0:1789997099.547011:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997099.547152:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704349440 00000100:00100000:1.0:1789997099.547164:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704349440 00000100:00100000:1.0:1789997099.547224:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 475 00000100:00100000:1.0:1789997099.547235:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37395:x1876946704349440:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997099.547255:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997099.547278:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b5a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8c1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547364:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547381:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547395:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547408:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547415:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547422:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547776:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b5b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547786:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547794:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997099.547817:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:1.0:1789997099.547821:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997099.547840:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547862:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547870:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547876:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547882:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997099.547887:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547894:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547907:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997099.547910:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997099.547915:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547921:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b5a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547932:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547938:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547944:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.547955:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997099.547958:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.548034:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.548044:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38e062d500) 00010000:00010000:1.0:1789997099.548046:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997099.548050:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.548056:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b5b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.548089:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b5a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8c1 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.548106:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8c1 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.548113:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997099.548116:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997099.548118:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997099.548188:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37395:x1876946704349440:12345-192.168.204.4@tcp:101:dd.0 Request processed in 954us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997099.548195:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 475 00000100:00100000:2.0:1789997099.553216:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997099.555101:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704349696 00000100:00100000:1.0:1789997099.555135:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704349696 00000100:00100000:1.0:1789997099.555375:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 476 00000100:00100000:1.0:1789997099.555387:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37395:x1876946704349696:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997099.555410:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997099.555432:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b5be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8c8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.555760:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.555775:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.555787:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.555802:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.555811:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.555817:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997099.557939:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:1.0:1789997099.559554:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b5d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559576:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559599:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559641:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559649:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559676:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559682:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997099.559687:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559694:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559706:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997099.559709:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997099.559714:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559721:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592b5c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997099.559734:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afa4d918 reply state 00000000c72a5a40 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997099.559754:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997099.559800:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b5be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8c8 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559816:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8c8 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.559824:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:1.0:1789997099.559827:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997099.559829:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997099.559985:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37395:x1876946704349696:12345-192.168.204.4@tcp:101:dd.0 Request processed in 4598us (6779us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789997099.559993:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 476 00000100:00100000:2.0:1789997099.577074:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:3.0:1789997099.577188:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997099.577201:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997099.577210:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997099.577234:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997099.577239:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997099.577247:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997099.577262:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38e062d600) 00010000:00010000:3.0:1789997099.577264:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997099.577269:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997099.577276:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b5cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997099.583133:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704349824 00000100:00100000:1.0:1789997099.583148:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704349824 00000100:00100000:1.0:1789997099.583256:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 240 00000100:00100000:1.0:1789997099.583268:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37395:x1876946704349824:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997099.583286:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997099.583308:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8cf expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997099.583336:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789997099.583372:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=1288s v=(0 0) 00010000:00010000:1.0:1789997099.583377:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997099.583388:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.583408:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997099.583445:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997099.583530:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37395:x1876946704349824:12345-192.168.204.4@tcp:101:dd.0 Request processed in 265us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997099.583538:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 240 00000100:00100000:2.0:1789997099.602762:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997099.602874:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704349952 00000100:00100000:0.0:1789997099.602885:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704349952 00002000:00100000:0.0:1789997099.602937:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->1048575) req@ffff8a38fadf3480 x1876946704349952/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:75/0 lens 488/0 e 0 to 0 dl 1789997110 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789997099.602950:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fadf3480 with x1876946704349952 ext(0->1048575) 00002000:00010000:0.0:1789997099.602956:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fadf3480 00000100:00100000:0.0:1789997099.602991:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:0.0:1789997099.603001:0:6663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704349952:12345-192.168.204.4@tcp:4:dd.0 00000001:00100000:0.0:1789997099.670728:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:2.0:1789997099.741682:0:6663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704349952:12345-192.168.204.4@tcp:4:dd.0 Request processed in 138652us (138912us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789997099.741713:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00002000:00100000:2.0:1789997099.741729:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xf:0x0] (0->1048575) req@ffff8a38fadf3480 x1876946704349952/t4294967325(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:75/0 lens 488/448 e 0 to 0 dl 1789997110 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997099.741749:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fadf3480 with x1876946704349952 ext(0->1048575) 00002000:00010000:2.0:1789997099.741756:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fadf3480 00000001:00080000:0.0:1789997099.742098:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:0.0:1789997099.756300:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997099.756428:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704350080 00000100:00100000:3.0:1789997099.756440:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704350080 00000100:00100000:3.0:1789997099.756510:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 477 00000100:00100000:3.0:1789997099.756522:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:37395:x1876946704350080:12345-192.168.204.4@tcp:44:dd.0 00010000:00010000:2.0:1789997099.787844:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997099.834521:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967484 is committed 00000100:00100000:3.0:1789997099.834879:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37395:x1876946704350080:12345-192.168.204.4@tcp:44:dd.0 Request processed in 78263us (78493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997099.834891:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 477 00000100:00100000:3.0:1789997099.845444:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997099.845960:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704350208 00000100:00100000:1.0:1789997099.845973:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704350208 00000100:00100000:1.0:1789997099.846044:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 241 00000100:00100000:1.0:1789997099.846054:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704350208:12345-192.168.204.4@tcp:16:dd.0 00000100:00100000:1.0:1789997099.846398:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704350208:12345-192.168.204.4@tcp:16:dd.0 Request processed in 344us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997099.846407:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 241 00000100:00100000:0.0:1789997099.850384:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997099.850494:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704350464 00000100:00100000:1.0:1789997099.850504:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704350464 00000100:00100000:1.0:1789997099.850563:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:1.0:1789997099.850573:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37395:x1876946704350464:12345-192.168.204.4@tcp:35:dd.0 00000100:00100000:1.0:1789997099.854060:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:37395:x1876946704350464:12345-192.168.204.4@tcp:35:dd.0 Request processed in 3476us (3672us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789997099.854075:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 53 00000100:00100000:3.0:1789997100.493255:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712864512:0@lo:400:kworker.0 00000100:00100000:2.0:1789997100.493293:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712864768:0@lo:400:kworker.0 00000100:00100000:3.0:1789997100.493348:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997100.494246:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712864640:0@lo:400:kworker.0 00000100:00100000:2.0:1789997100.496156:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997100.496209:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997100.496216:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712865024:0@lo:400:kworker.0 00000100:00100000:2.0:1789997100.496221:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712864896:0@lo:400:kworker.0 00000100:00100000:2.0:1789997100.496795:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997100.496850:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712864896 00000100:00100000:2.0:1789997100.496858:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712864896 00000100:00100000:2.0:1789997100.496934:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1789997100.496944:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712864896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997100.497003:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712864896:12345-0@lo:400:kworker.0 Request processed in 60us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997100.497011:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00080000:2.0:1789997100.497034:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997100.497083:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712864896:0@lo:400:kworker.0 00000100:00100000:3.0:1789997100.497411:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997100.497421:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997100.497505:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712865152:0@lo:400:kworker.0 00000100:00100000:1.0:1789997100.497537:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997100.499761:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712864512 00000100:00100000:1.0:1789997100.499791:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712864512 00000100:00100000:1.0:1789997100.499842:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1789997100.499851:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712864512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997100.499926:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712864512:12345-0@lo:400:kworker.0 Request processed in 77us (6579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997100.499933:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1789997100.500041:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712864768 00000100:00100000:2.0:1789997100.500046:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712864768 00000100:00100000:2.0:1789997100.500094:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712864640 00000100:00100000:2.0:1789997100.500097:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712864640 00000100:00100000:2.0:1789997100.500212:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712865152 00000100:00100000:2.0:1789997100.500217:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712865152 00000100:00100000:2.0:1789997100.500251:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1789997100.500258:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712864768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997100.500305:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712864768:12345-0@lo:400:kworker.0 Request processed in 47us (4155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997100.500311:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:2.0:1789997100.500324:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1789997100.500330:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712864640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997100.500363:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712864640:12345-0@lo:400:kworker.0 Request processed in 33us (2943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997100.500368:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1789997100.500381:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1789997100.500387:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712865152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997100.500412:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712865152:12345-0@lo:400:kworker.0 Request processed in 27us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997100.500418:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:1.0:1789997100.500686:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712865024 00000100:00100000:1.0:1789997100.500691:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712865024 00000100:00100000:1.0:1789997100.500734:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1789997100.500742:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712865024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997100.500776:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712865024:12345-0@lo:400:kworker.0 Request processed in 36us (3367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997100.500782:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1789997100.500837:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712865024:0@lo:400:kworker.0 00000100:00100000:1.0:1789997100.500848:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712864512:0@lo:400:kworker.0 00000100:00100000:1.0:1789997100.500881:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712864640:0@lo:400:kworker.0 00000100:00100000:1.0:1789997100.500890:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712865152:0@lo:400:kworker.0 00000100:00080000:3.0:1789997100.500980:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997100.500985:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997100.502471:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712864768:0@lo:400:kworker.0 00010000:00010000:1.0:1789997100.814195:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997101.157813:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967485 is committed 00010000:00010000:3.0:1789997101.834862:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997102.359733:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997102.359978:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704350592 00000100:00100000:0.0:1789997102.359993:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704350592 00000100:00100000:0.0:1789997102.360060:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 833 00000100:00100000:0.0:1789997102.360070:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704350592:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997102.360155:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704350592:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997102.360162:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 833 00000100:00100000:3.0:1789997102.372079:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997102.372130:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997102.372172:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997102.372202:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704350976 00000100:00100000:3.0:1789997102.372214:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704350976 00000100:00100000:3.0:1789997102.372270:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704350848 00000100:00100000:3.0:1789997102.372273:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704350848 00000100:00100000:2.0:1789997102.372307:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704350720 00000100:00100000:3.0:1789997102.372313:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 501 00000100:00100000:2.0:1789997102.372314:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704350720 00000100:00100000:3.0:1789997102.372328:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704350976:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997102.372359:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 926 00000100:00100000:2.0:1789997102.372369:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704350720:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997102.372404:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704350976:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997102.372413:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 501 00000100:00100000:2.0:1789997102.372418:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704350720:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997102.372427:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 926 00000100:00100000:3.0:1789997102.372437:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 502 00000100:00100000:3.0:1789997102.372448:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704350848:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997102.372479:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704350848:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997102.372487:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 502 00000100:00080000:3.0:1789997102.372509:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997102.372513:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997102.372516:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997102.539339:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712865280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997102.539414:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997102.539499:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712865280 00000100:00100000:1.0:1789997102.539507:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712865280 00000100:00100000:1.0:1789997102.539563:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1789997102.539571:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712865280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997102.539604:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997102.539695:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712865280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997102.539702:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00080000:1.0:1789997102.539723:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997102.539761:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712865280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997102.548467:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712865408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997102.548535:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997102.548830:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712865408 00000100:00100000:3.0:1789997102.548839:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712865408 00000100:00080000:2.0:1789997102.548977:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997102.548998:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:3.0:1789997102.549011:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712865408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997102.549061:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997102.549229:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712865408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 221us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997102.549237:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:2.0:1789997102.553643:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712865408:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789997102.585131:0:63681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1291277474208ns, next at 1235088453406ns, rc = 0 00000004:00080000:1.0:1789997102.585328:0:63681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1291277673418ns, next at 1270969555105ns, rc = 0 00000004:00080000:3.0:1789997102.591017:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 42 committed 00000004:00080000:3.0:1789997102.591043:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 40 committed 00010000:00010000:2.0:1789997102.859182:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997103.886579:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997104.043827:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997104.043931:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704351104 00000100:00100000:1.0:1789997104.043942:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704351104 00000100:00100000:1.0:1789997104.044015:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 478 00000100:00100000:1.0:1789997104.044027:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37587:x1876946704351104:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997104.044127:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37587:x1876946704351104:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997104.044134:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 478 00000100:00080000:2.0:1789997104.044197:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997104.050290:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997104.051494:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704351232 00000100:00100000:1.0:1789997104.051507:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704351232 00000100:00100000:1.0:1789997104.051588:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 242 00000100:00100000:1.0:1789997104.051613:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37587:x1876946704351232:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:3.0:1789997104.051704:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997104.052017:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37587:x1876946704351232:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 419us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997104.052026:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 242 00000100:00100000:0.0:1789997104.055638:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997104.057890:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704351360 00000100:00100000:1.0:1789997104.057906:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704351360 00000100:00100000:3.0:1789997104.058297:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 243 00000100:00100000:3.0:1789997104.058311:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37587:x1876946704351360:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:2.0:1789997104.058524:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997104.060185:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37587:x1876946704351360:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 428us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997104.060200:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 243 00000100:00100000:3.0:1789997104.061070:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997104.061333:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704351488 00000100:00100000:1.0:1789997104.061344:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704351488 00000100:00100000:1.0:1789997104.061390:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 479 00000100:00100000:1.0:1789997104.061400:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37587:x1876946704351488:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997104.061852:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37587:x1876946704351488:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 452us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997104.061861:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 479 00000100:00100000:2.0:1789997104.069351:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997104.069405:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704351616 00000100:00100000:3.0:1789997104.069416:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704351616 00000100:00100000:3.0:1789997104.069480:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 480 00000100:00100000:3.0:1789997104.069491:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37587:x1876946704351616:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997104.069593:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37587:x1876946704351616:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997104.069600:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 480 00000100:00100000:2.0:1789997104.076336:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997104.076429:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704351744 00000100:00100000:3.0:1789997104.076440:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704351744 00000100:00100000:3.0:1789997104.076499:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 244 00000100:00100000:3.0:1789997104.076509:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37587:x1876946704351744:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997104.076976:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37587:x1876946704351744:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 466us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997104.076991:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 244 00000100:00100000:3.0:1789997104.080371:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997104.080460:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704351872 00000100:00100000:1.0:1789997104.080470:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704351872 00000100:00100000:1.0:1789997104.080522:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 245 00000100:00100000:1.0:1789997104.080539:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37587:x1876946704351872:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997104.080889:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37587:x1876946704351872:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 350us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997104.080896:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 245 00000100:00100000:3.0:1789997104.083098:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997104.084039:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704352000 00000100:00100000:1.0:1789997104.084051:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704352000 00000100:00100000:1.0:1789997104.084110:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 481 00000100:00100000:1.0:1789997104.084121:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37587:x1876946704352000:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997104.084585:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37587:x1876946704352000:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 464us (1495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997104.084593:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 481 00000100:00100000:0.0:1789997104.172310:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997104.172349:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704352256 00000100:00100000:0.0:1789997104.172358:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704352256 00000100:00100000:0.0:1789997104.172407:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 482 00000100:00100000:0.0:1789997104.172417:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37591:x1876946704352256:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789997104.172467:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997104.172492:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b5d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8c8 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.172508:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:0.0:1789997104.172518:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997104.172536:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.172549:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.172559:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.172573:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.172580:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.172592:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.174446:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.174464:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.174477:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789997104.179587:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00000004:00080000:0.0:1789997104.179605:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1292871950613ns, next at 1293871946081ns, rc = 0 00010000:00010000:0.0:1789997104.179764:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.179793:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.179806:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.179815:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.179821:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.179827:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181438:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997104.181472:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181481:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181488:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181494:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997104.181498:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181508:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181522:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997104.181525:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997104.181530:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181536:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592b5f6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181566:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181573:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181583:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181588:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997104.181590:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181596:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181602:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:0.0:1789997104.181604:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997104.181607:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997104.181612:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b5e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997104.181621:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030352843 reply state 00000000d1a005e5 transno 4294967486 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997104.181629:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997104.181745:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:37591:x1876946704352256:12345-192.168.204.4@tcp:36:rm.0 Request processed in 9326us (9496us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789997104.181752:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 482 00010000:00010000:3.0:1789997104.183374:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997104.183387:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997104.183397:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997104.183402:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997104.183412:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997104.183426:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:3.0:1789997104.183429:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997104.183433:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997104.183439:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b5fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997104.183462:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997104.183464:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997104.183466:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997104.192713:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997104.192732:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997104.192741:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997104.192761:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997104.192766:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997104.192774:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997104.192792:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38c28e9300) 00010000:00010000:1.0:1789997104.192796:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997104.192802:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997104.192809:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b5ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997104.906961:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997105.611325:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712865536:0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.611404:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997105.611467:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712866048:0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.611495:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997105.611535:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789997105.611543:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712865664:0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.611569:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997105.611586:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712866176:0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.611606:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997105.611646:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712866048 00000100:00100000:1.0:1789997105.611683:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712866048 00000100:00100000:1.0:1789997105.611755:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1789997105.611764:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712866048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.611820:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712866048:12345-0@lo:400:kworker.0 Request processed in 57us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997105.611827:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1789997105.611860:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712865664 00000100:00100000:1.0:1789997105.611864:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712865664 00000100:00100000:1.0:1789997105.611890:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712866176 00000100:00100000:1.0:1789997105.611893:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712866176 00000100:00100000:1.0:1789997105.611912:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1789997105.611918:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712865664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.611949:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712865664:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997105.611955:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1789997105.611966:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1789997105.611971:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712866176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.611996:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712866176:12345-0@lo:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997105.612000:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1789997105.612037:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712865664:0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.612047:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712866176:0@lo:400:kworker.0 00000100:00100000:1.0:1789997105.612054:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712866048:0@lo:400:kworker.0 00000100:00100000:3.0:1789997105.612378:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712865536 00000100:00100000:3.0:1789997105.612384:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712865536 00000100:00100000:3.0:1789997105.612424:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1789997105.612431:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712865536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997105.612474:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712865536:12345-0@lo:400:kworker.0 Request processed in 44us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997105.612489:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1789997105.612542:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712865536:0@lo:400:kworker.0 00000100:00100000:2.0:1789997105.612699:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712865920:0@lo:400:kworker.0 00000100:00100000:2.0:1789997105.612734:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997105.612756:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997105.612762:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712865792:0@lo:400:kworker.0 00000100:00100000:2.0:1789997105.612783:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997105.612807:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712865792 00000100:00100000:2.0:1789997105.612810:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712865792 00000100:00100000:2.0:1789997105.612837:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1789997105.612844:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712865792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997105.612891:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712865792:12345-0@lo:400:kworker.0 Request processed in 47us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997105.612898:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00080000:2.0:1789997105.612914:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997105.612919:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997105.612945:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712865792:0@lo:400:kworker.0 00000100:00100000:3.0:1789997105.613206:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712865920 00000100:00100000:3.0:1789997105.613211:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712865920 00000100:00100000:3.0:1789997105.613258:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1789997105.613274:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712865920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997105.613310:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712865920:12345-0@lo:400:kworker.0 Request processed in 46us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997105.613316:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00080000:2.0:1789997105.613987:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997105.614028:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712865920:0@lo:400:kworker.0 00010000:00010000:2.0:1789997105.930882:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997106.421466:0:63826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1295113808762ns, next at 1293871946081ns, rc = 0 00000004:00080000:3.0:1789997106.505811:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 42 committed 00000001:00080000:3.0:1789997106.505851:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967486 is committed 00000004:00080000:3.0:1789997106.505856:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 41 committed 00000100:00100000:1.0:1789997106.506196:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997106.508025:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712866304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789997106.508106:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997106.508419:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712866304 00000100:00100000:2.0:1789997106.508429:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712866304 00000100:00100000:2.0:1789997106.508492:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789997106.508502:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712866304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789997106.508531:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:15 count 1 00010000:00010000:2.0:1789997106.508556:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.508578:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.508588:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xf:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1789997106.508593:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997106.508597:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.508647:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.508681:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 5 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997106.508693:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1876946712866432:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997106.508752:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e14f8840 going to sleep for 11 seconds 00000100:00100000:1.0:1789997106.512629:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997106.512752:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704352384 00000100:00100000:3.0:1789997106.512762:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704352384 00010000:00010000:3.0:1789997106.512812:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 6 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997106.512856:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 288 00000100:00100000:3.0:1789997106.512868:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704352384:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997106.512882:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997106.512888:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 6 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.512901:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 6 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.512955:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997106.512960:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997106.512966:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.512977:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.513005:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997106.513052:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704352384:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 187us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997106.513059:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 288 00000100:00080000:0.0:1789997106.513363:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997106.514909:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592b5e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8cf expref: 5 pid: 6659 timeout: 1395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997106.514929:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1876946712866432:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997106.515002:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.515014:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.515021:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.515031:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.515038:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997106.515063:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997106.515387:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997106.515395:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.515412:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997106.515416:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.515425:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.515452:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.515471:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592b604 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997106.515492:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997106.515494:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997106.515496:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997106.521694:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712866304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13187us (13581us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789997106.521707:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000004:00080000:1.0:1789997106.529784:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fab10000/2, rc 0, transno 4294967326 00000100:00100000:1.0:1789997106.529804:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712866304:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789997106.530127:0:63826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1295222472170ns, next at 1270969555105ns, rc = 0 00000004:00080000:2.0:1789997106.533580:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 43 committed 00010000:00010000:1.0:1789997106.961438:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997107.486257:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997107.486315:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997107.486350:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997107.486370:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704352512 00000100:00100000:3.0:1789997107.486382:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704352512 00000100:00100000:0.0:1789997107.486386:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997107.486428:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704352768 00000100:00100000:0.0:1789997107.486434:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704352768 00000100:00100000:3.0:1789997107.486439:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 835 00000100:00100000:3.0:1789997107.486450:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704352512:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997107.486472:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704352896 00000100:00100000:0.0:1789997107.486476:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704352896 00000100:00100000:3.0:1789997107.486529:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704352512:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997107.486530:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 505 00000100:00100000:0.0:1789997107.486543:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704352768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997107.486544:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 835 00000100:00100000:0.0:1789997107.486602:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704352768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 61us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997107.486604:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 506 00000100:00100000:0.0:1789997107.486615:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 505 00000100:00100000:3.0:1789997107.486620:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704352896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:0.0:1789997107.486639:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997107.486676:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704352896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997107.486684:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 506 00000100:00100000:1.0:1789997107.486938:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704352640 00000100:00100000:1.0:1789997107.486944:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704352640 00000100:00100000:1.0:1789997107.486997:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 930 00000100:00100000:1.0:1789997107.487004:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704352640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997107.487041:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704352640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997107.487048:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 930 00000100:00080000:0.0:1789997107.488053:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997107.659610:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997107.659633:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712866560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997107.659714:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997107.659781:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712866560 00000100:00100000:2.0:1789997107.659790:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712866560 00000100:00100000:2.0:1789997107.659846:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1789997107.659854:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712866560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997107.659888:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789997107.659933:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712866560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997107.659951:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00080000:2.0:1789997107.659972:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997107.660019:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712866560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997107.661384:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997107.661402:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712866688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997107.661462:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997107.661506:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712866688 00000100:00100000:1.0:1789997107.661513:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712866688 00000100:00080000:2.0:1789997107.661620:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997107.661707:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1789997107.661718:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712866688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997107.661751:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997107.661795:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712866688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997107.661802:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789997107.662010:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712866688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997107.978902:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997109.003900:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997109.246286:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00010000:00010000:1.0:1789997110.027029:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997110.732090:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712866816:0@lo:400:kworker.0 00000100:00100000:3.0:1789997110.732161:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997110.732224:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712867328:0@lo:400:kworker.0 00000100:00100000:3.0:1789997110.732279:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997110.732307:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997110.732313:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712867200:0@lo:400:kworker.0 00000100:00100000:3.0:1789997110.732333:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997110.732364:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712867328 00000100:00100000:3.0:1789997110.732372:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712867328 00000100:00100000:3.0:1789997110.732419:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712867200 00000100:00100000:3.0:1789997110.732422:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712867200 00000100:00100000:3.0:1789997110.732442:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789997110.732452:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712867328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997110.732500:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712867328:12345-0@lo:400:kworker.0 Request processed in 49us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997110.732507:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789997110.732534:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1789997110.732540:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712867200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997110.732566:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712867200:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997110.732571:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1789997110.732623:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:3.0:1789997110.732628:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fab10000, transno 4294967326 00000100:00100000:3.0:1789997110.732640:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712867200:0@lo:400:kworker.0 00000100:00100000:3.0:1789997110.732650:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712867328:0@lo:400:kworker.0 00000100:00100000:0.0:1789997110.732850:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712866816 00000100:00100000:0.0:1789997110.732855:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712866816 00000100:00100000:0.0:1789997110.732891:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1789997110.732898:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712866816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997110.732935:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712866816:12345-0@lo:400:kworker.0 Request processed in 38us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997110.732940:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:1.0:1789997110.733488:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712867072:0@lo:400:kworker.0 00000100:00100000:1.0:1789997110.733532:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997110.733564:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789997110.733570:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712866944:0@lo:400:kworker.0 00000100:00100000:1.0:1789997110.733598:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997110.733626:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712867456:0@lo:400:kworker.0 00000100:00100000:1.0:1789997110.733645:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997110.733696:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712867072 00000100:00100000:1.0:1789997110.733700:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712867072 00000100:00100000:1.0:1789997110.733729:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712866944 00000100:00100000:1.0:1789997110.733731:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712866944 00000100:00100000:1.0:1789997110.733759:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712867456 00000100:00100000:1.0:1789997110.733761:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712867456 00000100:00100000:1.0:1789997110.733791:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1789997110.733798:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712867072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997110.733833:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712867072:12345-0@lo:400:kworker.0 Request processed in 36us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997110.733840:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1789997110.733852:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1789997110.733857:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712866944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997110.733879:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712866944:12345-0@lo:400:kworker.0 Request processed in 22us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997110.733884:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1789997110.733894:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1789997110.733899:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712867456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997110.733920:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712867456:12345-0@lo:400:kworker.0 Request processed in 21us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997110.733924:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:1.0:1789997110.733960:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712866944:0@lo:400:kworker.0 00000100:00100000:1.0:1789997110.733969:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712867456:0@lo:400:kworker.0 00000100:00100000:1.0:1789997110.733976:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712867072:0@lo:400:kworker.0 00000100:00080000:2.0:1789997110.734277:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997110.734283:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997110.734286:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997110.734415:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712866816:0@lo:400:kworker.0 00010000:00010000:2.0:1789997111.054149:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997112.076754:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997112.601541:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997112.601599:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997112.601722:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997112.601752:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997112.601781:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704353280 00000100:00100000:0.0:1789997112.601782:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704353408 00000100:00100000:3.0:1789997112.601793:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704353280 00000100:00100000:0.0:1789997112.601793:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704353408 00000100:00100000:3.0:1789997112.601867:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 509 00000100:00100000:3.0:1789997112.601878:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704353280:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997112.601923:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704353024 00000100:00100000:2.0:1789997112.601929:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704353024 00000100:00100000:3.0:1789997112.601952:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704353280:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997112.601961:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 509 00000100:00100000:2.0:1789997112.601977:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 837 00000100:00100000:2.0:1789997112.601988:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704353024:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997112.602019:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704353024:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997112.602025:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 837 00000100:00100000:1.0:1789997112.602106:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704353152 00000100:00100000:1.0:1789997112.602111:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704353152 00000100:00100000:0.0:1789997112.605378:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 510 00000100:00100000:0.0:1789997112.605394:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704353408:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997112.605473:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704353408:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997112.605495:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 510 00000100:00080000:3.0:1789997112.614374:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997112.614391:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997112.614394:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997112.623058:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 934 00000100:00100000:1.0:1789997112.623951:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704353152:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997112.624069:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704353152:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 997us (22536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997112.624078:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 934 00000100:00100000:2.0:1789997112.778879:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997112.778913:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712867584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997112.778985:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997112.779130:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712867584 00000100:00100000:3.0:1789997112.779138:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712867584 00000100:00100000:3.0:1789997112.779213:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1789997112.779229:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712867584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997112.779268:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997112.779324:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712867584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997112.779331:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1789997112.779390:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712867584:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997112.779552:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997112.780739:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712867712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997112.780794:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997112.781273:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712867712 00000100:00100000:2.0:1789997112.781280:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712867712 00000100:00100000:2.0:1789997112.781347:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789997112.781356:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712867712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997112.781389:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789997112.781458:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997112.789722:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712867712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8356us (8916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997112.789737:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789997112.790368:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712867712:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997113.100706:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997113.110433:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997113.110516:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704353536 00000100:00100000:1.0:1789997113.110529:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704353536 00000100:00100000:1.0:1789997113.110600:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 483 00000100:00100000:1.0:1789997113.110610:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704353536:12345-192.168.204.4@tcp:17:kworker.0 00000100:00100000:1.0:1789997113.110763:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704353536:12345-192.168.204.4@tcp:17:kworker.0 Request processed in 154us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997113.110772:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 483 00010000:00010000:2.0:1789997114.123486:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997115.147168:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997115.851189:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712867840:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.851263:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997115.851326:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712868352:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.851352:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997115.851414:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997115.851444:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712868224:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.851468:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997115.851507:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712867968:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.851531:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997115.851548:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712868480:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.851566:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997115.851584:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997115.851590:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712868096:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.851609:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997115.851642:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712868352 00000100:00100000:3.0:1789997115.851650:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712868352 00000100:00100000:3.0:1789997115.851724:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712868224 00000100:00100000:3.0:1789997115.851728:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712868224 00000100:00100000:3.0:1789997115.851755:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1789997115.851764:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712868352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.851816:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712868352:12345-0@lo:400:kworker.0 Request processed in 53us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997115.851823:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1789997115.851839:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1789997115.851846:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712868224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.851873:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712868224:12345-0@lo:400:kworker.0 Request processed in 28us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997115.851879:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1789997115.851900:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712867968 00000100:00100000:3.0:1789997115.851903:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712867968 00000100:00100000:3.0:1789997115.851924:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712868480 00000100:00100000:3.0:1789997115.851935:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712868480 00000100:00100000:3.0:1789997115.851954:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712868096 00000100:00100000:3.0:1789997115.851956:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712868096 00000100:00100000:3.0:1789997115.851977:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1789997115.851983:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712867968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.852019:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712867968:12345-0@lo:400:kworker.0 Request processed in 36us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997115.852025:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1789997115.852037:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:3.0:1789997115.852042:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712868480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.852068:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712868480:12345-0@lo:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997115.852072:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:3.0:1789997115.852082:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1789997115.852087:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712868096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.852111:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712868096:12345-0@lo:400:kworker.0 Request processed in 24us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997115.852116:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1789997115.852156:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712868096:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.852166:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712867968:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.852174:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712868480:0@lo:400:kworker.0 00000100:00080000:3.0:1789997115.852194:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997115.852199:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997115.852201:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997115.852217:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712868224:0@lo:400:kworker.0 00000100:00100000:3.0:1789997115.852239:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712868352:0@lo:400:kworker.0 00000100:00100000:1.0:1789997115.852678:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712867840 00000100:00100000:1.0:1789997115.852684:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712867840 00000100:00100000:1.0:1789997115.852724:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1789997115.852731:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712867840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997115.852790:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712867840:12345-0@lo:400:kworker.0 Request processed in 60us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997115.852797:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:2.0:1789997115.852923:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712867840:0@lo:400:kworker.0 00010000:00010000:1.0:1789997116.174540:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997117.195059:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997117.723262:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997117.723310:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997117.723412:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997117.723451:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997117.723482:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704353920 00000100:00100000:2.0:1789997117.723492:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704353920 00000100:00100000:2.0:1789997117.723549:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704354048 00000100:00100000:2.0:1789997117.723552:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704354048 00000100:00100000:2.0:1789997117.723573:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 513 00000100:00100000:2.0:1789997117.723584:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704353920:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997117.723690:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704353920:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 108us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997117.723698:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 513 00000100:00100000:2.0:1789997117.723715:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 514 00000100:00100000:2.0:1789997117.723722:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704354048:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997117.724481:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704354048:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 758us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997117.724490:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 514 00000100:00100000:3.0:1789997117.724568:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704353664 00000100:00100000:3.0:1789997117.724573:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704353664 00000100:00100000:3.0:1789997117.724623:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 839 00000100:00100000:3.0:1789997117.724631:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704353664:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997117.724698:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704353664:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 68us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997117.724705:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 839 00000100:00080000:3.0:1789997117.724731:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997117.724736:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997117.734926:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704353792 00000100:00100000:0.0:1789997117.734944:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704353792 00000100:00100000:0.0:1789997117.735038:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 938 00000100:00100000:0.0:1789997117.735049:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704353792:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997117.735149:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704353792:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 101us (11837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997117.735157:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 938 00000100:00080000:3.0:1789997117.735337:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997117.898950:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712868608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997117.899026:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997117.899204:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712868736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997117.899236:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997117.899332:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712868608 00000100:00100000:1.0:1789997117.899341:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712868608 00000100:00100000:1.0:1789997117.899417:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712868736 00000100:00100000:1.0:1789997117.899421:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712868736 00000100:00100000:1.0:1789997117.899441:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1789997117.899449:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712868608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997117.899484:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997117.899539:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712868608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997117.899546:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1789997117.899562:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789997117.899569:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712868736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997117.899588:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997117.899624:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712868736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997117.899630:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789997117.899704:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712868736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997117.899737:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712868608:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997117.899836:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997117.899841:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997118.220815:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997119.242923:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997120.268509:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997120.971259:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712868864:0@lo:400:kworker.0 00000100:00100000:2.0:1789997120.971365:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997120.971434:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712869376:0@lo:400:kworker.0 00000100:00100000:2.0:1789997120.971460:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997120.971484:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997120.971490:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712869248:0@lo:400:kworker.0 00000100:00100000:2.0:1789997120.971524:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997120.971566:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712869376 00000100:00100000:2.0:1789997120.971575:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712869376 00000100:00100000:2.0:1789997120.971622:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712869248 00000100:00100000:2.0:1789997120.971626:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712869248 00000100:00100000:2.0:1789997120.971646:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1789997120.971679:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712869376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997120.971729:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712869376:12345-0@lo:400:kworker.0 Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997120.971737:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1789997120.971753:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1789997120.971772:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712869248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997120.971802:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712869248:12345-0@lo:400:kworker.0 Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997120.971808:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00080000:2.0:1789997120.971825:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997120.971828:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997120.971856:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712869248:0@lo:400:kworker.0 00000100:00100000:2.0:1789997120.971866:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712869376:0@lo:400:kworker.0 00000100:00100000:0.0:1789997120.971936:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712868864 00000100:00100000:0.0:1789997120.971940:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712868864 00000100:00100000:0.0:1789997120.971979:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1789997120.971986:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712868864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997120.972024:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712868864:12345-0@lo:400:kworker.0 Request processed in 39us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997120.972030:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1789997120.972057:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712868864:0@lo:400:kworker.0 00000100:00100000:3.0:1789997120.972165:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712868992:0@lo:400:kworker.0 00000100:00100000:3.0:1789997120.972194:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997120.972220:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712869504:0@lo:400:kworker.0 00000100:00100000:3.0:1789997120.972238:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997120.972252:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997120.972257:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712869120:0@lo:400:kworker.0 00000100:00100000:3.0:1789997120.972272:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997120.972342:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712868992 00000100:00100000:0.0:1789997120.972346:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712868992 00000100:00100000:0.0:1789997120.972374:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712869504 00000100:00100000:0.0:1789997120.972377:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712869504 00000100:00100000:0.0:1789997120.972395:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712869120 00000100:00100000:0.0:1789997120.972397:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712869120 00000100:00100000:0.0:1789997120.972413:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1789997120.972418:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712868992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997120.972448:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712868992:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997120.972454:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:0.0:1789997120.972463:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:0.0:1789997120.972468:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712869504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997120.972487:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712869504:12345-0@lo:400:kworker.0 Request processed in 19us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997120.972492:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00100000:0.0:1789997120.972500:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1789997120.972504:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712869120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997120.972522:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712869120:12345-0@lo:400:kworker.0 Request processed in 18us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997120.972527:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00080000:0.0:1789997120.972543:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997120.972732:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712869120:0@lo:400:kworker.0 00000100:00100000:3.0:1789997120.972742:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712868992:0@lo:400:kworker.0 00000100:00100000:3.0:1789997120.972749:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712869504:0@lo:400:kworker.0 00010000:00010000:2.0:1789997121.290882:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997121.940973:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997121.941181:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704354176 00000100:00100000:0.0:1789997121.941192:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704354176 00000100:00100000:0.0:1789997121.941328:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 484 00000100:00100000:0.0:1789997121.941340:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37809:x1876946704354176:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997121.941458:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37809:x1876946704354176:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 121us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997121.941466:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 484 00000100:00100000:1.0:1789997121.943459:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997121.943528:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704354304 00000100:00100000:3.0:1789997121.943550:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704354304 00000100:00080000:2.0:1789997121.943909:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997121.943915:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997121.944057:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 247 00000100:00100000:3.0:1789997121.944069:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37809:x1876946704354304:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997121.944617:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37809:x1876946704354304:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 549us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997121.944626:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 247 00000100:00100000:3.0:1789997121.950766:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997121.951324:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704354432 00000100:00100000:0.0:1789997121.951336:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704354432 00000100:00080000:2.0:1789997121.951485:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997121.951835:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 248 00000100:00100000:0.0:1789997121.951860:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37809:x1876946704354432:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997121.952243:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37809:x1876946704354432:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 396us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997121.952254:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 248 00000100:00100000:2.0:1789997121.955632:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997121.956131:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704354560 00000100:00100000:1.0:1789997121.956142:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704354560 00000100:00100000:1.0:1789997121.956202:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 485 00000100:00100000:1.0:1789997121.956212:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37809:x1876946704354560:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997121.957154:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37809:x1876946704354560:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 940us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997121.957169:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 485 00000100:00100000:2.0:1789997121.960438:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997121.960526:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704354688 00000100:00100000:1.0:1789997121.960544:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704354688 00000100:00100000:1.0:1789997121.960603:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 486 00000100:00100000:1.0:1789997121.960612:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37809:x1876946704354688:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997121.960739:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37809:x1876946704354688:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 128us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997121.960746:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 486 00000100:00100000:3.0:1789997121.962788:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997121.963301:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704354816 00000100:00100000:0.0:1789997121.963320:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704354816 00000100:00100000:0.0:1789997121.963412:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 249 00000100:00100000:0.0:1789997121.963423:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37809:x1876946704354816:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997121.963879:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37809:x1876946704354816:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 457us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997121.963886:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 249 00000100:00100000:3.0:1789997121.966500:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997121.966630:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704354944 00000100:00100000:1.0:1789997121.966640:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704354944 00000100:00100000:1.0:1789997121.966714:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 250 00000100:00100000:1.0:1789997121.966724:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37809:x1876946704354944:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997121.967376:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37809:x1876946704354944:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 650us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997121.967385:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 250 00000100:00100000:2.0:1789997121.972344:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997121.972689:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704355072 00000100:00100000:0.0:1789997121.972700:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704355072 00000100:00100000:0.0:1789997121.972755:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 487 00000100:00100000:0.0:1789997121.972765:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37809:x1876946704355072:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997121.973536:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37809:x1876946704355072:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 761us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997121.973545:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 487 00010000:00010000:1.0:1789997122.317264:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997122.839213:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997122.839254:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997122.839296:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997122.839324:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997122.839350:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704355328 00000100:00100000:0.0:1789997122.839360:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704355328 00000100:00100000:0.0:1789997122.839407:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 942 00000100:00100000:0.0:1789997122.839416:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704355328:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997122.839482:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704355328:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997122.839493:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 942 00000100:00100000:0.0:1789997122.839529:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704355456 00000100:00100000:0.0:1789997122.839533:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704355456 00000100:00100000:0.0:1789997122.839552:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704355584 00000100:00100000:0.0:1789997122.839554:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704355584 00000100:00100000:0.0:1789997122.839570:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 517 00000100:00100000:0.0:1789997122.839577:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704355456:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997122.839599:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704355456:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997122.839606:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 517 00000100:00100000:0.0:1789997122.839616:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 518 00000100:00100000:0.0:1789997122.839621:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704355584:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997122.839640:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704355584:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 19us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997122.839646:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 518 00000100:00100000:2.0:1789997122.840069:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704355200 00000100:00100000:2.0:1789997122.840075:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704355200 00000100:00100000:2.0:1789997122.840114:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 841 00000100:00100000:2.0:1789997122.840121:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704355200:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997122.840164:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704355200:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997122.840170:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 841 00000100:00100000:3.0:1789997123.018926:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997123.018951:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712869632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997123.019024:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997123.019092:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712869632 00000100:00100000:3.0:1789997123.019100:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712869632 00000100:00100000:3.0:1789997123.019156:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1789997123.019165:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712869632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997123.019214:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997123.019291:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712869632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997123.019298:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00080000:3.0:1789997123.019320:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997123.019397:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712869632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997123.020118:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712869760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997123.020157:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997123.020247:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712869760 00000100:00100000:3.0:1789997123.020253:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712869760 00000100:00100000:3.0:1789997123.020311:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1789997123.020321:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712869760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997123.020345:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997123.020408:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997123.026113:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712869760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5782us (5942us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997123.026149:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:0.0:1789997123.026891:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712869760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997123.340365:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997124.026732:0:64093:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff19132900 20000000:00000080:3.0:1789997124.026749:0:64093:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb10f000 uarg=0000000000000000 00010000:00010000:3.0:1789997124.027836:0:64093:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997124.027873:0:64093:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:3.0:1789997124.027877:0:64093:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997124.027887:0:64093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b5b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8c1 expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997124.027910:0:64093:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997124.027927:0:64093:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997124.027940:0:64093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997124.027954:0:64093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b58d expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997124.027962:0:64093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997124.027995:0:64093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b58d expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997124.028009:0:64093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b58d expref: 18 pid: 7594 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997124.028023:0:64093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64093:1876946712869888:0@lo:104: 00000100:00100000:3.0:1789997124.028161:0:64093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997124.028310:0:64093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789997124.028467:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712869888 00000100:00100000:0.0:1789997124.028475:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712869888 00000100:00100000:0.0:1789997124.028573:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789997124.028583:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64093:x1876946712869888:12345-0@lo:104: 00010000:00010000:0.0:1789997124.028597:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997124.028692:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997124.028699:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64093:x1876946712869888:12345-0@lo:104: Request processed in 119us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997124.028707:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00010000:00010000:2.0:1789997124.028758:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997124.028766:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.028786:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997124.028790:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.028800:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997124.028807:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997124.028814:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997124.028848:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.028855:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997124.028876:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.028883:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b58d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b594 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.028898:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997124.028900:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997124.028901:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997124.028921:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712870016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997124.028952:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997124.028989:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712870016 00000100:00100000:2.0:1789997124.028993:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712870016 00010000:00010000:2.0:1789997124.029011:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b58d expref: 19 pid: 7594 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997124.029053:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789997124.029060:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712870016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997124.029071:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997124.029077:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b58d expref: 19 pid: 7594 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029087:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b58d expref: 19 pid: 7594 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029102:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029109:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029123:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029130:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029137:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029144:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029148:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997124.029152:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029166:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029175:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997124.029184:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997124.029212:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712870016:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997124.029218:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00010000:00010000:3.0:1789997124.029389:0:64093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b594 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b58d expref: 18 pid: 7594 timeout: 1462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997124.029400:0:64093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64093:1876946712869888:0@lo:104: 00010000:00010000:3.0:1789997124.029418:0:64093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997124.029427:0:64093:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997124.029433:0:64093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997124.029439:0:64093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592b60b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997124.030289:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712870016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997124.363827:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997125.130773:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997125.130782:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997125.131536:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997125.131589:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997125.131612:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997125.131624:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997125.133371:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712870144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997125.133460:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997125.133568:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0ccdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789997125.134540:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712870144 00000100:00100000:0.0:1789997125.134552:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712870144 00000100:00100000:0.0:1789997125.134611:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:0.0:1789997125.134623:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712870144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997125.134642:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997125.134690:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b612 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997125.134919:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b612 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997125.134932:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b612 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997125.134942:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997125.135000:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712870144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 379us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997125.135008:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1789997125.137553:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712870144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997125.137589:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997125.137601:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997125.137627:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997125.137633:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997125.137641:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997125.386988:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997126.092871:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712870272:0@lo:400:kworker.0 00000100:00100000:3.0:1789997126.092958:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997126.093090:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712870400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093123:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997126.093168:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712870912:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093190:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997126.093214:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997126.093220:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712870784:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093257:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997126.093285:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712870656:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093306:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997126.093328:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997126.093334:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712870528:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093355:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997126.093382:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712870400 00000100:00100000:2.0:1789997126.093390:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712870400 00000100:00100000:2.0:1789997126.093441:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712870912 00000100:00100000:2.0:1789997126.093445:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712870912 00000100:00100000:2.0:1789997126.093471:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712870528 00000100:00100000:2.0:1789997126.093474:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712870528 00000100:00100000:2.0:1789997126.093494:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1789997126.093503:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712870400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093554:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712870400:12345-0@lo:400:kworker.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997126.093562:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1789997126.093578:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1789997126.093584:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712870912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093610:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712870912:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997126.093616:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1789997126.093627:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1789997126.093633:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712870528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093681:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712870528:12345-0@lo:400:kworker.0 Request processed in 48us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997126.093687:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1789997126.093709:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712870784 00000100:00100000:2.0:1789997126.093712:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712870784 00000100:00100000:2.0:1789997126.093738:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712870656 00000100:00100000:2.0:1789997126.093741:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712870656 00000100:00100000:2.0:1789997126.093762:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1789997126.093768:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712870784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093798:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712870784:12345-0@lo:400:kworker.0 Request processed in 30us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997126.093814:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1789997126.093827:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1789997126.093833:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712870656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093863:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712870656:12345-0@lo:400:kworker.0 Request processed in 31us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997126.093869:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00080000:2.0:1789997126.093893:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997126.093897:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997126.093899:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997126.093943:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712870528:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093955:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712870656:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093985:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712870784:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.093995:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712870400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997126.094003:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712870912:0@lo:400:kworker.0 00000100:00100000:1.0:1789997126.108734:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712870272 00000100:00100000:1.0:1789997126.108751:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712870272 00000100:00100000:1.0:1789997126.108833:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:1.0:1789997126.108845:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712870272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997126.108943:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712870272:12345-0@lo:400:kworker.0 Request processed in 101us (15985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997126.108962:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:1.0:1789997126.109006:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712870272:0@lo:400:kworker.0 00000100:00100000:3.0:1789997126.300778:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997126.301026:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704355712 00000100:00100000:2.0:1789997126.301037:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704355712 00000100:00080000:3.0:1789997126.301096:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997126.301127:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 488 00000100:00100000:2.0:1789997126.301139:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37895:x1876946704355712:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997126.301162:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997126.301185:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8d6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.301275:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.301627:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.301642:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997126.301722:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789997126.301727:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997126.301746:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.301772:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8d6 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.301794:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8d6 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.301802:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997126.301804:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997126.301808:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997126.301890:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37895:x1876946704355712:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 753us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997126.301898:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 488 00000100:00100000:2.0:1789997126.307820:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997126.307889:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704355968 00000100:00100000:1.0:1789997126.307900:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704355968 00000100:00100000:1.0:1789997126.307961:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 489 00000100:00100000:1.0:1789997126.307974:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37895:x1876946704355968:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997126.308035:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997126.308064:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8d6 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997126.308082:0:6536:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b5b7) 00010000:00010000:1.0:1789997126.308086:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:1.0:1789997126.308099:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997126.308131:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997126.308146:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997126.308157:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997126.357031:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af5d6089 reply state 0000000099f463d6 transno 4294967487 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997126.357115:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997126.357133:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:1.0:1789997126.357315:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:37895:x1876946704355968:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 49338us (49501us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789997126.357331:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 489 00000001:00080000:1.0:1789997126.357387:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967487 is committed 00010000:00010000:2.0:1789997126.357483:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.357492:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.357509:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.357515:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997126.357520:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.357529:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.357546:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:2.0:1789997126.357550:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997126.357555:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.357561:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b62e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997126.410964:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997127.000050:0:64290:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc317ad7f0 20000000:00000080:1.0:1789997127.000071:0:64290:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fabb4c00 uarg=0000000000000000 00010000:00010000:1.0:1789997127.001971:0:64290:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997127.001992:0:64290:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997127.002008:0:64290:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997127.002028:0:64290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997127.002045:0:64290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b612 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997127.002053:0:64290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997127.002095:0:64290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b612 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997127.002109:0:64290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b612 expref: 18 pid: 5805 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997127.002122:0:64290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64290:1876946712871040:0@lo:104: 00000100:00100000:1.0:1789997127.002183:0:64290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997127.002316:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712871040 00000100:00100000:0.0:1789997127.002324:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712871040 00000100:00100000:0.0:1789997127.002375:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789997127.002384:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64290:x1876946712871040:12345-0@lo:104: 00010000:00010000:0.0:1789997127.002397:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997127.002457:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997127.002464:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64290:x1876946712871040:12345-0@lo:104: Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997127.002471:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00010000:00010000:2.0:1789997127.002865:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997127.002874:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997127.002882:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997127.002886:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997127.002895:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997127.002919:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997127.002924:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997127.002968:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997127.002975:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997127.003005:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997127.003012:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592b612 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b619 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997127.003030:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997127.003032:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997127.003033:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997127.003041:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997127.003054:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712871168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997127.003099:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997127.003225:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712871168 00000100:00100000:3.0:1789997127.003231:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712871168 00000100:00100000:1.0:1789997127.003319:0:64290:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997127.003343:0:64290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64290:1876946712871040:0@lo:104: 00010000:00010000:1.0:1789997127.003362:0:64290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004671:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b612 expref: 19 pid: 5805 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997127.004721:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789997127.004736:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712871168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997127.004751:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997127.004756:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b612 expref: 19 pid: 5805 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004782:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b612 expref: 19 pid: 5805 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004798:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b619 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b612 expref: 19 pid: 5805 timeout: 1465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004814:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004822:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004838:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004846:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004853:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004860:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004866:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997127.004870:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004878:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004909:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997127.004920:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997127.004984:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712871168:12345-0@lo:103:ldlm_bl.0 Request processed in 255us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997127.004992:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00010000:00010000:1.0:1789997127.005245:0:64290:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997127.005257:0:64290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997127.005264:0:64290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592b635 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997127.007561:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712871168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997127.434759:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997127.958650:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997127.958727:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997127.958757:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997127.958786:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704356224 00000100:00100000:3.0:1789997127.958797:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704356224 00000100:00100000:2.0:1789997127.958797:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997127.958823:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704356480 00000100:00100000:2.0:1789997127.958829:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704356480 00000100:00100000:3.0:1789997127.958869:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 946 00000100:00100000:2.0:1789997127.958880:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704356352 00000100:00100000:3.0:1789997127.958882:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704356224:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997127.958894:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704356352 00000100:00100000:2.0:1789997127.958925:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 521 00000100:00100000:2.0:1789997127.958934:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704356480:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997127.958962:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704356224:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997127.958972:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704356480:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997127.958973:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 946 00000100:00100000:2.0:1789997127.958985:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 521 00000100:00100000:2.0:1789997127.959013:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 522 00000100:00100000:2.0:1789997127.959020:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704356352:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997127.959244:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704356352:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997127.959254:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 522 00000100:00080000:2.0:1789997127.959284:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997127.959288:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997127.959825:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704356096 00000100:00100000:0.0:1789997127.959830:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704356096 00000100:00100000:0.0:1789997127.959879:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 844 00000100:00100000:0.0:1789997127.959888:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704356096:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997127.959934:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704356096:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997127.959941:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 844 00000100:00100000:2.0:1789997128.139877:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997128.139886:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712871296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997128.139897:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712871424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997128.140005:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997128.140137:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712871296 00000100:00100000:1.0:1789997128.140154:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712871296 00000100:00100000:1.0:1789997128.140227:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789997128.140237:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712871296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997128.140270:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997128.140318:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712871296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997128.140325:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00080000:0.0:1789997128.140459:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997128.140501:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712871296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997128.143377:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997128.143550:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712871424 00000100:00100000:3.0:1789997128.143559:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712871424 00000100:00100000:3.0:1789997128.143630:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1789997128.143642:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712871424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997128.143710:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997128.143769:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712871424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997128.143776:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00080000:1.0:1789997128.143939:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997128.144163:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712871424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997128.460224:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997128.778732:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997128.778740:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997128.778746:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997128.778797:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997128.778819:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997128.778833:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997128.778861:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712871552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997128.778932:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997128.778992:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712871552 00000100:00100000:3.0:1789997128.778993:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e432c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789997128.779002:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712871552 00000100:00100000:2.0:1789997128.779119:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1789997128.779130:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712871552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997128.779145:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997128.779158:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b63c expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997128.779193:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b63c expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997128.779991:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b63c expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997128.780007:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3200, rc 0) 00000100:00100000:2.0:1789997128.780072:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712871552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 944us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997128.780080:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1789997128.780334:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712871552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997128.780355:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997128.781183:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997128.781209:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997128.781215:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997128.781228:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997129.236846:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997129.236903:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704356608 00000100:00100000:1.0:1789997129.236915:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704356608 00000100:00080000:2.0:1789997129.236973:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997129.237061:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 490 00000100:00100000:1.0:1789997129.237076:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:37972:x1876946704356608:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997129.237096:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997129.237118:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b64a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8dd expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.237210:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.237231:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.237246:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.237263:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.237271:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.237292:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238118:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b65f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238141:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238151:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997129.238189:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:1.0:1789997129.238194:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997129.238214:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238227:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238245:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238253:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238259:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997129.238264:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238272:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238297:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997129.238301:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997129.238306:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238313:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592b651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238818:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238828:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238835:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238841:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997129.238851:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238859:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238868:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38e062d800) 00010000:00010000:1.0:1789997129.238872:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997129.238875:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238882:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b658 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238920:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592b64a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8dd expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238939:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8dd expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.238947:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:1.0:1789997129.238950:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997129.238953:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997129.239040:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37972:x1876946704356608:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1969us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997129.239049:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 490 00000100:00100000:3.0:1789997129.246841:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997129.246875:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704356864 00000100:00100000:3.0:1789997129.246884:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704356864 00000100:00100000:3.0:1789997129.246934:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 491 00000100:00100000:3.0:1789997129.246945:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:37972:x1876946704356864:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997129.246964:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997129.246983:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b666 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8e4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.247321:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.247337:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.247349:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.247364:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.247380:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.247388:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997129.248109:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x10:0x0], index 1: 0 00010000:00010000:3.0:1789997129.248885:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b67b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.248902:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.248913:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.248954:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.248962:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.248969:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.248975:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997129.248980:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.248988:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.249013:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:3.0:1789997129.249017:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997129.249023:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.249030:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b66d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997129.249045:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000210586ad reply state 000000000ef28cef transno 4294967488 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997129.249053:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997129.249087:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b666 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8e4 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.249103:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8e4 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.249110:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997129.249113:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997129.249116:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997129.249360:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37972:x1876946704356864:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 2415us (2522us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1789997129.249368:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 491 00010000:00010000:3.0:1789997129.251873:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.251888:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.251905:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.251911:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997129.251916:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.251924:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.251940:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997129.251943:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997129.251948:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.251954:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b674 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997129.254977:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997129.255434:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704357120 00000100:00100000:3.0:1789997129.255446:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704357120 00000100:00100000:3.0:1789997129.255514:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 492 00000100:00100000:3.0:1789997129.255525:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:37972:x1876946704357120:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:3.0:1789997129.255583:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997129.255609:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b67b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8e4 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.255631:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997129.255642:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997129.256399:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.256415:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.256426:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997129.256567:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062c48a08 reply state 0000000040577c37 transno 4294967489 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997129.256578:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997129.256705:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37972:x1876946704357120:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 1180us (1734us total) trans 4294967489 rc 0/0 00000100:00100000:3.0:1789997129.256713:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 492 00010000:00010000:1.0:1789997129.258208:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.258223:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.258241:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.258248:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997129.258253:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.258262:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.258288:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff8a38ee49e300) 00010000:00010000:1.0:1789997129.258292:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997129.258296:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.258303:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592b689 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997129.259887:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997129.259943:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704357248 00000100:00100000:1.0:1789997129.259954:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704357248 00000100:00100000:1.0:1789997129.260012:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 493 00000100:00100000:1.0:1789997129.260024:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:37972:x1876946704357248:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997129.260046:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997129.260067:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b690 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8eb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.260122:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b690 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8eb expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.260156:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b690 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x29:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8eb expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.260189:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997129.260192:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789997129.260195:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997129.260258:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37972:x1876946704357248:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 237us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997129.260264:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 493 00000100:00100000:3.0:1789997129.263090:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997129.263265:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704357376 00000100:00100000:2.0:1789997129.263276:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704357376 00000100:00100000:2.0:1789997129.263523:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 251 00000100:00100000:2.0:1789997129.263537:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704357376:12345-192.168.204.4@tcp:2:touch.60003 00000100:00080000:0.0:1789997129.263717:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997129.264637:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704357376:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 1099us (1548us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789997129.264648:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 251 00000100:00100000:0.0:1789997129.269285:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997129.269890:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704357632 00000100:00100000:3.0:1789997129.269901:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704357632 00000100:00100000:3.0:1789997129.269962:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 54 00000100:00100000:3.0:1789997129.269971:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:37972:x1876946704357632:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:3.0:1789997129.270312:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:37972:x1876946704357632:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 341us (1036us total) trans 4294967490 rc 0/0 00000100:00100000:3.0:1789997129.270319:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 54 00000100:00100000:0.0:1789997129.314613:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997129.314908:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704357760 00000100:00100000:3.0:1789997129.314920:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704357760 00000100:00100000:3.0:1789997129.315240:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 494 00000100:00100000:3.0:1789997129.315254:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:37976:x1876946704357760:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:3.0:1789997129.315278:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997129.315319:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8f2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.315452:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.315467:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.315481:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.315498:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.315570:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.315579:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316399:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316415:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316424:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997129.316461:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x29:0x0]: returning size 0 00000004:00200000:2.0:1789997129.316465:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997129.316487:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316511:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316520:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316526:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316533:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316539:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997129.316543:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316548:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316558:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:2.0:1789997129.316560:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997129.316565:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316569:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592b69e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316580:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316583:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316591:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316594:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997129.316596:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316600:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316604:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38ee49e500) 00010000:00010000:2.0:1789997129.316605:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997129.316607:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316610:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b6a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316637:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f2 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316648:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f2 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.316770:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:2.0:1789997129.316772:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997129.316775:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997129.316836:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:37976:x1876946704357760:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 1584us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997129.316853:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 494 00000100:00100000:2.0:1789997129.324970:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997129.325075:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704357888 00000100:00100000:0.0:1789997129.325086:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704357888 00000100:00100000:0.0:1789997129.325148:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 252 00000100:00100000:0.0:1789997129.325168:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704357888:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:0.0:1789997129.325188:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997129.325209:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae8f9 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997129.325237:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x6ab13049, atime: 0x6ab13049, ctime: 0x6ab13049, blocks: 0x1 00010000:00010000:0.0:1789997129.325257:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=1318s v=(0 0) 00010000:00010000:0.0:1789997129.325262:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997129.325271:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997129.325290:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997129.325304:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789997129.325373:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704357888:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 215us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997129.325381:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 252 00000100:00100000:1.0:1789997129.334202:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997129.334299:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704358144 00000100:00100000:3.0:1789997129.334311:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704358144 00000100:00100000:3.0:1789997129.334413:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 495 00000100:00100000:3.0:1789997129.334426:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:37976:x1876946704358144:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997129.334481:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997129.334510:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f2 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334534:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b690 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8eb expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334566:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:3.0:1789997129.334577:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997129.334600:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334614:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334625:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334641:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334648:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334707:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334821:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334830:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.334838:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997129.335387:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 64 off9216 00000004:00080000:3.0:1789997129.335398:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1318027743341ns, next at 1319027741126ns, rc = 0 00010000:00010000:3.0:1789997129.335468:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335478:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335487:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335495:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335501:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335508:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335635:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997129.335684:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335691:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335697:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335703:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997129.335708:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335715:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335733:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:3.0:1789997129.335736:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997129.335740:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335746:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b6c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335762:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335769:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335775:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335780:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997129.335783:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335789:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335796:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:3.0:1789997129.335799:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997129.335802:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.335807:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b6ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997129.335830:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000403ea54 reply state 0000000039424d37 transno 4294967491 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997129.335839:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997129.335926:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:37976:x1876946704358144:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1502us (1732us total) trans 4294967491 rc 0/0 00000100:00100000:3.0:1789997129.335936:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 495 00010000:00010000:2.0:1789997129.336210:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997129.336217:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.336224:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997129.336227:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.336234:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.336243:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:2.0:1789997129.336246:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997129.336248:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.336254:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b6cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997129.336269:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997129.336270:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997129.336272:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997129.337932:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.337949:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.337957:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.337963:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997129.337967:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.337975:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.337988:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38ee49e400) 00010000:00010000:1.0:1789997129.337991:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997129.338009:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997129.338015:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b6c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997129.482811:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997129.736864:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967327 is committed 00010000:00010000:2.0:1789997130.506899:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997130.684393:0:64535:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd15624a80 20000000:00000080:3.0:1789997130.684412:0:64535:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae92400 uarg=0000000000000000 00010000:00010000:3.0:1789997130.685169:0:64535:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997130.685215:0:64535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:3.0:1789997130.685219:0:64535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997130.685231:0:64535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b65f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8dd expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997130.685256:0:64535:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997130.685273:0:64535:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997130.685286:0:64535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997130.685301:0:64535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b63c expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997130.685309:0:64535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997130.685346:0:64535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b63c expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997130.685371:0:64535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b63c expref: 18 pid: 7594 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997130.685385:0:64535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64535:1876946712871680:0@lo:104: 00000100:00100000:3.0:1789997130.685454:0:64535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997130.685575:0:64535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d399dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997130.687967:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712871680 00000100:00100000:1.0:1789997130.687979:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712871680 00000100:00100000:1.0:1789997130.688149:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789997130.688160:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64535:x1876946712871680:12345-0@lo:104: 00010000:00010000:1.0:1789997130.688177:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997130.688291:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997130.688298:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64535:x1876946712871680:12345-0@lo:104: Request processed in 141us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997130.688305:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00010000:00010000:2.0:1789997130.688359:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997130.688366:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688387:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997130.688391:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688399:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997130.688405:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997130.688411:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997130.688448:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688454:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997130.688487:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688495:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592b63c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b643 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688511:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997130.688513:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997130.688514:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997130.688538:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712871808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997130.688584:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997130.688643:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712871808 00000100:00100000:2.0:1789997130.688647:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712871808 00010000:00010000:2.0:1789997130.688691:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b63c expref: 19 pid: 7594 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997130.688720:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789997130.688726:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712871808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997130.688738:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997130.688743:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b63c expref: 19 pid: 7594 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688753:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b63c expref: 19 pid: 7594 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688771:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688778:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688792:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688799:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688806:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688812:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688818:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997130.688821:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688835:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688844:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997130.688853:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997130.688882:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712871808:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997130.688889:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789997130.688965:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712871808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997130.689067:0:64535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592b643 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b63c expref: 18 pid: 7594 timeout: 1469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997130.689078:0:64535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7cb9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64535:1876946712871680:0@lo:104: 00010000:00010000:3.0:1789997130.689092:0:64535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997130.689100:0:64535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997130.689105:0:64535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997130.689111:0:64535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b600/0x65b43101d592b6d6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997131.211082:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997131.211166:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997131.211187:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712872064:0@lo:400:kworker.0 00000100:00100000:2.0:1789997131.211251:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997131.211320:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712872064 00000100:00100000:2.0:1789997131.211327:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712872064 00000100:00100000:2.0:1789997131.211395:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1789997131.211404:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712872064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997131.211460:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712872064:12345-0@lo:400:kworker.0 Request processed in 56us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997131.211486:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00080000:2.0:1789997131.211510:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997131.211970:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712872064:0@lo:400:kworker.0 00000100:00100000:3.0:1789997131.212729:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712871936:0@lo:400:kworker.0 00000100:00100000:3.0:1789997131.212781:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997131.213331:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712871936 00000100:00100000:2.0:1789997131.213338:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712871936 00000100:00100000:2.0:1789997131.213387:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1789997131.213396:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712871936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997131.213446:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712871936:12345-0@lo:400:kworker.0 Request processed in 52us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997131.213458:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:3.0:1789997131.213897:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712871936:0@lo:400:kworker.0 00000100:00100000:3.0:1789997131.215976:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712872448:0@lo:400:kworker.0 00000100:00100000:3.0:1789997131.216046:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997131.216112:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712872448 00000100:00100000:3.0:1789997131.216118:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712872448 00000100:00100000:3.0:1789997131.216182:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:3.0:1789997131.216191:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712872448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997131.216236:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712872448:12345-0@lo:400:kworker.0 Request processed in 47us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997131.216243:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00080000:3.0:1789997131.216262:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997131.216296:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712872448:0@lo:400:kworker.0 00000100:00100000:2.0:1789997131.216713:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712872192:0@lo:400:kworker.0 00000100:00100000:2.0:1789997131.219552:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997131.219621:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997131.219634:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712872320:0@lo:400:kworker.0 00000100:00100000:2.0:1789997131.219685:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997131.219735:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712872192 00000100:00100000:2.0:1789997131.219742:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712872192 00000100:00100000:1.0:1789997131.219830:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712872320 00000100:00100000:1.0:1789997131.219834:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712872320 00000100:00100000:2.0:1789997131.223689:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1789997131.223700:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1789997131.223708:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712872192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997131.223718:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712872320:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789997131.223769:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997131.223776:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997131.223823:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712872320:12345-0@lo:400:kworker.0 Request processed in 112us (4137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997131.223831:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1789997131.224173:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712872320:0@lo:400:kworker.0 00000100:00100000:2.0:1789997131.224606:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712872192:12345-0@lo:400:kworker.0 Request processed in 905us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997131.224613:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1789997131.224714:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712872192:0@lo:400:kworker.0 00010000:00010000:3.0:1789997131.531303:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997131.756243:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967491 is committed 00000004:00080000:1.0:1789997131.756255:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 44 committed 00000100:00100000:0.0:1789997131.756482:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712872576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997131.756564:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997131.758806:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712872576 00000100:00100000:2.0:1789997131.758820:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712872576 00000100:00100000:2.0:1789997131.758883:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789997131.758897:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712872576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789997131.759020:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:16 count 1 00010000:00010000:2.0:1789997131.759052:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.759085:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.759094:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789997131.759100:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997131.759125:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.759168:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.759184:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 5 pid: 8169 timeout: 1420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997131.759199:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712872704:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997131.759293:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae10480 going to sleep for 11 seconds 00000100:00100000:1.0:1789997131.762606:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712872704:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997131.762638:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997131.764207:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997131.764325:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704358272 00000100:00100000:2.0:1789997131.764336:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704358272 00010000:00010000:2.0:1789997131.764463:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 6 pid: 8169 timeout: 1420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997131.764506:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 292 00000100:00100000:2.0:1789997131.764517:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704358272:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997131.764531:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997131.764538:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 6 pid: 8169 timeout: 1420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.764551:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 6 pid: 8169 timeout: 1420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.764575:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088474211/0x65b43101d592b6b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae8f9 expref: 6 pid: 8169 timeout: 1420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.764608:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997131.764612:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997131.764618:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.764628:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.764670:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997131.764720:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704358272:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 205us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997131.764728:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 292 00000100:00080000:0.0:1789997131.765014:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997131.765370:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.765384:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.765396:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.765405:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.765422:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789997131.766899:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712872576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8001us (10329us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789997131.766911:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00010000:00010000:2.0:1789997131.766949:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997131.766958:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.766970:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997131.766974:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.766985:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.767005:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.767014:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592b6dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997131.767036:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997131.767038:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997131.767039:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997131.767713:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38ffdf8000/2, rc 0, transno 4294967328 00000100:00100000:3.0:1789997131.767723:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712872576:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789997132.554898:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997132.746743:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997132.746750:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997132.746756:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997132.746801:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997132.746821:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997132.746833:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997132.746860:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712872832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997132.746941:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997132.747016:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae106c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997132.747198:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712872832 00000100:00100000:0.0:1789997132.747207:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712872832 00000100:00100000:0.0:1789997132.747265:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1789997132.747274:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712872832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997132.747287:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997132.747300:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b6e4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997132.747324:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997132.747335:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997132.747344:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997132.747394:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712872832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997132.747401:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:3.0:1789997132.747485:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf02a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712872832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997132.747500:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997132.747510:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997132.747530:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997132.747535:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997132.747542:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997132.987148:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997132.987186:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704358400 00000100:00100000:2.0:1789997132.987197:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704358400 00000100:00100000:2.0:1789997132.987273:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 496 00000100:00100000:2.0:1789997132.987284:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38063:x1876946704358400:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997132.987310:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997132.987345:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae900 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997132.987416:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b6f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997132.987431:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997132.987445:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997132.987484:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789997132.987509:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997132.987532:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997132.987559:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b6f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae900 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997132.987582:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae900 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997132.987591:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997132.987594:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997132.987597:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789997132.987674:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38063:x1876946704358400:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 372us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997132.987681:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 496 00000100:00080000:3.0:1789997132.991722:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997132.996393:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997132.996467:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704358656 00000100:00100000:3.0:1789997132.996477:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704358656 00000100:00100000:3.0:1789997132.996537:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 497 00000100:00100000:3.0:1789997132.996548:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38063:x1876946704358656:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997132.996603:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997132.996632:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592b6f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae900 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997132.996676:0:5810:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b65f) 00010000:00010000:3.0:1789997132.996681:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997132.996692:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997132.996717:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997132.996730:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997132.996740:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997133.066173:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c0c065e reply state 000000006635ffb4 transno 4294967492 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997133.066193:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997133.066211:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:0.0:1789997133.066333:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38063:x1876946704358656:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 69781us (69945us total) trans 4294967492 rc 0/0 00000100:00100000:0.0:1789997133.066341:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 497 00000001:00080000:1.0:1789997133.066798:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967492 is committed 00010000:00010000:2.0:1789997133.066865:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.066875:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.066883:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.066889:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997133.066894:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.066902:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.066930:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:2.0:1789997133.066933:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997133.066939:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.066945:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b700 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997133.080754:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997133.080801:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997133.080831:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997133.080930:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704358784 00000100:00100000:3.0:1789997133.080942:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704358784 00000100:00100000:3.0:1789997133.080997:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 847 00000100:00100000:3.0:1789997133.081007:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704358784:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997133.081078:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704358784:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997133.081116:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 847 00000100:00100000:1.0:1789997133.083484:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704358912 00000100:00100000:1.0:1789997133.083500:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704358912 00000100:00100000:1.0:1789997133.084866:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704359040 00000100:00100000:1.0:1789997133.084877:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704359040 00000100:00100000:0.0:1789997133.084956:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 525 00000100:00100000:0.0:1789997133.084973:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704358912:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997133.085059:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704358912:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 91us (4314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997133.085072:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 525 00000100:00080000:3.0:1789997133.088468:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997133.088478:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997133.089541:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 526 00000100:00100000:1.0:1789997133.089560:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704359040:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997133.089647:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704359040:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 95us (8814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997133.089672:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 526 00000100:00100000:0.0:1789997133.261478:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997133.261504:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712872960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997133.261575:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997133.261641:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712872960 00000100:00100000:0.0:1789997133.261648:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712872960 00000100:00100000:0.0:1789997133.261737:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1789997133.261747:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712872960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997133.261784:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997133.261831:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712872960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997133.261838:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00080000:0.0:1789997133.261859:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997133.261896:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712872960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997133.263520:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997133.263538:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712873088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997133.263596:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997133.263647:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712873088 00000100:00100000:1.0:1789997133.263673:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712873088 00000100:00100000:1.0:1789997133.263728:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1789997133.263737:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712873088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997133.263766:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997133.263810:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712873088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997133.263817:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00080000:1.0:1789997133.263836:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997133.263868:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712873088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789997133.578810:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997133.752069:0:64731:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe548701d0 20000000:00000080:0.0:1789997133.752098:0:64731:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e82c00 uarg=0000000000000000 00010000:00010000:0.0:1789997133.756435:0:64731:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997133.756458:0:64731:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997133.756476:0:64731:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997133.756496:0:64731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997133.756513:0:64731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997133.756521:0:64731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997133.756617:0:64731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997133.756632:0:64731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 18 pid: 5805 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997133.756644:0:64731:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64731:1876946712873216:0@lo:104: 00000100:00100000:0.0:1789997133.756779:0:64731:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997133.756887:0:64731:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee505780 going to sleep for 11 seconds 00000100:00100000:3.0:1789997133.756909:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789997133.756921:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712873216 00000100:00100000:3.0:1789997133.756927:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712873216 00000100:00100000:3.0:1789997133.756990:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789997133.756999:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64731:x1876946712873216:12345-0@lo:104: 00010000:00010000:3.0:1789997133.757012:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997133.757135:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997133.757141:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d19450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64731:x1876946712873216:12345-0@lo:104: Request processed in 144us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997133.757148:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:2.0:1789997133.757194:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997133.757203:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757210:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997133.757214:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757223:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997133.757229:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997133.757246:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997133.757278:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757285:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997133.757316:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757339:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592b6e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b6eb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757354:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997133.757356:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997133.757357:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997133.757366:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997133.757375:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712873344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997133.757408:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997133.757439:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712873344 00000100:00100000:2.0:1789997133.757444:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712873344 00010000:00010000:2.0:1789997133.757462:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 19 pid: 5805 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997133.757483:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789997133.757488:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712873344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997133.757499:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997133.757504:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 19 pid: 5805 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757513:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 19 pid: 5805 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757540:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757549:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757571:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757578:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757585:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757591:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757597:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997133.757601:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757608:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757617:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997133.757627:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997133.757678:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712873344:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997133.757684:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789997133.757727:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712873344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997133.760107:0:64731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b6eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b6e4 expref: 18 pid: 5805 timeout: 1472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997133.760130:0:64731:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64731:1876946712873216:0@lo:104: 00010000:00010000:0.0:1789997133.760153:0:64731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997133.760162:0:64731:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997133.760170:0:64731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997133.760176:0:64731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592b707 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997134.606638:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997134.888266:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967328 is committed 10000000:01000000:3.0:1789997134.986831:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997134.986839:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997134.986844:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997134.986894:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997134.986907:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997134.986919:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997134.986944:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712873472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997134.987027:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997134.987087:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997134.987230:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712873472 00000100:00100000:0.0:1789997134.987238:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712873472 00000100:00100000:0.0:1789997134.987295:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1789997134.987305:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712873472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997134.987320:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997134.987334:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b70e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997134.987359:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b70e expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997134.987373:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b70e expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997134.987383:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997134.987433:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712873472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997134.987441:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1789997134.987504:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712873472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997134.987520:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997134.987529:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997134.987547:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997134.987551:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997134.987560:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997135.628050:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997136.331761:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712873728:0@lo:400:kworker.0 00000100:00100000:3.0:1789997136.331846:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997136.332158:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712874240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997136.332188:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997136.332216:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997136.332222:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712873856:0@lo:400:kworker.0 00000100:00100000:3.0:1789997136.332243:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997136.332289:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712873728 00000100:00100000:3.0:1789997136.332298:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712873728 00000100:00100000:3.0:1789997136.332351:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712874240 00000100:00100000:3.0:1789997136.332369:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712874240 00000100:00100000:3.0:1789997136.332401:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712873856 00000100:00100000:3.0:1789997136.332404:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712873856 00000100:00100000:3.0:1789997136.332422:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1789997136.332430:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712873728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.333037:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712873984:0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.333152:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997136.333187:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789997136.333194:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712873600:0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.333231:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997136.333255:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712874112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.333275:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997136.333308:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1789997136.333317:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712874240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.333359:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712874240:12345-0@lo:400:kworker.0 Request processed in 45us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997136.333367:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1789997136.333386:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1789997136.333392:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712873856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.333421:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712873856:12345-0@lo:400:kworker.0 Request processed in 29us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997136.333427:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1789997136.333448:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712873984 00000100:00100000:3.0:1789997136.333610:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712873728:12345-0@lo:400:kworker.0 Request processed in 1179us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997136.333617:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00080000:3.0:1789997136.333651:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997136.333830:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712873984 00000100:00100000:0.0:1789997136.333880:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712874112 00000100:00100000:0.0:1789997136.333884:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712874112 00000100:00100000:0.0:1789997136.333906:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1789997136.333924:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712873984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.333964:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712873984:12345-0@lo:400:kworker.0 Request processed in 53us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997136.333970:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1789997136.333983:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1789997136.333988:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712874112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.334015:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712874112:12345-0@lo:400:kworker.0 Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997136.334021:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1789997136.334052:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712873600 00000100:00100000:0.0:1789997136.334057:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712873600 00000100:00100000:0.0:1789997136.334953:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:0.0:1789997136.334964:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712873600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.335019:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712873600:12345-0@lo:400:kworker.0 Request processed in 58us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997136.335037:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:0.0:1789997136.335689:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712873856:0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.335706:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712873728:0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.335718:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712874240:0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.335760:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712873600:0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.335771:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:0.0:1789997136.335776:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38ffdf8000, transno 4294967328 00000100:00100000:0.0:1789997136.335786:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712874112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997136.335796:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712873984:0@lo:400:kworker.0 00000100:00080000:3.0:1789997136.337710:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997136.337717:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997136.423258:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997136.423342:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704359168 00000100:00100000:0.0:1789997136.423352:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704359168 00000100:00100000:0.0:1789997136.423435:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 498 00000100:00100000:0.0:1789997136.423445:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38140:x1876946704359168:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:0.0:1789997136.423470:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997136.423490:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b71c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae907 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.423566:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789997136.423579:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997136.423581:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.423596:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.423609:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.423615:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.423622:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.423957:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.423968:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.423980:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997136.424003:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:0.0:1789997136.424007:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997136.424038:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424049:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424056:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424063:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424069:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997136.424073:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424080:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424092:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997136.424095:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997136.424100:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424106:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424124:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424130:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424136:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424140:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997136.424143:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424149:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424156:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38c28e9500) 00010000:00010000:0.0:1789997136.424158:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997136.424161:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424167:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b72a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424207:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592b71c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae907 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424223:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae907 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997136.424234:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997136.424236:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997136.424239:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997136.424305:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38140:x1876946704359168:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 860us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997136.424312:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 498 00010000:00010000:2.0:1789997136.650876:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997137.677177:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997137.877892:0:64978:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3e3640c0 20000000:00000080:1.0:1789997137.877914:0:64978:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fad5d400 uarg=0000000000000000 00010000:00010000:1.0:1789997137.878140:0:64978:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997137.878219:0:64978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:1.0:1789997137.878224:0:64978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997137.878237:0:64978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae907 expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997137.878362:0:64978:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997137.878381:0:64978:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997137.878396:0:64978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997137.878411:0:64978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b70e expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997137.878419:0:64978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997137.878457:0:64978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b70e expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997137.878472:0:64978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b70e expref: 18 pid: 5805 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997137.878486:0:64978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64978:1876946712874368:0@lo:104: 00000100:00100000:1.0:1789997137.878551:0:64978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997137.878692:0:64978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d399d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789997137.878841:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712874368 00000100:00100000:0.0:1789997137.878848:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712874368 00000100:00100000:0.0:1789997137.878930:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789997137.878939:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64978:x1876946712874368:12345-0@lo:104: 00010000:00010000:0.0:1789997137.878953:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997137.879050:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997137.879057:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:64978:x1876946712874368:12345-0@lo:104: Request processed in 119us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997137.879063:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00010000:2.0:1789997137.879118:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997137.879125:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879132:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997137.879135:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879143:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997137.879150:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997137.879155:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997137.879185:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879192:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997137.879212:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879218:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592b70e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b715 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879234:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997137.879236:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997137.879237:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997137.879256:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712874496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997137.879304:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997137.879341:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712874496 00000100:00100000:2.0:1789997137.879345:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712874496 00010000:00010000:2.0:1789997137.879363:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b70e expref: 19 pid: 5805 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997137.879382:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789997137.879389:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712874496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997137.879398:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997137.879403:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b70e expref: 19 pid: 5805 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879412:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b70e expref: 19 pid: 5805 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879426:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879433:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879447:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879453:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879460:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879465:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879471:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997137.879475:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879481:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879488:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997137.879496:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997137.879521:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712874496:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997137.879528:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789997137.879569:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712874496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997137.879740:0:64978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b715 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b70e expref: 18 pid: 5805 timeout: 1476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997137.879752:0:64978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64978:1876946712874368:0@lo:104: 00010000:00010000:3.0:1789997137.879765:0:64978:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997137.879775:0:64978:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997137.879782:0:64978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997137.879787:0:64978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b738 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997138.198484:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997138.198577:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997138.198628:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997138.198694:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997138.198722:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704359552 00000100:00100000:3.0:1789997138.198733:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704359552 00000100:00100000:3.0:1789997138.198790:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704359680 00000100:00100000:3.0:1789997138.198793:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704359680 00000100:00100000:3.0:1789997138.198823:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 529 00000100:00100000:3.0:1789997138.198834:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704359552:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997138.198900:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704359552:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 68us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997138.198908:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 529 00000100:00100000:3.0:1789997138.198924:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 530 00000100:00100000:3.0:1789997138.198930:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704359680:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997138.198953:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704359680:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 23us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997138.198959:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 530 00000100:00080000:3.0:1789997138.198979:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997138.198984:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997138.201934:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704359424 00000100:00100000:1.0:1789997138.201949:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704359424 00000100:00100000:1.0:1789997138.202028:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 953 00000100:00100000:1.0:1789997138.202041:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704359424:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997138.202135:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704359424:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 97us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997138.202143:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 953 00000100:00080000:0.0:1789997138.202231:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997138.202310:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704359296 00000100:00100000:2.0:1789997138.202315:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704359296 00000100:00100000:0.0:1789997138.202424:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 850 00000100:00100000:0.0:1789997138.202432:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704359296:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997138.202460:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704359296:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (3985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997138.202465:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 850 00000100:00100000:2.0:1789997138.378832:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997138.378855:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712874624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997138.378949:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997138.379190:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997138.379202:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712874752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997138.379244:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997138.382175:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712874624 00000100:00100000:3.0:1789997138.382188:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712874624 00000100:00100000:3.0:1789997138.383071:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712874752 00000100:00100000:3.0:1789997138.383079:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712874752 00000100:00100000:3.0:1789997138.383106:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1789997138.383116:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712874624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997138.384270:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997138.384370:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712874624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1253us (5419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997138.384389:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:3.0:1789997138.384415:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1789997138.384425:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb2ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712874752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997138.384450:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997138.384478:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb2ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712874752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997138.384483:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:3.0:1789997138.385037:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712874624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997138.394389:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712874752:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997138.395041:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997138.395048:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997138.701180:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997139.468188:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997139.468196:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997139.468201:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997139.468251:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997139.468265:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997139.468277:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997139.468304:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712874880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997139.468381:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997139.468440:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c11cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789997139.468460:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712874880 00000100:00100000:0.0:1789997139.468470:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712874880 00000100:00100000:0.0:1789997139.468525:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1789997139.468535:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712874880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997139.468548:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997139.468563:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b73f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997139.468587:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b73f expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997139.468598:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b73f expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997139.468607:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997139.468683:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712874880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997139.468690:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1789997139.468800:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712874880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997139.468816:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997139.468825:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997139.468844:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997139.468849:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997139.468856:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997139.722876:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997140.184296:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997140.184390:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704359808 00000100:00100000:2.0:1789997140.184401:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704359808 00000100:00100000:2.0:1789997140.184479:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 499 00000100:00100000:2.0:1789997140.184490:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38226:x1876946704359808:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997140.184510:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997140.184570:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b74d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae90e expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.184638:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.184843:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.184870:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997140.184906:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:2.0:1789997140.184910:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997140.184927:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.184963:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592b74d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae90e expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.184983:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae90e expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.185000:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997140.185004:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997140.185008:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997140.185061:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38226:x1876946704359808:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 572us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997140.185069:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 499 00000100:00080000:3.0:1789997140.185269:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997140.192346:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997140.192389:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704360064 00000100:00100000:3.0:1789997140.192405:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704360064 00000100:00100000:3.0:1789997140.192455:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 500 00000100:00100000:3.0:1789997140.192465:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38226:x1876946704360064:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997140.192513:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997140.192537:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592b754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae90e expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997140.192552:0:5812:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b731) 00010000:00010000:3.0:1789997140.192556:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:3.0:1789997140.192566:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997140.192589:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997140.192602:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997140.192613:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997140.195586:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d5628e9 reply state 00000000042b0958 transno 4294967493 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997140.195609:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997140.195621:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000100:00100000:3.0:1789997140.197299:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38226:x1876946704360064:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 4829us (4958us total) trans 4294967493 rc 0/0 00000100:00100000:3.0:1789997140.197310:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 500 00010000:00010000:0.0:1789997140.206993:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.207012:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.207020:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.207027:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997140.207032:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.207041:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.207061:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:0.0:1789997140.207065:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997140.207070:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.207075:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b75b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.746794:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997140.838507:0:65174:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd74e437e0 20000000:00000080:0.0:1789997140.838525:0:65174:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e6800 uarg=0000000000000000 00010000:00010000:0.0:1789997140.839289:0:65174:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997140.839306:0:65174:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997140.839320:0:65174:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997140.839338:0:65174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.839355:0:65174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b73f expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.839364:0:65174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.839403:0:65174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b73f expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.839417:0:65174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b73f expref: 18 pid: 5803 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997140.839435:0:65174:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65174:1876946712875008:0@lo:104: 00000100:00100000:0.0:1789997140.839498:0:65174:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997140.839597:0:65174:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789997140.839647:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712875008 00000100:00100000:3.0:1789997140.840100:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712875008 00000100:00100000:0.0:1789997140.840280:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789997140.840290:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:65174:x1876946712875008:12345-0@lo:104: 00010000:00010000:0.0:1789997140.840304:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997140.840381:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997140.840388:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:65174:x1876946712875008:12345-0@lo:104: Request processed in 100us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997140.840394:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789997140.840476:0:65174:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65174:1876946712875008:0@lo:104: 00010000:00010000:1.0:1789997140.840497:0:65174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.840694:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997140.840702:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.840709:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997140.840724:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.840733:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997140.840741:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997140.840746:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997140.840784:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.840791:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997140.840811:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.840818:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592b73f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b746 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.840833:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997140.840836:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997140.840837:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997140.840849:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712875136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997140.840882:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997140.840948:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712875136 00000100:00100000:2.0:1789997140.840952:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712875136 00010000:00010000:2.0:1789997140.840973:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b73f expref: 19 pid: 5803 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997140.840994:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789997140.841001:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712875136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997140.841011:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997140.841016:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b73f expref: 19 pid: 5803 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841025:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b73f expref: 19 pid: 5803 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841038:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b746 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b73f expref: 19 pid: 5803 timeout: 1479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841051:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841059:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841072:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841079:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841086:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841093:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841099:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997140.841103:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841109:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841121:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997140.841128:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997140.841154:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712875136:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997140.841161:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789997140.841195:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712875136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997140.841322:0:65174:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997140.841331:0:65174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997140.841336:0:65174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592b762 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997141.452074:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712875264:0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.452153:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997141.452280:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712875264 00000100:00100000:1.0:1789997141.452289:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712875264 00000100:00100000:1.0:1789997141.452347:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:1.0:1789997141.452358:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712875264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997141.452408:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712875264:12345-0@lo:400:kworker.0 Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997141.452415:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1789997141.452554:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712875264:0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.453911:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712875648:0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.453981:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997141.454019:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712875520:0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.454021:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997141.454026:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712875776:0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.454044:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997141.454047:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997141.454076:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712875648 00000100:00100000:1.0:1789997141.454079:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789997141.454082:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712875648 00000100:00100000:1.0:1789997141.454085:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712875392:0@lo:400:kworker.0 00000100:00100000:1.0:1789997141.454107:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997141.454123:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712875904:0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.454127:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712875776 00000100:00100000:0.0:1789997141.454130:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712875776 00000100:00100000:1.0:1789997141.454140:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997141.454151:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1789997141.454159:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712875648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997141.454163:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712875520 00000100:00100000:1.0:1789997141.454165:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712875520 00000100:00100000:1.0:1789997141.454188:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712875392 00000100:00100000:1.0:1789997141.454190:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712875392 00000100:00100000:1.0:1789997141.454204:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712875904 00000100:00100000:0.0:1789997141.454205:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712875648:12345-0@lo:400:kworker.0 Request processed in 46us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997141.454206:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712875904 00000100:00100000:0.0:1789997141.454211:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789997141.454222:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1789997141.454225:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1789997141.454228:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712875520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.454230:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712875776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.454254:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712875776:12345-0@lo:400:kworker.0 Request processed in 24us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997141.454257:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712875520:12345-0@lo:400:kworker.0 Request processed in 29us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997141.454260:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1789997141.454263:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00080000:0.0:1789997141.454276:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997141.454280:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997141.454282:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997141.454286:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1789997141.454292:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712875392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.454292:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1789997141.454298:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712875904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997141.454319:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712875392:12345-0@lo:400:kworker.0 Request processed in 27us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997141.454319:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712875904:12345-0@lo:400:kworker.0 Request processed in 20us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997141.454325:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1789997141.454373:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712875776:0@lo:400:kworker.0 00000100:00100000:0.0:1789997141.454382:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712875648:0@lo:400:kworker.0 00000100:00100000:1.0:1789997141.454452:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:1.0:1789997141.454481:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712875392:0@lo:400:kworker.0 00000100:00100000:1.0:1789997141.454491:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712875904:0@lo:400:kworker.0 00000100:00100000:1.0:1789997141.454499:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712875520:0@lo:400:kworker.0 00010000:00010000:1.0:1789997141.770811:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997142.732536:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997142.732563:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997142.732568:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997142.732615:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997142.732629:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997142.732640:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997142.732695:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712876032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997142.732774:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997142.733186:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997142.733700:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712876032 00000100:00100000:3.0:1789997142.733715:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712876032 00000100:00100000:3.0:1789997142.733765:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1789997142.733774:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712876032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997142.733789:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997142.733803:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b769 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997142.733829:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b769 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997142.733841:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b769 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997142.733851:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997142.733925:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712876032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997142.733932:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1789997142.733983:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712876032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997142.733998:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997142.734008:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997142.734028:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997142.734033:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997142.734041:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997142.795852:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997143.157009:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.157047:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704360192 00000100:00100000:3.0:1789997143.157057:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704360192 00000100:00100000:3.0:1789997143.161501:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 501 00000100:00100000:3.0:1789997143.161527:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38311:x1876946704360192:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997143.161639:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38311:x1876946704360192:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 119us (4681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997143.161647:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 501 00000100:00080000:3.0:1789997143.161696:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997143.171346:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.171395:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704360320 00000100:00100000:3.0:1789997143.171405:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704360320 00000100:00100000:3.0:1789997143.171467:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 254 00000100:00100000:3.0:1789997143.171478:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38311:x1876946704360320:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997143.171856:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38311:x1876946704360320:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 380us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997143.171864:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 254 00000100:00080000:3.0:1789997143.171887:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997143.177755:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997143.177824:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704360448 00000100:00100000:1.0:1789997143.177834:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704360448 00000100:00100000:1.0:1789997143.177908:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 255 00000100:00100000:1.0:1789997143.177920:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38311:x1876946704360448:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:3.0:1789997143.177922:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997143.178299:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38311:x1876946704360448:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 381us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997143.178307:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 255 00000100:00100000:3.0:1789997143.182083:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997143.182336:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704360576 00000100:00100000:1.0:1789997143.182346:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704360576 00000100:00100000:1.0:1789997143.182398:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 502 00000100:00100000:1.0:1789997143.182410:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38311:x1876946704360576:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997143.183577:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38311:x1876946704360576:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 1165us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997143.183599:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 502 00000100:00100000:3.0:1789997143.191323:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997143.191425:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704360704 00000100:00100000:0.0:1789997143.191436:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704360704 00000100:00100000:0.0:1789997143.191593:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 503 00000100:00100000:0.0:1789997143.191606:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38311:x1876946704360704:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997143.191733:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38311:x1876946704360704:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 130us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997143.191742:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 503 00000100:00100000:3.0:1789997143.193836:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997143.193929:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704360832 00000100:00100000:1.0:1789997143.193936:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704360832 00000100:00100000:1.0:1789997143.193984:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 256 00000100:00100000:1.0:1789997143.193994:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38311:x1876946704360832:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997143.194327:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38311:x1876946704360832:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 333us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997143.194334:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 256 00000100:00100000:1.0:1789997143.197066:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.197151:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704360960 00000100:00100000:3.0:1789997143.197161:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704360960 00000100:00100000:3.0:1789997143.197218:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 257 00000100:00100000:3.0:1789997143.197228:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38311:x1876946704360960:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997143.197605:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38311:x1876946704360960:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 377us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997143.197613:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 257 00000100:00100000:2.0:1789997143.199903:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.200585:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704361088 00000100:00100000:3.0:1789997143.200594:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704361088 00000100:00100000:3.0:1789997143.200650:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 504 00000100:00100000:3.0:1789997143.200681:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38311:x1876946704361088:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997143.201209:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38311:x1876946704361088:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 529us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997143.201219:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 504 00000100:00100000:0.0:1789997143.266880:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.267094:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704361216 00000100:00100000:3.0:1789997143.267105:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704361216 00000100:00100000:3.0:1789997143.267173:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 505 00000100:00100000:3.0:1789997143.267185:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38315:x1876946704361216:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997143.267206:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997143.267230:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae915 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267299:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267313:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267327:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267355:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267362:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267384:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267916:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b78c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267926:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267934:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997143.267957:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:3.0:1789997143.267961:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997143.267979:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267989:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.267996:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268002:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268007:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997143.268012:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268019:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268036:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:3.0:1789997143.268039:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997143.268043:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268049:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268061:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268067:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268073:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268077:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997143.268080:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268085:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268092:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38ee49e800) 00010000:00010000:3.0:1789997143.268095:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997143.268097:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268103:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592b785 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268146:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae915 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268162:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae915 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.268170:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997143.268172:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997143.268174:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997143.268243:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38315:x1876946704361216:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 1061us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997143.268252:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 505 00000100:00100000:1.0:1789997143.273083:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.273235:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704361472 00000100:00100000:3.0:1789997143.273248:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704361472 00000100:00100000:3.0:1789997143.273308:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 506 00000100:00100000:3.0:1789997143.273320:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38315:x1876946704361472:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997143.273341:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997143.273361:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b793 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae91c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.274278:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.274298:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.274310:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.274325:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.274332:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.274338:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997143.276319:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:2.0:1789997143.276874:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b7a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.276901:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.276917:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.276956:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.276962:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.276968:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.276974:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997143.276978:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.276984:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.276996:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:2.0:1789997143.276998:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997143.277003:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.277009:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592b79a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997143.277021:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5641fd1 reply state 00000000bdc753a3 transno 4294967494 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997143.277029:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997143.277354:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592b793 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae91c expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.277372:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae91c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.277380:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997143.277382:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997143.277385:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997143.277851:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:38315:x1876946704361472:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 4531us (4775us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789997143.277860:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 506 00010000:00010000:2.0:1789997143.279411:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.279427:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.279435:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.279442:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997143.279447:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.279454:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.279468:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997143.279471:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997143.279476:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997143.279482:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b7a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997143.285064:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.285158:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704361600 00000100:00100000:3.0:1789997143.285169:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704361600 00000100:00100000:3.0:1789997143.285228:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 258 00000100:00100000:3.0:1789997143.285239:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38315:x1876946704361600:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997143.285256:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997143.285276:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae923 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997143.285315:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789997143.285337:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=1331s v=(0 0) 00010000:00010000:3.0:1789997143.285342:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997143.285351:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 6 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.285370:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 6 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997143.285382:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997143.285499:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38315:x1876946704361600:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 261us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997143.285506:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 258 00000100:00100000:0.0:1789997143.313758:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.314031:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704361728 00000100:00100000:3.0:1789997143.314041:0:6664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704361728 00002000:00100000:3.0:1789997143.314222:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x10:0x0] (0->1048575) req@ffff8a38f9b45880 x1876946704361728/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:119/0 lens 488/0 e 0 to 0 dl 1789997154 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1789997143.314234:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f9b45880 with x1876946704361728 ext(0->1048575) 00002000:00010000:3.0:1789997143.314241:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38f9b45880 00000100:00100000:3.0:1789997143.314280:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00100000:3.0:1789997143.314291:0:6664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704361728:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:1.0:1789997143.320786:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997143.321457:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704361856 00000100:00100000:2.0:1789997143.321469:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704361856 00000100:00100000:2.0:1789997143.321530:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 854 00000100:00100000:2.0:1789997143.321609:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704361856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997143.321758:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704361856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 153us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997143.321767:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 854 00000100:00100000:2.0:1789997143.342476:0:6664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704361728:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 28174us (28715us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789997143.342492:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00002000:00100000:2.0:1789997143.342506:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x10:0x0] (0->1048575) req@ffff8a38f9b45880 x1876946704361728/t4294967327(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:119/0 lens 488/448 e 0 to 0 dl 1789997154 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789997143.342517:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f9b45880 with x1876946704361728 ext(0->1048575) 00002000:00010000:2.0:1789997143.342525:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38f9b45880 00000100:00100000:3.0:1789997143.351481:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997143.352353:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704361984 00000100:00100000:1.0:1789997143.352365:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704361984 00000100:00100000:1.0:1789997143.352428:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 507 00000100:00100000:1.0:1789997143.352439:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:38315:x1876946704361984:12345-192.168.204.4@tcp:44:dd.60003 00000001:00080000:3.0:1789997143.399401:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967494 is committed 00000100:00100000:0.0:1789997143.399731:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38315:x1876946704361984:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 47288us (48254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997143.399743:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 507 00000100:00100000:1.0:1789997143.402221:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997143.402370:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704362112 00000100:00100000:3.0:1789997143.402392:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704362112 00000100:00100000:3.0:1789997143.402449:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 259 00000100:00100000:3.0:1789997143.402460:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704362112:12345-192.168.204.4@tcp:16:dd.60003 00000001:00080000:1.0:1789997143.433028:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00000100:00100000:3.0:1789997143.433199:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704362112:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 30734us (30980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997143.433212:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 259 00000100:00100000:3.0:1789997143.437524:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997143.437684:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704362368 00000100:00100000:0.0:1789997143.437694:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704362368 00000100:00100000:0.0:1789997143.437814:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:0.0:1789997143.437825:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38315:x1876946704362368:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:1.0:1789997143.438845:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:38315:x1876946704362368:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 1016us (1327us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789997143.438855:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 55 00000100:00100000:1.0:1789997143.499686:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712876160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997143.499762:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997143.499955:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712876160 00000100:00100000:2.0:1789997143.499963:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712876160 00000100:00100000:2.0:1789997143.500042:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1789997143.500052:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712876160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997143.500092:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997143.500144:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712876160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997143.500153:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00080000:0.0:1789997143.500262:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997143.500344:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712876160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997143.500878:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712876288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997143.500929:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997143.501547:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712876288 00000100:00100000:1.0:1789997143.501570:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712876288 00000100:00100000:1.0:1789997143.501634:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1789997143.501643:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712876288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997143.501686:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00080000:2.0:1789997143.501761:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997143.502495:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712876288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 850us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997143.502504:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1789997143.502645:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712876288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789997143.819644:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997144.383273:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967495 is committed 00010000:00010000:0.0:1789997144.844380:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997145.322489:0:65419:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1334014831081ns, next at 1293871946081ns, rc = 0 00000004:00080000:3.0:1789997145.322596:0:65419:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1334014941605ns, next at 1319027741126ns, rc = 0 00000004:00080000:1.0:1789997145.326383:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 45 committed 00000004:00080000:1.0:1789997145.326408:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 43 committed 00010000:00010000:2.0:1789997145.866856:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997146.492027:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997146.492102:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704362496 00000100:00100000:3.0:1789997146.492113:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704362496 00000100:00100000:3.0:1789997146.492214:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 508 00000100:00100000:3.0:1789997146.492224:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38507:x1876946704362496:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997146.492331:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38507:x1876946704362496:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 107us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.492339:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 508 00000100:00080000:2.0:1789997146.492824:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997146.494125:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997146.494199:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704362624 00000100:00100000:3.0:1789997146.494207:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704362624 00000100:00100000:3.0:1789997146.494260:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 260 00000100:00100000:3.0:1789997146.494269:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38507:x1876946704362624:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997146.494605:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38507:x1876946704362624:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 336us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.494614:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 260 00000100:00080000:2.0:1789997146.497067:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997146.498222:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997146.498405:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704362752 00000100:00100000:2.0:1789997146.498414:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704362752 00000100:00100000:2.0:1789997146.498476:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 261 00000100:00100000:2.0:1789997146.498487:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38507:x1876946704362752:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997146.499128:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38507:x1876946704362752:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 640us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997146.499137:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 261 00000100:00080000:2.0:1789997146.499161:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997146.500979:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997146.501042:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704362880 00000100:00100000:3.0:1789997146.501107:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704362880 00000100:00100000:3.0:1789997146.502958:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 509 00000100:00100000:3.0:1789997146.502976:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38507:x1876946704362880:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997146.503587:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38507:x1876946704362880:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 508us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.503599:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 509 00000100:00100000:2.0:1789997146.510604:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997146.511381:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704363008 00000100:00100000:3.0:1789997146.511391:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704363008 00000100:00100000:3.0:1789997146.511545:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 510 00000100:00100000:3.0:1789997146.511557:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38507:x1876946704363008:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997146.511700:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38507:x1876946704363008:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 145us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.511708:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 510 00000100:00100000:1.0:1789997146.516097:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997146.516223:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704363136 00000100:00100000:3.0:1789997146.516234:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704363136 00000100:00100000:3.0:1789997146.516293:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 262 00000100:00100000:3.0:1789997146.516304:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38507:x1876946704363136:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997146.517048:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38507:x1876946704363136:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 744us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.517065:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 262 00000100:00100000:1.0:1789997146.523172:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997146.525104:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704363264 00000100:00100000:3.0:1789997146.525118:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704363264 00000100:00100000:3.0:1789997146.525197:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 263 00000100:00100000:3.0:1789997146.525209:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38507:x1876946704363264:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997146.526326:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38507:x1876946704363264:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1116us (3160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.526341:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 263 00000100:00100000:2.0:1789997146.533194:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997146.533261:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704363392 00000100:00100000:3.0:1789997146.533272:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704363392 00000100:00100000:3.0:1789997146.533332:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 511 00000100:00100000:3.0:1789997146.533343:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38507:x1876946704363392:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997146.533820:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38507:x1876946704363392:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 477us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.533941:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 511 00000100:00100000:0.0:1789997146.571515:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997146.571552:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712876800:0@lo:400:kworker.0 00000100:00100000:0.0:1789997146.571631:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997146.571642:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712876928:0@lo:400:kworker.0 00000100:00100000:1.0:1789997146.571848:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712876544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997146.571916:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712876800 00000100:00100000:2.0:1789997146.571924:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712876800 00000100:00100000:2.0:1789997146.571977:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1789997146.571987:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712876800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997146.573948:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997146.574098:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712876928 00000100:00100000:3.0:1789997146.574106:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712876928 00000100:00100000:3.0:1789997146.574150:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1789997146.574160:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712876928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997146.574234:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997146.574282:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712877056:0@lo:400:kworker.0 00000100:00100000:3.0:1789997146.574294:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712876928:12345-0@lo:400:kworker.0 Request processed in 135us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997146.574325:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997146.574355:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997146.574362:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712876672:0@lo:400:kworker.0 00000100:00100000:3.0:1789997146.574380:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1789997146.574395:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997146.574448:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712876544 00000100:00100000:1.0:1789997146.574452:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712876544 00000100:00100000:1.0:1789997146.574488:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712877056 00000100:00100000:1.0:1789997146.574491:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712877056 00000100:00100000:3.0:1789997146.574504:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712876928:0@lo:400:kworker.0 00000100:00100000:1.0:1789997146.574516:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712876672 00000100:00100000:1.0:1789997146.574520:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712876672 00000100:00100000:1.0:1789997146.574543:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1789997146.575156:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712876800:12345-0@lo:400:kworker.0 Request processed in 3167us (3523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997146.575165:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00080000:2.0:1789997146.575259:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997146.575263:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997146.575270:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997146.576238:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712876800:0@lo:400:kworker.0 00000100:00100000:0.0:1789997146.576250:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712876416:0@lo:400:kworker.0 00000100:00100000:0.0:1789997146.576294:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997146.576488:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1789997146.576503:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712877056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997146.576561:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712877056:12345-0@lo:400:kworker.0 Request processed in 64us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.576568:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1789997146.576589:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:3.0:1789997146.576604:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712876672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997146.576633:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712876672:12345-0@lo:400:kworker.0 Request processed in 31us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997146.576639:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1789997146.577147:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712876544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997146.577188:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712876544:12345-0@lo:400:kworker.0 Request processed in 48us (2955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997146.577195:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:1.0:1789997146.577244:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712876672:0@lo:400:kworker.0 00000100:00100000:1.0:1789997146.577256:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712876544:0@lo:400:kworker.0 00000100:00100000:1.0:1789997146.577266:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712877056:0@lo:400:kworker.0 00000100:00100000:0.0:1789997146.577965:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712876416 00000100:00100000:0.0:1789997146.577974:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712876416 00000100:00100000:0.0:1789997146.578011:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:0.0:1789997146.578021:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712876416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997146.578082:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712876416:12345-0@lo:400:kworker.0 Request processed in 62us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997146.578088:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1789997146.578560:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712876416:0@lo:400:kworker.0 00000100:00100000:2.0:1789997146.594346:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997146.594518:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704363648 00000100:00100000:3.0:1789997146.594528:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704363648 00000100:00100000:3.0:1789997146.594636:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 512 00000100:00100000:3.0:1789997146.594648:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38511:x1876946704363648:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997146.594755:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997146.594787:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592b7a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae91c expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.594807:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:3.0:1789997146.594841:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997146.594865:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.594879:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.594890:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.594904:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.594911:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.594919:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.595888:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.595902:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.595911:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997146.597177:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9216 00000004:00080000:3.0:1789997146.597189:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1335289535092ns, next at 1336289532262ns, rc = 0 00010000:00010000:3.0:1789997146.597305:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597319:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597329:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597338:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597344:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597350:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597377:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997146.597403:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597418:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597425:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597499:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997146.597505:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597513:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597525:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997146.597529:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997146.597534:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597540:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592b7cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597561:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597568:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597573:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597578:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997146.597588:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597594:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597603:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997146.597606:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997146.597609:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997146.597615:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b7bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997146.597625:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f1df030 reply state 00000000a10548fc transno 4294967496 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997146.597633:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997146.597712:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997146.597721:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997146.597729:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997146.597733:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997146.597740:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997146.597750:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:0.0:1789997146.597754:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1789997146.597755:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:38511:x1876946704363648:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 3103us (3413us total) trans 4294967496 rc 0/0 00010000:00010000:0.0:1789997146.597758:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997146.597770:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592b7d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997146.597772:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 512 00010000:00010000:0.0:1789997146.597945:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997146.597948:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997146.597950:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997146.602421:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997146.602441:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997146.602450:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997146.602456:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997146.602462:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997146.602470:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997146.602486:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x93c5647 (ffff8a38ee49ec00) 00010000:00010000:1.0:1789997146.602489:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997146.602494:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997146.602501:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592b7c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997146.891145:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997147.915612:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997148.258592:0:65564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1336950935962ns, next at 1336289532262ns, rc = 0 00000004:00080000:3.0:1789997148.310231:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 45 committed 00000001:00080000:3.0:1789997148.310268:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967496 is committed 00000004:00080000:3.0:1789997148.310273:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 44 committed 00000100:00100000:2.0:1789997148.310534:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997148.310555:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712877184:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789997148.310627:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997148.310849:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712877184 00000100:00100000:3.0:1789997148.310858:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712877184 00000100:00100000:3.0:1789997148.310923:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789997148.310933:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712877184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789997148.310964:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:16 count 1 00010000:00010000:3.0:1789997148.311003:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789997148.311112:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789997148.311150:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 5 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997148.311163:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x10:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1789997148.311167:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997148.311172:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997148.311203:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 5 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997148.311219:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 5 pid: 8169 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997148.311234:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946712877312:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997148.311308:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c12ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1789997148.313546:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946712877312:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997148.313577:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997148.315766:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997148.316307:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704363776 00000100:00100000:2.0:1789997148.316320:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704363776 00010000:00010000:2.0:1789997148.316390:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 6 pid: 8169 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789997148.316497:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997148.316545:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 296 00000100:00100000:2.0:1789997148.316557:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704363776:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997148.316574:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997148.316580:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 6 pid: 8169 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997148.316594:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 6 pid: 8169 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997148.316619:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592b7b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae923 expref: 6 pid: 8169 timeout: 1437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997148.316638:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997148.316642:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997148.316648:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997148.316714:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997148.316761:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997148.316828:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704363776:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 272us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997148.316835:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 296 00010000:00010000:0.0:1789997148.316895:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997148.316919:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997148.316946:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997148.316954:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997148.316972:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997148.320211:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997148.320236:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997148.320264:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997148.320269:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997148.320281:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997148.320329:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997148.320337:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592b7d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997148.320372:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997148.320375:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997148.320376:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997148.321312:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712877184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10375us (10679us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789997148.321324:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000004:00080000:2.0:1789997148.321427:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38f9b47100/2, rc 0, transno 4294967328 00000100:00100000:2.0:1789997148.321515:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712877184:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789997148.322366:0:65564:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1337014711538ns, next at 1319027741126ns, rc = 0 00000004:00080000:0.0:1789997148.325355:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 46 committed 00000100:00100000:2.0:1789997148.440891:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997148.441069:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997148.441117:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997148.441144:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704364032 00000100:00100000:2.0:1789997148.441154:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704364032 00000100:00100000:2.0:1789997148.441209:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 960 00000100:00100000:2.0:1789997148.441219:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704364032:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997148.441305:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704364032:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997148.441313:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 960 00000100:00080000:2.0:1789997148.441332:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997148.441473:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704364160 00000100:00100000:1.0:1789997148.441477:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704364160 00000100:00100000:1.0:1789997148.441515:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 535 00000100:00100000:1.0:1789997148.441523:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704364160:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997148.441556:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704364160:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997148.441571:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 535 00000100:00080000:2.0:1789997148.441804:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997148.441926:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704363904 00000100:00100000:0.0:1789997148.441931:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704363904 00000100:00100000:1.0:1789997148.442089:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 856 00000100:00100000:1.0:1789997148.442099:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704363904:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997148.442140:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704363904:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997148.442147:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 856 00000100:00100000:2.0:1789997148.618862:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997148.618888:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712877440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997148.618967:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997148.619039:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712877440 00000100:00100000:2.0:1789997148.619048:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712877440 00000100:00100000:2.0:1789997148.619097:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1789997148.619107:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712877440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997148.619143:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789997148.619189:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712877440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997148.619196:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:2.0:1789997148.619251:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712877440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997148.623570:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997148.623597:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712877568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997148.623691:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997148.623755:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712877568 00000100:00100000:0.0:1789997148.623764:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712877568 00000100:00080000:1.0:1789997148.623832:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997148.623853:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1789997148.623864:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712877568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997148.623897:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997148.623956:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712877568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997148.623967:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1789997148.624487:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712877568:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997148.938937:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997149.963329:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997150.987137:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997151.690908:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712877696:0@lo:400:kworker.0 00000100:00100000:0.0:1789997151.690986:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712877824:0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.691008:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997151.691034:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997151.691067:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712878208:0@lo:400:kworker.0 00000100:00100000:0.0:1789997151.691070:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712878336:0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.691110:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997151.691115:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997151.691162:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712877952:0@lo:400:kworker.0 00000100:00100000:0.0:1789997151.691168:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712877696 00000100:00100000:0.0:1789997151.691177:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712877696 00000100:00100000:2.0:1789997151.691186:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997151.691205:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997151.691210:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712878080:0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.691231:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997151.691231:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1789997151.691245:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712877696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.691278:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712877824 00000100:00100000:2.0:1789997151.691282:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712877824 00000100:00100000:0.0:1789997151.691302:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712877696:12345-0@lo:400:kworker.0 Request processed in 59us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997151.691311:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1789997151.691319:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712878336 00000100:00100000:2.0:1789997151.691322:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712878336 00000100:00100000:2.0:1789997151.691346:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712877952 00000100:00100000:2.0:1789997151.691347:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712877952 00000100:00100000:2.0:1789997151.691360:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1789997151.691364:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712877824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.691406:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712877824:12345-0@lo:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997151.691414:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1789997151.691427:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1789997151.691433:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712878336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.691467:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712878336:12345-0@lo:400:kworker.0 Request processed in 35us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997151.691473:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1789997151.691485:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1789997151.691491:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712877952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.691522:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712877952:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997151.691528:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00080000:2.0:1789997151.691544:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997151.691589:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712877952:0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.691623:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712877696:0@lo:400:kworker.0 00000100:00100000:1.0:1789997151.691753:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712878208 00000100:00100000:1.0:1789997151.691758:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712878208 00000100:00100000:1.0:1789997151.691790:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712878080 00000100:00100000:1.0:1789997151.691793:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712878080 00000100:00100000:1.0:1789997151.691810:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1789997151.691818:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712878208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997151.692056:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1789997151.692068:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712878080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789997151.692081:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997151.692087:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997151.692121:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712878080:12345-0@lo:400:kworker.0 Request processed in 55us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997151.692128:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1789997151.692172:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712878080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997151.692463:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712878208:12345-0@lo:400:kworker.0 Request processed in 645us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997151.692603:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1789997151.692608:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712877824:0@lo:400:kworker.0 00000100:00100000:2.0:1789997151.692627:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712878208:0@lo:400:kworker.0 00000100:00100000:3.0:1789997151.692628:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712878336:0@lo:400:kworker.0 00000001:00080000:2.0:1789997151.725412:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00010000:00010000:0.0:1789997152.011241:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997153.034974:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997153.558813:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997153.558916:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997153.558952:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997153.558991:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997153.559148:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704364288 00000100:00100000:1.0:1789997153.559160:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704364288 00000100:00100000:1.0:1789997153.559221:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 858 00000100:00100000:1.0:1789997153.559239:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704364288:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997153.559314:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704364288:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997153.559321:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 858 00000100:00100000:3.0:1789997153.561904:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704364672 00000100:00100000:3.0:1789997153.561918:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704364672 00000100:00100000:3.0:1789997153.562012:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704364544 00000100:00100000:3.0:1789997153.562016:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704364544 00000100:00100000:3.0:1789997153.562056:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 538 00000100:00100000:3.0:1789997153.562067:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704364672:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997153.562162:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704364672:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 97us (3246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997153.562170:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 538 00000100:00100000:3.0:1789997153.562188:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 539 00000100:00100000:3.0:1789997153.562195:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704364544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997153.562221:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704364544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997153.562227:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 539 00000100:00080000:2.0:1789997153.562386:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997153.562392:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997153.563553:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704364416 00000100:00100000:0.0:1789997153.563563:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704364416 00000100:00100000:0.0:1789997153.563727:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 964 00000100:00100000:0.0:1789997153.563736:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704364416:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997153.563802:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704364416:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 67us (4999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997153.563809:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 964 00000100:00080000:2.0:1789997153.564993:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997153.738881:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997153.738906:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712878464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997153.738981:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997153.739015:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712878464 00000100:00100000:0.0:1789997153.739025:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712878464 00000100:00100000:0.0:1789997153.739096:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1789997153.739106:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712878464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997153.739138:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997153.739189:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712878464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997153.739196:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00080000:0.0:1789997153.739216:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997153.739245:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712878464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997153.740178:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997153.740190:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712878592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997153.740232:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997153.740509:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712878592 00000100:00100000:0.0:1789997153.740516:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712878592 00000100:00100000:0.0:1789997153.740568:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1789997153.740577:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712878592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997153.740602:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997153.740683:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712878592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997153.740701:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1789997153.740741:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:0.0:1789997153.740746:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38f9b47100, transno 4294967328 00000100:00100000:0.0:1789997153.740761:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712878592:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997153.741192:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997154.059025:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997155.083047:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997156.109683:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997156.810970:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712878976:0@lo:400:kworker.0 00000100:00100000:0.0:1789997156.811042:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997156.811116:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997156.811123:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712879104:0@lo:400:kworker.0 00000100:00100000:0.0:1789997156.811151:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997156.811184:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712879104 00000100:00100000:0.0:1789997156.811192:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712879104 00000100:00100000:0.0:1789997156.811259:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1789997156.811271:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712879104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997156.811330:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712879104:12345-0@lo:400:kworker.0 Request processed in 62us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997156.811338:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00080000:0.0:1789997156.811362:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997156.811364:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712878720:0@lo:400:kworker.0 00000100:00100000:0.0:1789997156.811397:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712879104:0@lo:400:kworker.0 00000100:00100000:0.0:1789997156.811446:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712878976 00000100:00100000:0.0:1789997156.811451:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712878976 00000100:00100000:0.0:1789997156.811485:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:0.0:1789997156.811492:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712878976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997156.812320:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997156.812357:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712879232:0@lo:400:kworker.0 00000100:00100000:2.0:1789997156.812386:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997156.812412:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789997156.812419:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712878848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997156.812441:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997156.812460:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712879360:0@lo:400:kworker.0 00000100:00100000:2.0:1789997156.812481:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997156.812521:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712878720 00000100:00100000:2.0:1789997156.812526:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712878720 00000100:00100000:2.0:1789997156.812559:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1789997156.812567:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712878720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997156.812568:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712878848 00000100:00100000:1.0:1789997156.812572:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712878848 00000100:00100000:1.0:1789997156.812595:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712879360 00000100:00100000:1.0:1789997156.812598:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712879360 00000100:00100000:2.0:1789997156.812604:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712878720:12345-0@lo:400:kworker.0 Request processed in 38us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997156.812610:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1789997156.812618:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1789997156.812624:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712878848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997156.812650:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1789997156.812672:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712879360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997156.812684:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712878848:12345-0@lo:400:kworker.0 Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997156.812690:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1789997156.812696:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712879360:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997156.812701:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00080000:1.0:1789997156.812708:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997156.812884:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712878848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997156.812896:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712879360:0@lo:400:kworker.0 00000100:00100000:2.0:1789997156.812904:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712878720:0@lo:400:kworker.0 00000100:00100000:3.0:1789997156.813194:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712879232 00000100:00100000:3.0:1789997156.813199:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712879232 00000100:00100000:3.0:1789997156.813235:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:3.0:1789997156.813242:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712879232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997156.813481:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712879232:12345-0@lo:400:kworker.0 Request processed in 239us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997156.813488:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:3.0:1789997156.813511:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997156.813623:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712879232:0@lo:400:kworker.0 00000100:00100000:0.0:1789997156.814867:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712878976:12345-0@lo:400:kworker.0 Request processed in 3371us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997156.814878:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1789997156.814979:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712878976:0@lo:400:kworker.0 00010000:00010000:1.0:1789997157.132927:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997158.157542:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997158.683022:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997158.683240:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997158.683366:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997158.683381:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704364800 00000100:00100000:0.0:1789997158.683393:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704364800 00000100:00100000:1.0:1789997158.683427:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997158.683458:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 860 00000100:00100000:1.0:1789997158.683461:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704365184 00000100:00100000:1.0:1789997158.683467:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704365184 00000100:00100000:0.0:1789997158.683473:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704364800:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997158.683511:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704365056 00000100:00100000:1.0:1789997158.683514:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704365056 00000100:00100000:1.0:1789997158.683537:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 542 00000100:00100000:0.0:1789997158.683557:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704364800:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 88us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997158.683569:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 860 00000100:00100000:1.0:1789997158.683575:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704365184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997158.683625:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704365184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 53us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997158.683631:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 542 00000100:00100000:1.0:1789997158.683647:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 543 00000100:00100000:1.0:1789997158.683686:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704365056:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997158.683713:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704365056:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 59us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997158.683719:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 543 00000100:00080000:3.0:1789997158.683992:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997158.683997:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997158.686836:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704364928 00000100:00100000:2.0:1789997158.686854:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704364928 00000100:00100000:2.0:1789997158.687015:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 968 00000100:00100000:2.0:1789997158.687026:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704364928:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997158.687136:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704364928:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 111us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997158.687144:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 968 00000100:00080000:3.0:1789997158.689757:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997158.858912:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997158.858951:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712879488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997158.859027:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997158.859229:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712879488 00000100:00100000:0.0:1789997158.859238:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712879488 00000100:00100000:0.0:1789997158.859318:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1789997158.859329:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712879488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997158.859365:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997158.859408:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712879488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997158.859415:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1789997158.859486:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997158.859498:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712879616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997158.859532:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789997158.859576:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997158.859708:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712879616 00000100:00100000:0.0:1789997158.859712:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712879616 00000100:00100000:0.0:1789997158.859759:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1789997158.859767:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712879616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997158.859788:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997158.859845:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712879616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997158.859852:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1789997158.859910:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712879616:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997158.860028:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997158.860377:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712879488:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997159.184835:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997160.204992:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997161.226984:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997161.931596:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712879872:0@lo:400:kworker.0 00000100:00100000:1.0:1789997161.931695:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997161.931764:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712880384:0@lo:400:kworker.0 00000100:00100000:1.0:1789997161.931789:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997161.931812:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789997161.931818:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712879744:0@lo:400:kworker.0 00000100:00100000:1.0:1789997161.931846:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997161.931867:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712880256:0@lo:400:kworker.0 00000100:00100000:0.0:1789997161.932211:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712880000:0@lo:400:kworker.0 00000100:00100000:0.0:1789997161.932242:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997161.932263:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997161.932269:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712880128:0@lo:400:kworker.0 00000100:00100000:0.0:1789997161.932290:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997161.932320:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712879872 00000100:00100000:0.0:1789997161.932328:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712879872 00000100:00100000:0.0:1789997161.932825:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712880384 00000100:00100000:0.0:1789997161.932830:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712880384 00000100:00100000:0.0:1789997161.932858:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712880000 00000100:00100000:0.0:1789997161.932860:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712880000 00000100:00100000:3.0:1789997161.933023:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1789997161.933037:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712879872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997161.933099:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712879872:12345-0@lo:400:kworker.0 Request processed in 65us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997161.933107:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1789997161.933126:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1789997161.933133:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712880384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997161.933209:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712880384:12345-0@lo:400:kworker.0 Request processed in 28us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997161.933217:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1789997161.933229:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1789997161.933235:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712880000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997161.933267:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712880000:12345-0@lo:400:kworker.0 Request processed in 33us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997161.933272:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1789997161.933273:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712879744 00000100:00100000:2.0:1789997161.933279:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712879744 00000100:00100000:3.0:1789997161.933288:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712880128 00000100:00100000:3.0:1789997161.933291:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712880128 00000100:00100000:2.0:1789997161.933306:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1789997161.933312:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712879744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997161.933314:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1789997161.933319:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712880128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997161.933345:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712879744:12345-0@lo:400:kworker.0 Request processed in 33us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997161.933351:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00080000:2.0:1789997161.933375:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997161.933380:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997161.933634:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712880000:0@lo:400:kworker.0 00000100:00100000:0.0:1789997161.933751:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712880128:0@lo:400:kworker.0 00000100:00100000:3.0:1789997161.934405:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712880128:12345-0@lo:400:kworker.0 Request processed in 375us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997161.934414:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1789997161.934580:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997161.934619:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712879872:0@lo:400:kworker.0 00000100:00100000:1.0:1789997161.934629:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712880384:0@lo:400:kworker.0 00000100:00100000:1.0:1789997161.934647:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712879744:0@lo:400:kworker.0 00000100:00100000:1.0:1789997161.934705:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712880256 00000100:00100000:1.0:1789997161.934710:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712880256 00000100:00080000:0.0:1789997161.934805:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997161.937923:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1789997161.937948:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712880256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997161.938060:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712880256:12345-0@lo:400:kworker.0 Request processed in 125us (3480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997161.938068:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1789997161.938136:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712880256:0@lo:400:kworker.0 00010000:00010000:0.0:1789997162.250887:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997163.276108:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997163.801840:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997163.801887:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997163.801990:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997163.802246:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704365440 00000100:00100000:2.0:1789997163.802259:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704365440 00000100:00100000:2.0:1789997163.802335:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 972 00000100:00100000:2.0:1789997163.802346:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704365440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997163.802432:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704365440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997163.802441:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 972 00000100:00100000:1.0:1789997163.802857:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704365312 00000100:00100000:1.0:1789997163.802862:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704365312 00000100:00100000:1.0:1789997163.802895:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 862 00000100:00100000:1.0:1789997163.802902:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704365312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997163.802936:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704365312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997163.802943:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 862 00000100:00080000:0.0:1789997163.803140:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997163.804711:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704365568 00000100:00100000:3.0:1789997163.804722:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704365568 00000100:00100000:3.0:1789997163.804796:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 546 00000100:00100000:3.0:1789997163.804806:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704365568:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1789997163.804849:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997163.804866:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704365568:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 61us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997163.804875:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 546 00000100:00100000:2.0:1789997163.804924:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997163.805206:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704365696 00000100:00100000:1.0:1789997163.805212:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704365696 00000100:00100000:1.0:1789997163.805257:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 547 00000100:00100000:1.0:1789997163.805264:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704365696:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997163.805301:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704365696:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997163.805307:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 547 00000100:00080000:2.0:1789997163.805885:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997163.979058:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712880512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997163.979132:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997163.979374:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997163.979382:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712880640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997163.979411:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997163.979454:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712880512 00000100:00100000:2.0:1789997163.979461:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712880512 00000100:00100000:0.0:1789997163.979505:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712880640 00000100:00100000:0.0:1789997163.979512:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712880640 00000100:00080000:3.0:1789997163.979517:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997163.979524:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997163.979539:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1789997163.979550:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712880512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997163.979583:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997163.979690:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712880512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997163.979697:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1789997163.979714:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1789997163.979721:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712880640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997163.979741:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997163.979772:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712880640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997163.979777:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1789997163.980218:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712880640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997163.980235:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712880512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997164.299427:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997164.512355:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997164.512801:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704365824 00000100:00100000:3.0:1789997164.512811:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704365824 00000100:00100000:3.0:1789997164.512868:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 513 00000100:00100000:3.0:1789997164.512877:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38770:x1876946704365824:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997164.512977:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38770:x1876946704365824:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 101us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997164.512984:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 513 00000100:00100000:0.0:1789997164.519318:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997164.519560:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704365952 00000100:00100000:3.0:1789997164.519572:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704365952 00000100:00100000:3.0:1789997164.519638:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 265 00000100:00100000:3.0:1789997164.519650:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38770:x1876946704365952:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997164.520168:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38770:x1876946704365952:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 519us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997164.520176:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 265 00000100:00100000:1.0:1789997164.522578:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997164.522679:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704366080 00000100:00100000:2.0:1789997164.522688:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704366080 00000100:00100000:2.0:1789997164.522849:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 266 00000100:00100000:2.0:1789997164.522861:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38770:x1876946704366080:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997164.523248:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38770:x1876946704366080:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 388us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997164.523256:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 266 00000100:00100000:2.0:1789997164.526019:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997164.526123:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704366208 00000100:00100000:0.0:1789997164.526132:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704366208 00000100:00100000:0.0:1789997164.526189:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 514 00000100:00100000:0.0:1789997164.526198:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38770:x1876946704366208:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997164.526646:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38770:x1876946704366208:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 447us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997164.526681:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 514 00000100:00100000:0.0:1789997164.546860:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997164.547007:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704366336 00000100:00100000:3.0:1789997164.547019:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704366336 00000100:00100000:3.0:1789997164.547081:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 515 00000100:00100000:3.0:1789997164.547092:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38770:x1876946704366336:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997164.549917:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38770:x1876946704366336:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 2812us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997164.549931:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 515 00000100:00100000:1.0:1789997164.567552:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997164.567681:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704366464 00000100:00100000:3.0:1789997164.567691:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704366464 00000100:00100000:3.0:1789997164.567756:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 267 00000100:00100000:3.0:1789997164.567768:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38770:x1876946704366464:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997164.568159:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38770:x1876946704366464:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 392us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997164.568167:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 267 00000100:00100000:1.0:1789997164.571249:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997164.571338:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704366592 00000100:00100000:3.0:1789997164.571352:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704366592 00000100:00100000:3.0:1789997164.571453:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 268 00000100:00100000:3.0:1789997164.571464:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38770:x1876946704366592:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997164.571956:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:38770:x1876946704366592:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 493us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997164.571964:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 268 00000100:00100000:0.0:1789997164.576503:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997164.576680:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704366720 00000100:00100000:3.0:1789997164.576824:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704366720 00000100:00100000:2.0:1789997164.576984:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 516 00000100:00100000:2.0:1789997164.576997:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38770:x1876946704366720:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997164.577954:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38770:x1876946704366720:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 958us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997164.577964:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 516 00000100:00100000:1.0:1789997164.613949:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997164.614089:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704366848 00000100:00100000:0.0:1789997164.614101:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704366848 00000100:00100000:0.0:1789997164.614164:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 517 00000100:00100000:0.0:1789997164.614175:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:38771:x1876946704366848:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997164.614195:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997164.614220:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b7e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae92a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997164.614286:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b7e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997164.614300:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997164.614314:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997164.614353:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00000004:00200000:0.0:1789997164.614357:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997164.614375:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997164.614400:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b7e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae92a expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997164.614433:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae92a expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997164.614442:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:0.0:1789997164.614444:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997164.614449:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997164.614524:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38771:x1876946704366848:12345-192.168.204.4@tcp:101:rm.0 Request processed in 350us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997164.614533:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 517 00000100:00100000:1.0:1789997164.619438:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997164.623186:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704367104 00000100:00100000:2.0:1789997164.623201:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704367104 00000100:00100000:2.0:1789997164.623300:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 518 00000100:00100000:2.0:1789997164.623310:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38771:x1876946704367104:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997164.623332:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997164.623356:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b7ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae931 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997164.623447:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x25:0x0]: returning size 16384 00010000:00010000:2.0:1789997164.625855:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b7ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae931 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997164.625876:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997164.625878:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789997164.625883:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592b7ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae931 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997164.625900:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997164.625965:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:38771:x1876946704367104:12345-192.168.204.4@tcp:101:rm.0 Request processed in 2655us (6536us total) trans 4294967497 rc 301/301 00000100:00100000:2.0:1789997164.625974:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 518 00000100:00100000:3.0:1789997164.641454:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997164.641514:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704367232 00000100:00100000:3.0:1789997164.641526:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704367232 00000100:00100000:3.0:1789997164.641589:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:3.0:1789997164.641601:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:38771:x1876946704367232:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:3.0:1789997164.650796:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:38771:x1876946704367232:12345-192.168.204.4@tcp:37:rm.0 Request processed in 9184us (9338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997164.650808:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 56 00000100:00100000:1.0:1789997164.659419:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997164.659564:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704367488 00000100:00100000:3.0:1789997164.659576:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704367488 00000100:00100000:3.0:1789997164.659635:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:3.0:1789997164.659646:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de236450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:38771:x1876946704367488:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:3.0:1789997164.659965:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de236450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:38771:x1876946704367488:12345-192.168.204.4@tcp:35:rm.0 Request processed in 319us (555us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789997164.659973:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 57 00000100:00100000:3.0:1789997164.665695:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997164.665821:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704367744 00000100:00100000:1.0:1789997164.665831:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704367744 00000100:00100000:1.0:1789997164.665884:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 519 00000100:00100000:1.0:1789997164.665894:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:38771:x1876946704367744:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997164.665945:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789997164.665968:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592b7e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae92a expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666006:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592b78c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae915 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666016:0:11799:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b3f0) 00010000:00010000:1.0:1789997164.666020:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997164.666030:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997164.666053:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666066:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666076:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666098:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666105:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666267:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666602:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666611:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666618:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666646:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666690:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.666697:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667838:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997164.667844:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667853:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667865:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:1.0:1789997164.667868:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997164.667873:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667888:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b80a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667909:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667915:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667922:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667927:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997164.667930:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667935:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667942:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:1.0:1789997164.667944:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997164.667947:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667952:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b7fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667960:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667966:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667976:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.667981:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997164.667984:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.668418:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.668427:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8a38e062de00) 00010000:00010000:1.0:1789997164.668429:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997164.668433:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997164.668439:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b803 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997164.668542:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:38771:x1876946704367744:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2645us (2850us total) trans 0 rc -13/-13 00000100:00100000:1.0:1789997164.668551:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 519 00010000:00010000:0.0:1789997165.324511:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997165.879011:0:65832:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9ece7380 20000000:00000080:0.0:1789997165.879029:0:65832:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e4c00 uarg=0000000000000000 00010000:00010000:0.0:1789997165.881560:0:65832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997165.881582:0:65832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997165.881627:0:65832:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997165.881646:0:65832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997165.881884:0:65832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b769 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997165.881893:0:65832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997165.881936:0:65832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b769 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997165.881952:0:65832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b769 expref: 18 pid: 7594 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997165.881966:0:65832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65832:1876946712880768:0@lo:104: 00000100:00100000:0.0:1789997165.882029:0:65832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997165.882174:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712880768 00000100:00100000:3.0:1789997165.882182:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712880768 00000100:00100000:3.0:1789997165.882232:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789997165.882241:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:65832:x1876946712880768:12345-0@lo:104: 00010000:00010000:3.0:1789997165.882254:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997165.882293:0:65832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997165.882316:0:65832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65832:1876946712880768:0@lo:104: 00010000:00010000:3.0:1789997165.882331:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789997165.882333:0:65832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997165.882337:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:65832:x1876946712880768:12345-0@lo:104: Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997165.882356:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00010000:00010000:2.0:1789997165.882433:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997165.882440:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882448:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997165.882461:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882470:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997165.882476:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997165.882483:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997165.882517:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882523:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997165.882549:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882561:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b769 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b770 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882581:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997165.882583:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997165.882584:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997165.882592:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997165.882602:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712880896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997165.882633:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997165.882791:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712880896 00000100:00100000:2.0:1789997165.882795:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712880896 00010000:00010000:2.0:1789997165.882818:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b769 expref: 19 pid: 7594 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997165.882849:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789997165.882856:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712880896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997165.882866:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997165.882872:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b769 expref: 19 pid: 7594 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882882:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b769 expref: 19 pid: 7594 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882895:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b400/0x65b43101d592b770 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b769 expref: 19 pid: 7594 timeout: 1504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882908:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882916:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882934:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882941:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882948:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882954:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882960:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997165.882964:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882971:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.882993:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997165.883002:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997165.883113:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712880896:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997165.883120:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00010000:00010000:1.0:1789997165.883193:0:65832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997165.883202:0:65832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997165.883209:0:65832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b811 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997165.883263:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712880896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997166.346925:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997166.702151:0:65880:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca21d2ac0 20000000:00000080:3.0:1789997166.702169:0:65880:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c85ad000 uarg=0000000000000000 00010000:00010000:3.0:1789997166.702590:0:65880:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997166.702609:0:65880:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997166.702630:0:65880:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997166.702649:0:65880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703048:0:65880:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703061:0:65880:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703067:0:65880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703073:0:65880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703080:0:65880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703086:0:65880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997166.703090:0:65880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703097:0:65880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703116:0:65880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703124:0:65880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997166.703130:0:65880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b818 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997167.052688:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712881408:0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.052754:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997167.052810:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712881024:0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.052821:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712881280:0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.052859:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997167.052878:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789997167.052883:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712881152:0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.052904:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997167.052918:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712881664:0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.052932:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997167.053216:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712881408 00000100:00100000:0.0:1789997167.053225:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712881408 00000100:00100000:0.0:1789997167.053273:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1789997167.053282:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712881408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.053334:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712881408:12345-0@lo:400:kworker.0 Request processed in 53us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997167.053341:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:0.0:1789997167.053363:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712881280 00000100:00100000:0.0:1789997167.053367:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712881280 00000100:00100000:0.0:1789997167.053392:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712881152 00000100:00100000:0.0:1789997167.053394:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712881152 00000100:00100000:0.0:1789997167.053410:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712881664 00000100:00100000:0.0:1789997167.053413:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712881664 00000100:00100000:0.0:1789997167.053444:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1789997167.053451:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712881280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.053488:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712881280:12345-0@lo:400:kworker.0 Request processed in 37us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997167.053494:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1789997167.053506:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:0.0:1789997167.053511:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712881152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.053540:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712881152:12345-0@lo:400:kworker.0 Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997167.053546:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:0.0:1789997167.053557:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1789997167.053563:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712881664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.053589:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712881664:12345-0@lo:400:kworker.0 Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997167.053595:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1789997167.053646:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712881152:0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.053679:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712881664:0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.053688:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712881280:0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.053722:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712881408:0@lo:400:kworker.0 00000100:00100000:2.0:1789997167.053819:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997167.053849:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712881536:0@lo:400:kworker.0 00000100:00100000:2.0:1789997167.053937:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997167.053980:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712881024 00000100:00100000:2.0:1789997167.053984:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712881024 00000100:00100000:2.0:1789997167.054013:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1789997167.054019:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712881024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997167.054051:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712881024:12345-0@lo:400:kworker.0 Request processed in 32us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997167.054056:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1789997167.054286:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712881536 00000100:00100000:0.0:1789997167.054290:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712881536 00000100:00100000:0.0:1789997167.054325:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1789997167.054332:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712881536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997167.054364:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712881536:12345-0@lo:400:kworker.0 Request processed in 34us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997167.054369:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1789997167.054495:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712881024:0@lo:400:kworker.0 00000100:00100000:2.0:1789997167.054507:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712881536:0@lo:400:kworker.0 00000100:00080000:3.0:1789997167.054637:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997167.054642:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997167.054644:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997167.373432:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997167.423069:0:65928:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe72e5d340 20000000:00000080:0.0:1789997167.423088:0:65928:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c25000 uarg=0000000000000000 00010000:00010000:0.0:1789997167.423381:0:65928:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997167.423397:0:65928:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997167.423414:0:65928:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997167.423446:0:65928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423461:0:65928:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423471:0:65928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423477:0:65928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423484:0:65928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423491:0:65928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423496:0:65928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997167.423501:0:65928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423509:0:65928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423522:0:65928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423530:0:65928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997167.423540:0:65928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592b81f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997167.438331:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997167.438340:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997167.438346:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997167.438395:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997167.438408:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997167.438431:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997167.438458:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712881792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997167.438529:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997167.438641:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997167.442324:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712881792 00000100:00100000:2.0:1789997167.442341:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712881792 00000100:00100000:1.0:1789997167.442522:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1789997167.442534:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712881792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997167.442550:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997167.442570:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b826 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997167.442598:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b826 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997167.442608:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b826 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997167.442618:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997167.442729:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712881792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997167.442735:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1789997167.444614:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712881792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997167.444642:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997167.444680:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997167.445052:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997167.445059:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997167.445068:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997168.394880:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997168.919321:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997168.919360:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997168.919426:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997168.919451:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997168.919479:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704368128 00000100:00100000:3.0:1789997168.919490:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704368128 00000100:00100000:3.0:1789997168.919542:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704368256 00000100:00100000:3.0:1789997168.919545:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704368256 00000100:00100000:3.0:1789997168.919571:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 550 00000100:00100000:3.0:1789997168.919581:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997168.919647:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997168.919671:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 550 00000100:00100000:3.0:1789997168.919690:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 551 00000100:00100000:3.0:1789997168.919696:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997168.919721:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997168.919727:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 551 00000100:00080000:3.0:1789997168.919750:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997168.919754:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997168.920010:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704367872 00000100:00100000:2.0:1789997168.920015:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704367872 00000100:00100000:2.0:1789997168.920051:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 865 00000100:00100000:2.0:1789997168.920059:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704367872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997168.920093:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704367872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997168.920099:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 865 00000100:00100000:0.0:1789997168.922208:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704368000 00000100:00100000:0.0:1789997168.922218:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704368000 00000100:00100000:0.0:1789997168.922289:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 976 00000100:00100000:0.0:1789997168.922299:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704368000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997168.922373:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704368000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (2946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997168.922380:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 976 00000100:00080000:2.0:1789997168.923145:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997169.099844:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712881920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997169.099920:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997169.100207:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712882048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997169.100245:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997169.100307:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712881920 00000100:00100000:1.0:1789997169.100315:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712881920 00000100:00100000:1.0:1789997169.100370:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712882048 00000100:00100000:1.0:1789997169.100374:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712882048 00000100:00100000:1.0:1789997169.100411:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1789997169.100423:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712881920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997169.100457:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997169.100475:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1789997169.100485:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712882048:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997169.100634:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712881920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997169.100641:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00080000:1.0:1789997169.100679:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997169.100682:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997169.100719:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712881920:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997169.101912:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997169.102243:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712882048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1757us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997169.102251:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1789997169.102469:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712882048:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789997169.155029:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967497 is committed 00000001:00080000:3.0:1789997169.155113:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00010000:00010000:0.0:1789997169.419851:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997170.442869:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997170.838203:0:66125:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff503e1170 20000000:00000080:0.0:1789997170.838220:0:66125:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c25800 uarg=0000000000000000 00010000:00010000:0.0:1789997170.838729:0:66125:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997170.838745:0:66125:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997170.838762:0:66125:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997170.838783:0:66125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997170.838800:0:66125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b826 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997170.838808:0:66125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997170.838850:0:66125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b826 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997170.838870:0:66125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b826 expref: 18 pid: 5805 timeout: 1509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997170.838884:0:66125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66125:1876946712882176:0@lo:104: 00000100:00100000:0.0:1789997170.838948:0:66125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997170.839006:0:66125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c12540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997170.839239:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712882176 00000100:00100000:1.0:1789997170.839247:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712882176 00000100:00100000:1.0:1789997170.839298:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789997170.839307:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:66125:x1876946712882176:12345-0@lo:104: 00010000:00010000:1.0:1789997170.839320:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997170.839404:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997170.839420:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:66125:x1876946712882176:12345-0@lo:104: Request processed in 114us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997170.839427:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789997170.839535:0:66125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66125:1876946712882176:0@lo:104: 00010000:00010000:3.0:1789997170.839560:0:66125:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.839702:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997170.839709:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.839718:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997170.839722:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.839730:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997170.839737:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997170.839743:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997170.839779:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.839786:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997170.839817:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.839825:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592b826 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b82d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997170.839829:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712882304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997170.839859:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997170.839863:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997170.839865:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997170.839870:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997170.839896:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712882304 00000100:00100000:3.0:1789997170.839901:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712882304 00010000:00010000:3.0:1789997170.839926:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b826 expref: 19 pid: 5805 timeout: 1509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997170.839961:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789997170.839969:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712882304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997170.839979:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997170.839984:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b826 expref: 19 pid: 5805 timeout: 1509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.839995:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b826 expref: 19 pid: 5805 timeout: 1509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840008:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592b82d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b826 expref: 19 pid: 5805 timeout: 1509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840021:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840030:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840043:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840062:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840069:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840076:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840082:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997170.840086:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840094:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840114:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997170.840123:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997170.840146:0:66125:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997170.840156:0:66125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997170.840163:0:66125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592b834 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997170.840170:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712882304:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997170.840179:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789997170.840550:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712882304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997171.471335:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997172.174795:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712882560:0@lo:400:kworker.0 00000100:00100000:1.0:1789997172.174869:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997172.174915:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712883072:0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.175052:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712882432:0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.175088:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997172.175113:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712882944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.175139:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997172.175177:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712882944 00000100:00100000:2.0:1789997172.175186:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712882944 00000100:00100000:2.0:1789997172.175241:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1789997172.175249:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712882944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.175299:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712882944:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997172.175306:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1789997172.175370:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712882944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.175410:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712882816:0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.175433:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997172.175454:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997172.175459:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712882688:0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.175480:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712882816 00000100:00100000:2.0:1789997172.175484:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712882816 00000100:00100000:2.0:1789997172.175508:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1789997172.175513:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712882816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.175546:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712882816:12345-0@lo:400:kworker.0 Request processed in 33us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997172.175551:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:1.0:1789997172.176036:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997172.176075:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712882432 00000100:00100000:1.0:1789997172.176080:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712882432 00000100:00100000:1.0:1789997172.176105:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1789997172.176111:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712882432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997172.176150:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712882432:12345-0@lo:400:kworker.0 Request processed in 38us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997172.176156:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00080000:1.0:1789997172.176181:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997172.176185:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997172.176206:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712882432:0@lo:400:kworker.0 00000100:00100000:0.0:1789997172.176373:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712882560 00000100:00100000:0.0:1789997172.176378:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712882560 00000100:00100000:0.0:1789997172.176405:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712883072 00000100:00100000:0.0:1789997172.176408:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712883072 00000100:00100000:0.0:1789997172.176435:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1789997172.176441:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712882560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997172.176483:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712882560:12345-0@lo:400:kworker.0 Request processed in 42us (1614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997172.176490:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1789997172.176504:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1789997172.176511:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712883072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997172.176539:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712883072:12345-0@lo:400:kworker.0 Request processed in 29us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997172.176545:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00080000:0.0:1789997172.176647:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997172.176876:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712882560:0@lo:400:kworker.0 00000100:00100000:0.0:1789997172.176887:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712883072:0@lo:400:kworker.0 00000100:00100000:2.0:1789997172.177546:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997172.177605:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712882816:0@lo:400:kworker.0 00000100:00100000:0.0:1789997172.178186:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712882688 00000100:00100000:0.0:1789997172.178193:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712882688 00000100:00100000:0.0:1789997172.178233:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1789997172.178241:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712882688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997172.178299:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712882688:12345-0@lo:400:kworker.0 Request processed in 59us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997172.178306:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1789997172.178355:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712882688:0@lo:400:kworker.0 00000100:00080000:1.0:1789997172.178484:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789997172.501044:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997172.554732:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997172.554740:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997172.554744:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997172.554796:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997172.554808:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997172.554821:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997172.554847:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712883200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997172.554914:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997172.554971:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee4cba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789997172.555039:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712883200 00000100:00100000:2.0:1789997172.555048:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712883200 00000100:00100000:2.0:1789997172.555099:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1789997172.555109:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712883200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997172.555132:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997172.555146:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b83b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997172.555168:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b83b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997172.555180:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b83b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997172.555190:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789997172.555239:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712883200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997172.555246:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1789997172.555532:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712883200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997172.555547:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997172.555557:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997172.555574:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997172.555579:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997172.555587:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997173.514782:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997174.038266:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997174.038327:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997174.038362:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997174.038394:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997174.038429:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704368512 00000100:00100000:3.0:1789997174.038446:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704368512 00000100:00100000:3.0:1789997174.038509:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 980 00000100:00100000:3.0:1789997174.038521:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368512:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997174.038675:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704368640 00000100:00100000:0.0:1789997174.038683:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704368640 00000100:00100000:3.0:1789997174.038707:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368512:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 187us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997174.038716:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 980 00000100:00100000:0.0:1789997174.038802:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704368768 00000100:00100000:0.0:1789997174.038806:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704368768 00000100:00100000:0.0:1789997174.038834:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 554 00000100:00100000:0.0:1789997174.038843:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997174.038873:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997174.038880:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 554 00000100:00100000:0.0:1789997174.038894:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 555 00000100:00100000:0.0:1789997174.038899:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997174.038920:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704368768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 21us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997174.038926:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 555 00000100:00100000:1.0:1789997174.039006:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704368384 00000100:00100000:1.0:1789997174.039012:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704368384 00000100:00100000:1.0:1789997174.039052:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 868 00000100:00100000:1.0:1789997174.039062:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704368384:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997174.039099:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704368384:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997174.039105:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 868 00000100:00080000:1.0:1789997174.039132:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997174.039136:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997174.039138:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997174.219868:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997174.219894:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712883328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997174.219963:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997174.220032:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712883328 00000100:00100000:3.0:1789997174.220039:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712883328 00000100:00100000:3.0:1789997174.220107:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1789997174.220117:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712883328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997174.220150:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997174.220194:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712883328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997174.220201:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00080000:3.0:1789997174.220224:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997174.220256:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712883328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997174.224236:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712883456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997174.224313:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997174.224387:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712883456 00000100:00100000:0.0:1789997174.224395:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712883456 00000100:00100000:0.0:1789997174.224451:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:0.0:1789997174.224461:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712883456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997174.224493:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997174.224536:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712883456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997174.224543:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00080000:0.0:1789997174.224562:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997174.224614:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712883456:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997174.539919:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997175.564443:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997176.587408:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997177.293145:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712883584:0@lo:400:kworker.0 00000100:00100000:1.0:1789997177.293219:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997177.293278:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712884096:0@lo:400:kworker.0 00000100:00100000:1.0:1789997177.293305:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997177.293329:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789997177.293335:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712883712:0@lo:400:kworker.0 00000100:00100000:1.0:1789997177.293360:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997177.293376:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712884224:0@lo:400:kworker.0 00000100:00100000:1.0:1789997177.293397:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997177.293426:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712883584 00000100:00100000:1.0:1789997177.293435:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712883584 00000100:00100000:1.0:1789997177.293548:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1789997177.293559:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712883584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997177.293614:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712883584:12345-0@lo:400:kworker.0 Request processed in 56us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997177.293621:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1789997177.293719:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712883584:0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.293942:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712883840:0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.293978:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997177.294015:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997177.294021:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712883968:0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294044:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997177.294086:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712884096 00000100:00100000:0.0:1789997177.294091:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712884096 00000100:00100000:0.0:1789997177.294131:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712883968 00000100:00100000:0.0:1789997177.294134:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712883968 00000100:00100000:0.0:1789997177.294156:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1789997177.294162:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712884096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294201:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712884096:12345-0@lo:400:kworker.0 Request processed in 39us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997177.294207:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1789997177.294223:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1789997177.294242:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712883968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294275:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712883968:12345-0@lo:400:kworker.0 Request processed in 46us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997177.294280:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1789997177.294297:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712883712 00000100:00100000:0.0:1789997177.294301:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712883712 00000100:00100000:0.0:1789997177.294324:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712884224 00000100:00100000:0.0:1789997177.294327:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712884224 00000100:00100000:0.0:1789997177.294345:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712883840 00000100:00100000:0.0:1789997177.294347:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712883840 00000100:00100000:0.0:1789997177.294367:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1789997177.294374:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712883712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294403:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712883712:12345-0@lo:400:kworker.0 Request processed in 30us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997177.294409:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1789997177.294422:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1789997177.294428:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712884224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294455:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712884224:12345-0@lo:400:kworker.0 Request processed in 28us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997177.294461:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1789997177.294551:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1789997177.294570:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712883840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294601:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712883840:12345-0@lo:400:kworker.0 Request processed in 43us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997177.294609:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00080000:0.0:1789997177.294631:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997177.294636:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997177.294638:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997177.294696:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712883712:0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294707:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712884224:0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294716:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712884096:0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294746:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712883968:0@lo:400:kworker.0 00000100:00100000:0.0:1789997177.294755:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712883840:0@lo:400:kworker.0 00010000:00010000:1.0:1789997177.610880:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997178.634851:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789997178.691177:0:66470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 18: test nodemap mapped_noadmin fileops ========================================================== 09:26:17 (1789997177) 00000100:00100000:0.0:1789997179.162276:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997179.162318:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997179.162355:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997179.162376:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704369280 00000100:00100000:2.0:1789997179.162388:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704369280 00000100:00100000:0.0:1789997179.162438:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997179.162494:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704369024 00000100:00100000:1.0:1789997179.162498:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704369024 00000100:00100000:1.0:1789997179.162539:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 984 00000100:00100000:1.0:1789997179.162550:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704369024:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997179.162625:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704369024:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 77us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997179.162633:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 984 00000100:00100000:0.0:1789997179.162715:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704368896 00000100:00100000:0.0:1789997179.162720:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704368896 00000100:00100000:0.0:1789997179.162754:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 870 00000100:00100000:0.0:1789997179.162763:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704368896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997179.162783:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704369152 00000100:00100000:1.0:1789997179.162789:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704369152 00000100:00100000:0.0:1789997179.162803:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704368896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997179.162812:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 870 00000100:00100000:1.0:1789997179.162827:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 558 00000100:00100000:1.0:1789997179.162837:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704369280:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997179.162865:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704369280:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997179.162872:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 558 00000100:00100000:1.0:1789997179.162888:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 559 00000100:00100000:1.0:1789997179.162896:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704369152:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997179.162924:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704369152:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997179.162930:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 559 00000100:00080000:2.0:1789997179.163001:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997179.163006:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997179.163008:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997179.338796:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997179.338822:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712884352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997179.338893:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997179.339098:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712884352 00000100:00100000:0.0:1789997179.339106:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712884352 00000100:00100000:0.0:1789997179.339160:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:0.0:1789997179.339169:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712884352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997179.339215:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997179.339343:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712884352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997179.339351:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00080000:0.0:1789997179.339373:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997179.339416:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712884352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997179.340520:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712884480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997179.340566:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997179.341113:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712884480 00000100:00100000:3.0:1789997179.341119:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712884480 00000100:00080000:2.0:1789997179.341265:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997179.341533:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1789997179.341544:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712884480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997179.341578:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997179.341639:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712884480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997179.341645:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1789997179.341749:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712884480:0@lo:13:osp-pre-0-0.0 00000004:00000400:3.0:1789997179.527291:0:66518:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1789997179.533893:0:66518:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:0.0:1789997179.659844:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997180.253221:0:66566:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffeb0195e0 20000000:00000080:3.0:1789997180.253240:0:66566:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63a2000 uarg=0000000000000000 10000000:01000000:3.0:1789997180.253853:0:66566:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997180.253872:0:66566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997180.253889:0:66566:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b83b expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997180.253899:0:66566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997180.253938:0:66566:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b83b expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997180.253954:0:66566:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b83b expref: 18 pid: 5803 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997180.253969:0:66566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66566:1876946712884608:0@lo:104: 00000100:00100000:3.0:1789997180.254037:0:66566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997180.254092:0:66566:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997180.254316:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712884608 00000100:00100000:1.0:1789997180.254325:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712884608 00000100:00100000:1.0:1789997180.254384:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789997180.254395:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:66566:x1876946712884608:12345-0@lo:104: 00010000:00010000:1.0:1789997180.254407:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997180.254486:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997180.254493:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:66566:x1876946712884608:12345-0@lo:104: Request processed in 100us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997180.254500:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:00010000:0.0:1789997180.254678:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997180.254750:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.254760:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997180.254765:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.254773:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997180.254781:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997180.254787:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997180.254817:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.254823:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997180.254861:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.254873:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3800/0x65b43101d592b83b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b842 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.254892:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997180.254894:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997180.254896:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997180.254925:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997180.254940:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712884736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997180.254992:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997180.255591:0:66566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66566:1876946712884608:0@lo:104: 00000100:00100000:0.0:1789997180.255597:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712884736 00000100:00100000:0.0:1789997180.255601:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712884736 00010000:00010000:3.0:1789997180.255611:0:66566:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255624:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b83b expref: 19 pid: 5803 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997180.255682:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789997180.255760:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712884736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997180.255772:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997180.255778:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b83b expref: 19 pid: 5803 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255789:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b83b expref: 19 pid: 5803 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255804:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592b842 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b83b expref: 19 pid: 5803 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255817:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255825:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255843:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255851:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255858:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255865:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255870:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997180.255873:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255881:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255903:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.255913:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997180.255958:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712884736:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (966us total) trans 0 rc 0/0 00010000:00010000:3.0:1789997180.256020:0:66566:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997180.256028:0:66566:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997180.256035:0:66566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b849 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997180.256319:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789997180.256362:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712884736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997180.685015:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997180.886873:0:66614:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0fa104a0 20000000:00000080:0.0:1789997180.886892:0:66614:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e2c00 uarg=0000000000000000 10000000:01000000:0.0:1789997180.887473:0:66614:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997180.887496:0:66614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887513:0:66614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887524:0:66614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887532:0:66614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887539:0:66614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887548:0:66614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887555:0:66614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997180.887560:0:66614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887569:0:66614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887582:0:66614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887589:0:66614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997180.887601:0:66614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592b850 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789997181.597859:0:66662:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc4f428340 20000000:00000080:3.0:1789997181.597876:0:66662:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63a2000 uarg=0000000000000000 10000000:01000000:3.0:1789997181.598065:0:66662:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997181.598084:0:66662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598100:0:66662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598110:0:66662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598117:0:66662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598124:0:66662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598131:0:66662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598137:0:66662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997181.598157:0:66662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598166:0:66662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598178:0:66662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598185:0:66662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997181.598261:0:66662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b857 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997181.709557:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997182.222079:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997182.222087:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997182.222093:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997182.222146:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.222158:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.222170:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997182.222197:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712884864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997182.222264:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997182.222310:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60780 going to sleep for 11 seconds 00000100:00100000:0.0:1789997182.222330:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712884864 00000100:00100000:0.0:1789997182.222336:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712884864 00000100:00100000:0.0:1789997182.222380:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1789997182.222390:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712884864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997182.222403:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997182.222416:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b85e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.222437:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b85e expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.222449:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b85e expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.222459:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997182.222499:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712884864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997182.222506:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1789997182.222555:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712884864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997182.222571:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.222581:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997182.222599:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997182.222604:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.222613:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789997182.259570:0:66711:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc85d4d540 20000000:00000080:0.0:1789997182.259585:0:66711:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e2800 uarg=0000000000000000 10000000:01000000:0.0:1789997182.259775:0:66711:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997182.259794:0:66711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.259812:0:66711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b85e expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.259821:0:66711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.259860:0:66711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b85e expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997182.259874:0:66711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b85e expref: 18 pid: 5803 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997182.259888:0:66711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66711:1876946712884992:0@lo:104: 00000100:00100000:0.0:1789997182.260311:0:66711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997182.260386:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712884992 00000100:00100000:1.0:1789997182.260393:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712884992 00000100:00100000:0.0:1789997182.260420:0:66711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60780 going to sleep for 11 seconds 00000100:00100000:1.0:1789997182.260434:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789997182.260442:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:66711:x1876946712884992:12345-0@lo:104: 00010000:00010000:1.0:1789997182.260455:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.260521:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997182.260528:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:66711:x1876946712884992:12345-0@lo:104: Request processed in 86us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997182.260535:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789997182.260542:0:66711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66711:1876946712884992:0@lo:104: 00010000:00010000:0.0:1789997182.260559:0:66711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.260641:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997182.260649:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262114:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997182.262119:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262129:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997182.262146:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997182.262152:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997182.262198:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262205:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997182.262242:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262249:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b85e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b865 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262278:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997182.262280:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997182.262282:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997182.262287:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712885120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997182.262338:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997182.262426:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712885120 00000100:00100000:2.0:1789997182.262432:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712885120 00010000:00010000:2.0:1789997182.262457:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b85e expref: 19 pid: 5803 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997182.262492:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789997182.262500:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712885120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997182.262510:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997182.262515:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b85e expref: 19 pid: 5803 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262525:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b85e expref: 19 pid: 5803 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262538:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b865 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b85e expref: 19 pid: 5803 timeout: 1520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262553:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262562:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262578:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262585:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262593:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262600:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262610:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997182.262614:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262622:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262644:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997182.262681:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997182.262712:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712885120:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997182.262719:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789997182.262848:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712885120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997182.262893:0:66711:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.262902:0:66711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.262908:0:66711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592b86c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997182.412427:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712885248:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.412892:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997182.412972:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712885760:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.413021:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997182.413055:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789997182.413063:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712885376:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.413107:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997182.413141:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712885888:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.413171:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997182.413216:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712885504:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.413247:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997182.413281:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997182.413285:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712885376 00000100:00100000:1.0:1789997182.413291:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712885632:0@lo:400:kworker.0 00000100:00100000:3.0:1789997182.413302:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712885376 00000100:00100000:1.0:1789997182.413324:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997182.413378:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712885248 00000100:00100000:1.0:1789997182.413386:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712885248 00000100:00100000:3.0:1789997182.413389:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712885888 00000100:00100000:3.0:1789997182.413395:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712885888 00000100:00100000:3.0:1789997182.413444:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712885504 00000100:00100000:3.0:1789997182.413448:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712885504 00000100:00100000:1.0:1789997182.413459:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1789997182.413472:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712885248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997182.413488:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1789997182.413501:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712885376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.413546:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712885248:12345-0@lo:400:kworker.0 Request processed in 75us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997182.413557:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1789997182.413774:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712885760 00000100:00100000:1.0:1789997182.413782:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712885760 00000100:00100000:1.0:1789997182.413834:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712885632 00000100:00100000:1.0:1789997182.413838:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712885632 00000100:00100000:1.0:1789997182.413896:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1789997182.413911:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712885760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.413979:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712885760:12345-0@lo:400:kworker.0 Request processed in 75us (956us total) trans 0 rc 0/0 00000100:00080000:3.0:1789997182.413981:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997182.413991:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997182.413998:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00080000:3.0:1789997182.414001:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997182.414020:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1789997182.414032:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712885632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.414073:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712885632:12345-0@lo:400:kworker.0 Request processed in 45us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997182.414079:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1789997182.414103:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1789997182.414113:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712885888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.414163:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712885888:12345-0@lo:400:kworker.0 Request processed in 52us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997182.414169:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1789997182.414187:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1789997182.414195:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712885504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.414233:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712885504:12345-0@lo:400:kworker.0 Request processed in 39us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997182.414240:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1789997182.414291:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712885376:12345-0@lo:400:kworker.0 Request processed in 787us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997182.414303:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1789997182.414341:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712885376:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.414364:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712885888:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.414376:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712885248:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.414387:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712885760:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.414582:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712885632:0@lo:400:kworker.0 00000100:00100000:1.0:1789997182.414596:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712885504:0@lo:400:kworker.0 00010000:00010000:1.0:1789997182.730912:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997182.871369:0:66759:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffece481ff0 20000000:00000080:1.0:1789997182.871387:0:66759:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4dfe400 uarg=0000000000000000 10000000:01000000:1.0:1789997182.871590:0:66759:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997182.871612:0:66759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.871629:0:66759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.871640:0:66759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.871646:0:66759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.871675:0:66759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.871684:0:66759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.871691:0:66759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997182.871695:0:66759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.871704:0:66759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.872018:0:66759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.872029:0:66759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997182.872036:0:66759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b873 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789997183.550398:0:66807:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0bfd6a20 20000000:00000080:2.0:1789997183.550414:0:66807:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faaf3800 uarg=0000000000000000 10000000:01000000:2.0:1789997183.550608:0:66807:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997183.550629:0:66807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550645:0:66807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550921:0:66807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550929:0:66807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550936:0:66807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550943:0:66807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550949:0:66807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997183.550954:0:66807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550971:0:66807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550991:0:66807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.550999:0:66807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997183.551011:0:66807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592b87a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997183.755834:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997184.268516:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997184.268524:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997184.268528:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997184.268575:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997184.268587:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997184.268598:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997184.268629:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712886016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997184.268716:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997184.268760:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712886016 00000100:00100000:1.0:1789997184.268770:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712886016 00000100:00100000:2.0:1789997184.268787:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1789997184.268829:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:1.0:1789997184.268843:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712886016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997184.268858:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997184.268873:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b881 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997184.268897:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b881 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997184.268909:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b881 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997184.268919:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997184.268970:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712886016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997184.268977:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:2.0:1789997184.269897:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712886016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997184.269919:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997184.269930:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997184.269949:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997184.269955:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997184.269962:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997184.280610:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997184.280685:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997184.280723:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704369536 00000100:00100000:3.0:1789997184.280733:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704369536 00000100:00080000:2.0:1789997184.280784:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997184.280799:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 988 00000100:00100000:3.0:1789997184.280811:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704369536:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997184.280893:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704369536:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997184.280901:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 988 00000100:00100000:0.0:1789997184.281068:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704369408 00000100:00100000:0.0:1789997184.281074:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704369408 00000100:00100000:0.0:1789997184.281124:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 874 00000100:00100000:0.0:1789997184.281132:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704369408:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997184.281179:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704369408:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997184.281186:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 874 00000100:00100000:3.0:1789997184.287435:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997184.287482:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997184.287513:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704369664 00000100:00100000:1.0:1789997184.287523:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704369664 00000100:00080000:3.0:1789997184.287593:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997184.287596:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704369792 00000100:00100000:1.0:1789997184.287600:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704369792 00000100:00100000:1.0:1789997184.287640:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 269 00000100:00100000:1.0:1789997184.287650:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704369664:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:1.0:1789997184.287694:0:6656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592b59b 00000100:00080000:1.0:1789997184.287704:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a38fada8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789997184.287741:0:6656:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967328 00000100:00080000:3.0:1789997184.287765:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997184.288007:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704369664:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 358us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997184.288016:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 269 00000100:00100000:1.0:1789997184.288034:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 270 00000100:00100000:1.0:1789997184.288041:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704369792:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:1.0:1789997184.288054:0:6656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592af5f 00000100:00080000:1.0:1789997184.288059:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a38fadad800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789997184.288080:0:6656:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967328 00000100:00100000:1.0:1789997184.288247:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704369792:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 206us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997184.288254:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 270 00010000:00010000:1.0:1789997184.288289:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997184.288294:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997184.459322:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997184.459343:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712886144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997184.459408:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997184.459617:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712886144 00000100:00100000:0.0:1789997184.459626:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712886144 00000100:00100000:0.0:1789997184.459706:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1789997184.459716:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712886144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997184.459750:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997184.459801:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712886144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997184.459808:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:0.0:1789997184.459859:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712886144:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997184.459980:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997184.461725:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997184.461744:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712886272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997184.461802:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997184.462367:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712886272 00000100:00100000:3.0:1789997184.462375:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712886272 00000100:00100000:3.0:1789997184.462438:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1789997184.462448:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712886272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997184.462481:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997184.462788:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712886272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 341us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997184.462796:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1789997184.462856:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712886272:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997184.463195:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997184.781397:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997185.803812:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997185.906863:0:66955:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5e6305f0 20000000:00000080:3.0:1789997185.906883:0:66955:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c2dbec00 uarg=0000000000000000 10000000:01000000:3.0:1789997185.907900:0:66955:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997185.907924:0:66955:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997185.907942:0:66955:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b881 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997185.907959:0:66955:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997185.907997:0:66955:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b881 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997185.908014:0:66955:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b881 expref: 18 pid: 5803 timeout: 1524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997185.908028:0:66955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66955:1876946712886400:0@lo:104: 00000100:00100000:3.0:1789997185.908227:0:66955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997185.908361:0:66955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c133a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789997185.908512:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789997185.908527:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712886400 00000100:00100000:0.0:1789997185.908534:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712886400 00000100:00100000:0.0:1789997185.908620:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789997185.908629:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fae93050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:66955:x1876946712886400:12345-0@lo:104: 00010000:00010000:0.0:1789997185.908642:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997185.908747:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997185.908754:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fae93050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:66955:x1876946712886400:12345-0@lo:104: Request processed in 126us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997185.908762:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789997185.908870:0:66955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66955:1876946712886400:0@lo:104: 00010000:00010000:3.0:1789997185.908890:0:66955:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997185.908960:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997185.908975:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997185.908982:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997185.908986:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997185.908995:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997185.909002:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997185.909008:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997185.909075:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997185.909082:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997185.909113:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997185.909121:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592b881 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b888 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997185.909147:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997185.909149:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997185.909151:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997185.909159:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997185.909170:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712886528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997185.909203:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997185.909327:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712886528 00000100:00100000:2.0:1789997185.909332:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712886528 00010000:00010000:2.0:1789997185.909355:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b881 expref: 19 pid: 5803 timeout: 1524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997185.909386:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789997185.909394:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712886528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997185.909404:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997185.909410:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b881 expref: 19 pid: 5803 timeout: 1524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909422:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b881 expref: 19 pid: 5803 timeout: 1524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909436:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592b888 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b881 expref: 19 pid: 5803 timeout: 1524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909449:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909458:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909472:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909479:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909486:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909493:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909499:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997185.909503:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909512:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909534:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997185.909543:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997185.909558:0:66955:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997185.909567:0:66955:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997185.909573:0:66955:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b88f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66955 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997185.909587:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712886528:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997185.909596:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789997185.910553:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712886528:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789997186.646202:0:67003:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffdc0f9ec0 20000000:00000080:1.0:1789997186.646219:0:67003:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fabb4c00 uarg=0000000000000000 10000000:01000000:1.0:1789997186.646630:0:67003:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997186.646676:0:67003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646694:0:67003:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646705:0:67003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646711:0:67003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646718:0:67003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646726:0:67003:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646733:0:67003:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997186.646738:0:67003:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646746:0:67003:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646762:0:67003:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646770:0:67003:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997186.646785:0:67003:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592b896 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67003 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997186.826882:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997187.531160:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997187.531168:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997187.531174:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997187.531221:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997187.531239:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997187.531251:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997187.531278:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712886656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997187.531346:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997187.531402:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997187.533872:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712886656 00000100:00100000:2.0:1789997187.533884:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712886656 00000100:00100000:2.0:1789997187.533950:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1789997187.533962:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712886656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997187.533978:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997187.533997:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b89d expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997187.534025:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b89d expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997187.534049:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b89d expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997187.534066:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3000, rc 0) 00000100:00100000:2.0:1789997187.534143:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712886656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997187.534151:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1789997187.534216:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712886656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997187.534236:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997187.534250:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997187.534272:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997187.534278:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997187.534286:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997187.536755:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712886784:0@lo:400:kworker.0 00000100:00100000:1.0:1789997187.536830:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997187.536903:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712886912:0@lo:400:kworker.0 00000100:00100000:1.0:1789997187.536928:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997187.536963:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712886784 00000100:00100000:1.0:1789997187.536971:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712886784 00000100:00100000:1.0:1789997187.537011:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712886912 00000100:00100000:1.0:1789997187.537014:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712886912 00000100:00100000:1.0:1789997187.537062:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1789997187.537072:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712886784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997187.537124:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712886784:12345-0@lo:400:kworker.0 Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997187.537131:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1789997187.537146:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1789997187.537153:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712886912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997187.537184:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712886912:12345-0@lo:400:kworker.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997187.537191:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00080000:1.0:1789997187.537214:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997187.537259:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712886912:0@lo:400:kworker.0 00000100:00100000:3.0:1789997187.538797:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712887040:0@lo:400:kworker.0 00000100:00100000:3.0:1789997187.538857:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997187.538917:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712887296:0@lo:400:kworker.0 00000100:00100000:3.0:1789997187.538953:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997187.538989:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712886784:0@lo:400:kworker.0 00000100:00100000:3.0:1789997187.539008:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997187.539042:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712887168:0@lo:400:kworker.0 00000100:00100000:1.0:1789997187.540375:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712887296 00000100:00100000:1.0:1789997187.540386:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712887296 00000100:00100000:1.0:1789997187.540455:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1789997187.540466:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712887296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997187.540924:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712887296:12345-0@lo:400:kworker.0 Request processed in 460us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997187.540932:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00080000:1.0:1789997187.540961:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997187.541341:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712887040 00000100:00100000:2.0:1789997187.541347:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712887040 00000100:00100000:2.0:1789997187.541384:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:2.0:1789997187.541392:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712887040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997187.541437:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712887040:12345-0@lo:400:kworker.0 Request processed in 46us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997187.541443:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:3.0:1789997187.542274:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997187.542472:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712887296:0@lo:400:kworker.0 00000100:00100000:3.0:1789997187.542525:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712887040:0@lo:400:kworker.0 00000100:00100000:3.0:1789997187.542565:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712887168 00000100:00100000:3.0:1789997187.542570:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712887168 00000100:00100000:3.0:1789997187.542685:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1789997187.542694:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712887168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997187.542757:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712887168:12345-0@lo:400:kworker.0 Request processed in 65us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997187.542765:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00080000:3.0:1789997187.542785:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997187.542789:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997187.542807:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712887168:0@lo:400:kworker.0 00000001:00100000:1.0:1789997187.559672:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997187.559682:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a38fadac000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997187.559709:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38fadac000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:1.0:1789997187.559754:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38fada8800 for lustre-OST0000 00000001:00100000:0.0:1789997187.575544:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997187.575554:0:7614:0:(genops.c:885:class_export_put()) final put ffff8a38fadab800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:3.0:1789997187.575617:0:40741:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38fadab800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0001 00000020:00000080:3.0:1789997187.575687:0:40741:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38fadad800 for lustre-OST0001 00010000:00010000:2.0:1789997187.851065:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997188.877284:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997189.398565:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997189.398683:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704369920 00000100:00100000:1.0:1789997189.398693:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704369920 00000100:00100000:1.0:1789997189.398743:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 876 00000100:00100000:1.0:1789997189.398754:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704369920:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997189.398831:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704369920:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997189.398838:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 876 00000100:00100000:3.0:1789997189.400964:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997189.401127:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704370048 00000100:00100000:1.0:1789997189.401135:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704370048 00000100:00100000:1.0:1789997189.401333:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 992 00000100:00100000:1.0:1789997189.401345:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704370048:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997189.401429:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704370048:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997189.401437:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 992 00000100:00080000:3.0:1789997189.401500:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997189.579270:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712887424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997189.579341:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997189.579419:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712887424 00000100:00100000:3.0:1789997189.581019:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712887552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997189.581154:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712887424 00000100:00100000:0.0:1789997189.581224:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1789997189.581234:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712887424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997189.581268:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997189.581339:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712887424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997189.581346:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1789997189.581522:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789997189.581585:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997189.581612:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712887552 00000100:00100000:3.0:1789997189.581618:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712887552 00000100:00100000:3.0:1789997189.581650:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1789997189.581679:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712887552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997189.582134:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997189.582181:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712887552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 503us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997189.582188:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00080000:3.0:1789997189.582210:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997189.582253:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712887424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997189.584441:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712887552:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1789997189.644463:0:67202:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7be48050 20000000:00000080:1.0:1789997189.644488:0:67202:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fabb5000 uarg=0000000000000000 00010000:00010000:1.0:1789997189.645446:0:67202:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997189.645464:0:67202:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997189.645480:0:67202:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997189.645501:0:67202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.645520:0:67202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b89d expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.645528:0:67202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.645565:0:67202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b89d expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.645581:0:67202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b89d expref: 18 pid: 7594 timeout: 1528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997189.645595:0:67202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67202:1876946712887680:0@lo:104: 00000100:00100000:1.0:1789997189.645898:0:67202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997189.646001:0:67202:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789997189.646044:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712887680 00000100:00100000:3.0:1789997189.646053:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712887680 00000100:00100000:3.0:1789997189.646129:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789997189.646139:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:67202:x1876946712887680:12345-0@lo:104: 00010000:00010000:3.0:1789997189.646161:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997189.646229:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997189.646235:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:67202:x1876946712887680:12345-0@lo:104: Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997189.646242:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789997189.646311:0:67202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67202:1876946712887680:0@lo:104: 00010000:00010000:2.0:1789997189.646332:0:67202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.646700:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997189.646708:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.646717:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997189.646721:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.646732:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997189.646748:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997189.646754:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997189.646795:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.646802:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997189.646825:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.646833:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592b89d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8a4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.646858:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997189.646860:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997189.646862:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997189.646876:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712887808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997189.646914:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997189.646961:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712887808 00000100:00100000:1.0:1789997189.646966:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712887808 00010000:00010000:1.0:1789997189.647006:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b89d expref: 19 pid: 7594 timeout: 1528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997189.647032:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789997189.647040:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712887808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997189.647051:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997189.647057:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b89d expref: 19 pid: 7594 timeout: 1528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647074:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b89d expref: 19 pid: 7594 timeout: 1528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647089:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592b8a4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b89d expref: 19 pid: 7594 timeout: 1528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647103:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647111:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647125:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647133:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647141:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647148:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647234:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997189.647239:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647247:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647532:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997189.647543:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997189.647633:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712887808:12345-0@lo:103:ldlm_bl.0 Request processed in 585us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997189.647641:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00010000:2.0:1789997189.647834:0:67202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997189.647842:0:67202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997189.647854:0:67202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8ab lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997189.647942:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712887808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997189.898818:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997190.923064:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997191.117510:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997191.117518:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997191.117523:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997191.117568:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997191.117581:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997191.117593:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997191.117618:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712887936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997191.117756:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997191.117977:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997191.118001:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712887936 00000100:00100000:0.0:1789997191.118010:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712887936 00000100:00100000:0.0:1789997191.118060:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1789997191.118072:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712887936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997191.118085:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997191.118100:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b8b2 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997191.118125:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997191.118136:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997191.118145:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997191.118316:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712887936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997191.118323:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1789997191.118378:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712887936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997191.118394:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997191.118404:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997191.118425:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997191.118431:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997191.118438:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997191.947802:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997192.388061:0:67399:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef881e880 20000000:00000080:1.0:1789997192.388078:0:67399:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fabb5c00 uarg=0000000000000000 10000000:01000000:1.0:1789997192.388123:0:67399:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997192.388142:0:67399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997192.388169:0:67399:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997192.388177:0:67399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997192.388213:0:67399:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997192.388226:0:67399:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 18 pid: 7594 timeout: 1531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997192.388240:0:67399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67399:1876946712888064:0@lo:104: 00000100:00100000:1.0:1789997192.388296:0:67399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997192.388348:0:67399:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789997192.388551:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712888064 00000100:00100000:3.0:1789997192.388559:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712888064 00000100:00100000:3.0:1789997192.388598:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789997192.388607:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:67399:x1876946712888064:12345-0@lo:104: 00010000:00010000:3.0:1789997192.388620:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.388712:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997192.388720:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:67399:x1876946712888064:12345-0@lo:104: Request processed in 113us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997192.388727:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00010000:2.0:1789997192.388730:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997192.388739:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997192.388748:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997192.388752:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997192.388762:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997192.388769:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997192.388775:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997192.388814:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997192.388820:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997192.388842:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997192.388849:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592b8b2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8b9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997192.388862:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997192.388864:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997192.388866:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997192.388877:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712888192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997192.388906:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997192.388924:0:67399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67399:1876946712888064:0@lo:104: 00000100:00100000:3.0:1789997192.388976:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712888192 00000100:00100000:3.0:1789997192.388981:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712888192 00010000:00010000:3.0:1789997192.388998:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 19 pid: 7594 timeout: 1531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997192.389029:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789997192.389035:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712888192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997192.389044:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997192.389048:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 19 pid: 7594 timeout: 1531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389056:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 19 pid: 7594 timeout: 1531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389071:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592b8b9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b8b2 expref: 19 pid: 7594 timeout: 1531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389090:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389098:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389109:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389124:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389131:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389137:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389143:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997192.389147:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389154:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389162:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.389170:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997192.389197:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712888192:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997192.389204:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789997192.389377:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712888192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997192.389525:0:67399:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997192.389536:0:67399:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997192.389542:0:67399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997192.389548:0:67399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592b8c0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997192.652099:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712888320:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652164:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997192.652216:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712888832:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652240:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997192.652267:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997192.652286:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712888448:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652311:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997192.652343:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712888576:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652369:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997192.652395:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997192.652400:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712888704:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652420:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997192.652451:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712888320 00000100:00100000:3.0:1789997192.652458:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712888320 00000100:00100000:3.0:1789997192.652500:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712888832 00000100:00100000:3.0:1789997192.652504:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712888832 00000100:00100000:3.0:1789997192.652526:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712888448 00000100:00100000:3.0:1789997192.652529:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712888448 00000100:00100000:3.0:1789997192.652550:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1789997192.652558:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712888320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652608:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712888320:12345-0@lo:400:kworker.0 Request processed in 51us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997192.652616:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1789997192.652632:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1789997192.652639:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712888832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652686:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712888832:12345-0@lo:400:kworker.0 Request processed in 48us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997192.652691:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1789997192.652702:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1789997192.652707:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712888448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652734:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712888448:12345-0@lo:400:kworker.0 Request processed in 27us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997192.652748:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1789997192.652774:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712888576 00000100:00100000:3.0:1789997192.652779:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712888576 00000100:00100000:3.0:1789997192.652803:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712888704 00000100:00100000:3.0:1789997192.652806:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712888704 00000100:00100000:3.0:1789997192.652824:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1789997192.652830:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712888576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.652946:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712888576:12345-0@lo:400:kworker.0 Request processed in 116us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997192.652952:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:3.0:1789997192.652964:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1789997192.652970:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712888704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.653003:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712888704:12345-0@lo:400:kworker.0 Request processed in 33us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997192.653008:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00080000:3.0:1789997192.653032:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997192.653035:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997192.653038:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997192.653296:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712888704:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.653307:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712888576:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.653343:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712888448:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.653353:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712888320:0@lo:400:kworker.0 00000100:00100000:3.0:1789997192.653362:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712888832:0@lo:400:kworker.0 00000020:00000080:3.0:1789997192.939694:0:67447:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee122b1a0 20000000:00000080:3.0:1789997192.939717:0:67447:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4f07000 uarg=0000000000000000 10000000:01000000:3.0:1789997192.939764:0:67447:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997192.939785:0:67447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.939801:0:67447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.939812:0:67447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.939819:0:67447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.940046:0:67447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.940054:0:67447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.940060:0:67447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997192.940065:0:67447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.940074:0:67447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.940088:0:67447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.940096:0:67447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997192.940113:0:67447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b8c7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997192.971697:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997193.802716:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997193.802726:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997193.802735:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997193.802778:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997193.802791:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997193.802803:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997193.802842:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712888960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997193.802998:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997193.803068:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789997193.803374:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712888960 00000100:00100000:0.0:1789997193.803381:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712888960 00000100:00100000:0.0:1789997193.803425:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1789997193.803432:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712888960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997193.803443:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997193.803456:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b8ce expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997193.803475:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b8ce expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997193.803482:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b8ce expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997193.803489:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997193.803527:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712888960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997193.803531:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1789997193.803570:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712888960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997193.803581:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997193.803588:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997193.803602:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997193.803606:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997193.803612:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997193.994945:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997194.519335:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997194.519434:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997194.519761:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704370176 00000100:00100000:0.0:1789997194.519771:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704370176 00000100:00100000:0.0:1789997194.519883:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 879 00000100:00100000:0.0:1789997194.519906:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704370176:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997194.519982:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704370176:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 89us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997194.519990:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 879 00000100:00100000:1.0:1789997194.520042:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704370304 00000100:00100000:1.0:1789997194.520047:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704370304 00000100:00100000:1.0:1789997194.520097:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 996 00000100:00100000:1.0:1789997194.520105:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704370304:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997194.520140:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704370304:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997194.520146:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 996 00000100:00080000:1.0:1789997194.520166:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997194.703177:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712889088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997194.703385:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997194.703465:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712889088 00000100:00100000:3.0:1789997194.703472:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712889088 00000100:00100000:3.0:1789997194.703535:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1789997194.703545:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712889088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997194.704255:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997194.704318:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712889088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 773us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997194.704340:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1789997194.704402:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712889088:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997194.705849:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997194.715231:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712889216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997194.715304:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997194.715470:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712889216 00000100:00100000:3.0:1789997194.715479:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712889216 00000100:00100000:3.0:1789997194.715538:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1789997194.715549:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712889216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997194.715583:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997194.715638:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712889216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997194.715645:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1789997194.715719:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712889216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997194.715800:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997195.019765:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997196.046148:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997196.893824:0:67741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc57fd9660 20000000:00000080:0.0:1789997196.893844:0:67741:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e4400 uarg=0000000000000000 00010000:00010000:0.0:1789997196.894622:0:67741:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997196.894643:0:67741:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997196.894678:0:67741:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997196.894697:0:67741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997196.894714:0:67741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b8ce expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997196.894723:0:67741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997196.894765:0:67741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b8ce expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997196.894781:0:67741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b8ce expref: 18 pid: 5804 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997196.894795:0:67741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67741:1876946712889344:0@lo:104: 00000100:00100000:0.0:1789997196.894871:0:67741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997196.894935:0:67741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb648f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789997196.895034:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712889344 00000100:00100000:2.0:1789997196.895041:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712889344 00000100:00100000:2.0:1789997196.895103:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789997196.895113:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:67741:x1876946712889344:12345-0@lo:104: 00010000:00010000:2.0:1789997196.895126:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997196.895185:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997196.895191:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:67741:x1876946712889344:12345-0@lo:104: Request processed in 81us (321us total) trans 0 rc 0/0 00010000:00010000:3.0:1789997196.895197:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789997196.895198:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00010000:3.0:1789997196.895209:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895216:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997196.895220:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895229:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997196.895236:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997196.895242:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997196.895345:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895359:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997196.895380:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895387:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592b8ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895404:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997196.895405:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997196.895407:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997196.895419:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712889472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997196.895450:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997196.895496:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712889472 00000100:00100000:3.0:1789997196.895500:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712889472 00010000:00010000:3.0:1789997196.895519:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b8ce expref: 19 pid: 5804 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997196.895552:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789997196.895559:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712889472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997196.895568:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997196.895573:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b8ce expref: 19 pid: 5804 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895583:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b8ce expref: 19 pid: 5804 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895599:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895618:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895630:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895636:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895643:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895650:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895676:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997196.895680:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895687:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895696:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997196.895706:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997196.895744:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712889472:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997196.895751:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789997196.895833:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712889472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997196.896702:0:67741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592b8d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b8ce expref: 18 pid: 5804 timeout: 1535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997196.896719:0:67741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67741:1876946712889344:0@lo:104: 00010000:00010000:0.0:1789997196.896738:0:67741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997196.896747:0:67741:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997196.896753:0:67741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997196.896759:0:67741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592b8dc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997197.068610:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997197.491547:0:67789:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6917de10 20000000:00000080:2.0:1789997197.491565:0:67789:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faaf2c00 uarg=0000000000000000 00010000:00010000:2.0:1789997197.491904:0:67789:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997197.491922:0:67789:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997197.491936:0:67789:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997197.492254:0:67789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492271:0:67789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492287:0:67789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492294:0:67789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492301:0:67789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492309:0:67789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492316:0:67789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997197.492321:0:67789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492330:0:67789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492344:0:67789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492351:0:67789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997197.492359:0:67789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592b8e3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997197.770982:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712889600:0@lo:400:kworker.0 00000100:00100000:2.0:1789997197.771003:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712889728:0@lo:400:kworker.0 00000100:00100000:3.0:1789997197.771253:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997197.771329:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712890112:0@lo:400:kworker.0 00000100:00100000:3.0:1789997197.771359:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997197.771396:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712890112 00000100:00100000:3.0:1789997197.771403:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712890112 00000100:00100000:3.0:1789997197.771453:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1789997197.771463:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712890112:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789997197.771512:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997197.771522:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712890112:12345-0@lo:400:kworker.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997197.771531:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1789997197.771551:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997197.771567:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712889600 00000100:00100000:0.0:1789997197.771573:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712889600 00000100:00100000:2.0:1789997197.771585:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712890240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997197.771588:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712890112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997197.771614:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1789997197.771623:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997197.771627:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712889600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997197.771680:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712889856:0@lo:400:kworker.0 00000100:00100000:0.0:1789997197.771703:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712889600:12345-0@lo:400:kworker.0 Request processed in 80us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997197.771715:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997197.771716:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1789997197.771738:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997197.771746:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712889984:0@lo:400:kworker.0 00000100:00100000:0.0:1789997197.771921:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712889600:0@lo:400:kworker.0 00000100:00100000:3.0:1789997197.771985:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712889728 00000100:00100000:3.0:1789997197.771991:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712889728 00000100:00100000:3.0:1789997197.772022:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712890240 00000100:00100000:3.0:1789997197.772026:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712890240 00000100:00080000:0.0:1789997197.772054:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997197.772179:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712889856 00000100:00100000:3.0:1789997197.772184:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712889856 00000100:00100000:2.0:1789997197.772311:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997197.772366:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712889984 00000100:00100000:0.0:1789997197.772371:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712889984 00000100:00100000:0.0:1789997197.772403:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1789997197.772410:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712889984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997197.772506:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1789997197.772516:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712889728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997197.772558:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712889728:12345-0@lo:400:kworker.0 Request processed in 45us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997197.772566:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1789997197.772575:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712889984:12345-0@lo:400:kworker.0 Request processed in 162us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997197.772582:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1789997197.772586:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1789997197.772593:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712890240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997197.772677:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1789997197.772686:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712889856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997197.772843:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712889856:12345-0@lo:400:kworker.0 Request processed in 146us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997197.772851:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1789997197.773147:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712889728:0@lo:400:kworker.0 00000100:00100000:2.0:1789997197.773192:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712889984:0@lo:400:kworker.0 00000100:00100000:2.0:1789997197.773206:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712889856:0@lo:400:kworker.0 00000100:00100000:1.0:1789997197.774082:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712890240:12345-0@lo:400:kworker.0 Request processed in 1487us (2456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997197.774093:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00080000:1.0:1789997197.774130:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997197.774195:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712890240:0@lo:400:kworker.0 00010000:00010000:0.0:1789997198.090933:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997198.922741:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997198.922749:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997198.922754:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997198.922801:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997198.922828:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997198.922838:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997198.922862:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712890368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997198.922930:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997198.922985:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e09a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789997198.923097:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712890368 00000100:00100000:0.0:1789997198.923107:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712890368 00000100:00100000:0.0:1789997198.923212:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1789997198.923273:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712890368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997198.923289:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997198.923304:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b8ea expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997198.923327:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b8ea expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997198.923339:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b8ea expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997198.923347:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997198.923405:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712890368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997198.923413:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1789997198.923511:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712890368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997198.923527:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997198.923537:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997198.923556:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997198.923561:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997198.923569:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.114956:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997199.632558:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997199.632603:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704370432 00000100:00100000:1.0:1789997199.632613:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704370432 00000100:00100000:1.0:1789997199.633093:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 520 00000100:00100000:1.0:1789997199.633103:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40001:x1876946704370432:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997199.633123:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997199.633144:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b8f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae938 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.633204:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b8ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.633219:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.633232:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997199.633275:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997199.633280:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997199.633304:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.633327:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b8f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae938 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.633342:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b8ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae938 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.633350:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997199.633354:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997199.633358:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997199.633413:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40001:x1876946704370432:12345-192.168.204.4@tcp:101:rm.0 Request processed in 310us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997199.633420:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 520 00000100:00080000:0.0:1789997199.633449:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997199.636819:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997199.637321:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704370560 00000100:00100000:3.0:1789997199.637332:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704370560 00000100:00100000:3.0:1789997199.637423:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 521 00000100:00100000:3.0:1789997199.637433:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40001:x1876946704370560:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997199.637463:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997199.637482:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b906 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae93f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637541:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637557:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637568:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637636:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637645:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637724:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637917:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637925:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637932:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637938:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997199.637948:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637957:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637968:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:3.0:1789997199.637971:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997199.637976:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637982:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b90d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.637995:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638002:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638007:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638012:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997199.638015:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638020:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638027:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38ee49e300) 00010000:00010000:3.0:1789997199.638029:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997199.638039:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638045:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b914 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638074:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b906 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae93f expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638084:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:3.0:1789997199.638086:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997199.638089:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b906 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae93f expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.638097:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997199.638153:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40001:x1876946704370560:12345-192.168.204.4@tcp:101:rm.0 Request processed in 721us (1341us total) trans 0 rc 301/301 00000100:00100000:3.0:1789997199.638160:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 521 00000100:00100000:1.0:1789997199.643816:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997199.643899:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704370688 00000100:00100000:2.0:1789997199.643910:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704370688 00000100:00100000:2.0:1789997199.643968:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 882 00000100:00100000:2.0:1789997199.643978:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704370688:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997199.644046:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704370688:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997199.644053:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 882 00000100:00100000:0.0:1789997199.679417:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997199.679527:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704370816 00000100:00100000:2.0:1789997199.679540:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704370816 00000100:00100000:2.0:1789997199.679601:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 522 00000100:00100000:2.0:1789997199.679612:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704370816:12345-192.168.204.4@tcp:41:mkdir.0 00000004:00000024:2.0:1789997199.679710:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789997199.679806:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704370816:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 183us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997199.679813:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 522 00000100:00100000:3.0:1789997199.684338:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997199.684823:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704371072 00000100:00100000:1.0:1789997199.684834:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704371072 00000100:00100000:1.0:1789997199.684907:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 523 00000100:00100000:1.0:1789997199.684918:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40005:x1876946704371072:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:1.0:1789997199.684985:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997199.685013:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b8ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae938 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.685109:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997199.685136:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997199.685346:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.685359:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.685370:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.685447:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.685456:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.685463:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997199.687973:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:1.0:1789997199.687995:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.688006:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.688014:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.688021:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997199.688025:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.688049:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.688067:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997199.688070:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997199.688076:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.688083:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b91b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997199.688109:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084526539 reply state 00000000517b7ec6 transno 4294967499 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997199.688118:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997199.688209:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40005:x1876946704371072:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 3291us (3879us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789997199.688218:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 523 00010000:00010000:2.0:1789997199.693190:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997199.693208:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997199.693216:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997199.693223:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997199.693228:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997199.693235:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997199.693252:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38e062d200) 00010000:00010000:2.0:1789997199.693256:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997199.693260:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997199.693267:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b922 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997199.736514:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997199.736759:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704371200 00000100:00100000:1.0:1789997199.736770:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704371200 00000100:00100000:1.0:1789997199.736838:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 524 00000100:00100000:1.0:1789997199.736849:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40009:x1876946704371200:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:1.0:1789997199.736877:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997199.736900:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b929 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae946 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.736959:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b930 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.736989:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.737001:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997199.737037:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997199.737041:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997199.737061:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b930 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.737084:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b929 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae946 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.737102:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b930 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae946 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.737110:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997199.737113:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997199.737116:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997199.737237:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40009:x1876946704371200:12345-192.168.204.4@tcp:101:chown.0 Request processed in 389us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997199.737244:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 524 00000100:00100000:3.0:1789997199.744349:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997199.744955:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704371328 00000100:00100000:2.0:1789997199.744966:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704371328 00000100:00100000:3.0:1789997199.745179:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 525 00000100:00100000:3.0:1789997199.745191:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40009:x1876946704371328:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:3.0:1789997199.745212:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997199.745236:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae94d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745304:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745333:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745345:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745361:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745367:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745374:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745484:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b94c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745492:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b94c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745500:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b94c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997199.745530:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:3.0:1789997199.745535:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997199.745557:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b94c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745570:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745586:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745593:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745599:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997199.745604:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745612:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745624:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:3.0:1789997199.745627:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997199.745633:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745639:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b93e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745707:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745714:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745720:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745725:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997199.745735:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745742:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745750:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38ee49e300) 00010000:00010000:3.0:1789997199.745752:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997199.745755:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745761:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592b945 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745790:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592b937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae94d expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745819:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b94c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae94d expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.745826:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997199.745828:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997199.745831:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ba00, rc 0) 00000100:00100000:3.0:1789997199.745901:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:40009:x1876946704371328:12345-192.168.204.4@tcp:101:chown.0 Request processed in 711us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997199.745907:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 525 00000100:00100000:0.0:1789997199.751034:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997199.751200:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704371584 00000100:00100000:3.0:1789997199.751210:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704371584 00000100:00100000:3.0:1789997199.751274:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 526 00000100:00100000:3.0:1789997199.751286:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:40009:x1876946704371584:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:3.0:1789997199.751359:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997199.751390:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592b94c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae94d expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.751409:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997199.751422:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997199.751445:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.751459:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997199.751470:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997199.752161:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030dd58e1 reply state 00000000d3a35bbb transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997199.752172:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997199.752182:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:3.0:1789997199.752316:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:40009:x1876946704371584:12345-192.168.204.4@tcp:36:chown.0 Request processed in 1031us (1289us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789997199.752324:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 526 00010000:00010000:1.0:1789997199.755897:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.755993:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.756168:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.756179:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997199.756184:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.756193:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.756211:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:1.0:1789997199.756214:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997199.756219:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997199.756227:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592b953 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997199.818951:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712890624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997199.819026:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997199.819084:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997199.819091:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712890496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997199.819112:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997199.819144:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712890624 00000100:00100000:1.0:1789997199.819151:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712890624 00000100:00100000:1.0:1789997199.821837:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712890496 00000100:00100000:1.0:1789997199.821851:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712890496 00000100:00100000:1.0:1789997199.821881:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1789997199.821892:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712890624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997199.821952:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997199.822033:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712890624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (3005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997199.822039:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1789997199.822057:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1789997199.822064:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712890496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997199.822084:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997199.822113:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712890496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997199.822119:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1789997199.822172:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712890496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997199.822187:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712890624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997199.822297:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997199.822301:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789997199.860039:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967499 is committed 00000001:00080000:0.0:1789997199.860056:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00010000:00010000:3.0:1789997200.138802:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997200.323975:0:67987:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdc7f2770 20000000:00000080:3.0:1789997200.323996:0:67987:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9b13c00 uarg=0000000000000000 00010000:00010000:3.0:1789997200.324866:0:67987:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997200.324905:0:67987:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:3.0:1789997200.324909:0:67987:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997200.324930:0:67987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592b930 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae946 expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997200.324955:0:67987:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997200.324975:0:67987:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997200.324989:0:67987:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997200.325003:0:67987:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b8ea expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997200.325089:0:67987:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997200.325128:0:67987:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b8ea expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997200.325145:0:67987:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b8ea expref: 18 pid: 5803 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997200.325160:0:67987:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67987:1876946712890752:0@lo:104: 00000100:00100000:3.0:1789997200.325298:0:67987:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997200.325405:0:67987:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61480 going to sleep for 11 seconds 00000100:00100000:2.0:1789997200.325511:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712890752 00000100:00100000:2.0:1789997200.325519:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712890752 00000100:00100000:2.0:1789997200.325603:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789997200.325613:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:67987:x1876946712890752:12345-0@lo:104: 00010000:00010000:2.0:1789997200.325627:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997200.325716:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997200.325722:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:67987:x1876946712890752:12345-0@lo:104: Request processed in 111us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997200.325729:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00010000:1.0:1789997200.325779:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997200.325796:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.325803:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997200.325808:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.325816:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997200.325823:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997200.325828:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997200.325865:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.325872:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997200.325891:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.325898:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592b8ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b8f1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.325911:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997200.325913:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997200.325915:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997200.325934:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712890880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997200.325967:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997200.326004:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712890880 00000100:00100000:1.0:1789997200.326020:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712890880 00010000:00010000:1.0:1789997200.326040:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b8ea expref: 19 pid: 5803 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997200.326064:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1789997200.326072:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712890880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997200.326081:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997200.326086:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b8ea expref: 19 pid: 5803 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326096:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b8ea expref: 19 pid: 5803 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326111:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326125:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326138:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326145:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326152:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326159:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326164:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997200.326168:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326176:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326186:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997200.326196:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997200.326538:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712890880:12345-0@lo:103:ldlm_bl.0 Request processed in 466us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997200.326546:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00010000:3.0:1789997200.326619:0:67987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592b8f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b8ea expref: 18 pid: 5803 timeout: 1539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997200.326632:0:67987:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67987:1876946712890752:0@lo:104: 00010000:00010000:3.0:1789997200.326651:0:67987:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997200.326740:0:67987:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997200.326753:0:67987:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997200.326760:0:67987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592b95a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997200.327917:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712890880:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789997200.935254:0:68035:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd386caa0 20000000:00000080:0.0:1789997200.935276:0:68035:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e2400 uarg=0000000000000000 00010000:00010000:0.0:1789997200.935587:0:68035:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997200.935603:0:68035:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997200.935616:0:68035:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997200.935635:0:68035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935868:0:68035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935882:0:68035:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935888:0:68035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935895:0:68035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935902:0:68035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935912:0:68035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997200.935917:0:68035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935925:0:68035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935938:0:68035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935946:0:68035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997200.935952:0:68035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592b961 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997201.162936:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997201.419189:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997201.419197:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997201.419356:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997201.419402:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997201.419423:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997201.419436:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997201.419464:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712891008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997201.419534:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997201.419590:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789997201.420141:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712891008 00000100:00100000:2.0:1789997201.420152:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712891008 00000100:00100000:2.0:1789997201.420216:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:2.0:1789997201.420226:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712891008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997201.420240:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997201.420256:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b968 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997201.420281:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b968 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997201.420293:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b968 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997201.420301:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997201.420357:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712891008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997201.420364:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1789997201.420410:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712891008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997201.420435:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997201.420445:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997201.420465:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997201.420470:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997201.420478:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997202.190125:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997202.891153:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712891136:0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891235:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997202.891301:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712891648:0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891329:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997202.891356:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997202.891362:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712891520:0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891383:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997202.891414:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712891264:0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891415:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712891392:0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891450:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997202.891475:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997202.891501:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712891776:0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891506:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712891136 00000100:00100000:1.0:1789997202.891514:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712891136 00000100:00100000:2.0:1789997202.891521:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997202.891555:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712891392 00000100:00100000:2.0:1789997202.891559:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712891392 00000100:00100000:1.0:1789997202.891564:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:1.0:1789997202.891575:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712891136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997202.891598:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712891264 00000100:00100000:2.0:1789997202.891602:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712891264 00000100:00100000:2.0:1789997202.891624:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712891776 00000100:00100000:1.0:1789997202.891627:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712891136:12345-0@lo:400:kworker.0 Request processed in 52us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997202.891635:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712891776 00000100:00100000:1.0:1789997202.891635:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1789997202.891685:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1789997202.891694:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712891392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891705:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712891136:0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891766:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1789997202.891774:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712891264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891809:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712891264:12345-0@lo:400:kworker.0 Request processed in 36us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997202.891815:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1789997202.891829:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1789997202.891849:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712891776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.891874:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712891776:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997202.891880:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00080000:1.0:1789997202.891894:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997202.891919:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712891392:0@lo:400:kworker.0 00000100:00100000:2.0:1789997202.891926:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712891392:12345-0@lo:400:kworker.0 Request processed in 231us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997202.891934:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1789997202.891957:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712891648 00000100:00100000:1.0:1789997202.891962:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712891648 00000100:00100000:2.0:1789997202.891979:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712891264:0@lo:400:kworker.0 00000100:00100000:2.0:1789997202.891991:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712891776:0@lo:400:kworker.0 00000100:00100000:3.0:1789997202.897333:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712891520 00000100:00100000:3.0:1789997202.897351:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712891520 00000100:00100000:1.0:1789997202.897506:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1789997202.897520:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1789997202.897533:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712891520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997202.897635:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712891648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997202.897648:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712891520:12345-0@lo:400:kworker.0 Request processed in 118us (6263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997202.897679:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1789997202.897703:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712891648:12345-0@lo:400:kworker.0 Request processed in 186us (6371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997202.897711:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1789997202.897942:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712891520:0@lo:400:kworker.0 00000100:00100000:3.0:1789997202.897966:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712891648:0@lo:400:kworker.0 00000100:00080000:0.0:1789997202.898753:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997202.898763:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997203.212104:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997203.464864:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997203.465217:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704371712 00000100:00100000:1.0:1789997203.465229:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704371712 00000100:00100000:1.0:1789997203.465321:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00100000:1.0:1789997203.465332:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704371712:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997203.465351:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997203.465355:0:5795:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b930) 00010000:00010000:1.0:1789997203.465358:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997203.465423:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704371712:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 92us (568us total) trans 0 rc 116/116 00000100:00100000:1.0:1789997203.465431:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 9 00000100:00080000:2.0:1789997203.465568:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997204.235483:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997204.758867:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997204.760773:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704371968 00000100:00100000:0.0:1789997204.760789:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704371968 00000100:00100000:0.0:1789997204.760858:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1003 00000100:00100000:0.0:1789997204.760869:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704371968:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997204.760966:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704371968:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 99us (2108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997204.760973:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1003 00000100:00100000:3.0:1789997204.769120:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997204.769204:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704371840 00000100:00100000:1.0:1789997204.769215:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704371840 00000100:00100000:1.0:1789997204.769277:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 885 00000100:00100000:1.0:1789997204.769289:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704371840:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997204.769373:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704371840:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997204.769381:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 885 00000020:00000080:1.0:1789997204.796036:0:68279:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfb9b6f80 20000000:00000080:1.0:1789997204.796126:0:68279:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb46e400 uarg=0000000000000000 00010000:00010000:1.0:1789997204.796432:0:68279:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997204.796449:0:68279:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997204.796465:0:68279:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997204.796483:0:68279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997204.796501:0:68279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b968 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997204.796509:0:68279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997204.796545:0:68279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b968 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997204.796561:0:68279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b968 expref: 18 pid: 7594 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997204.796576:0:68279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68279:1876946712891904:0@lo:104: 00000100:00100000:1.0:1789997204.796639:0:68279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997204.796761:0:68279:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d3b04240 going to sleep for 11 seconds 00000100:00100000:3.0:1789997204.796904:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712891904 00000100:00100000:3.0:1789997204.796912:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712891904 00000100:00100000:3.0:1789997204.796961:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789997204.796971:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:68279:x1876946712891904:12345-0@lo:104: 00010000:00010000:3.0:1789997204.796984:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997204.797064:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997204.797071:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:68279:x1876946712891904:12345-0@lo:104: Request processed in 102us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997204.797078:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00010000:0.0:1789997204.797135:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997204.797143:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997204.797150:0:68279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68279:1876946712891904:0@lo:104: 00010000:00010000:0.0:1789997204.797151:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997204.797155:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797164:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997204.797170:0:68279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997204.797170:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997204.797177:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997204.797214:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797221:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997204.797263:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797271:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592b968 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b96f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797287:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997204.797289:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997204.797290:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997204.797389:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712892032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997204.797420:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997204.797531:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712892032 00000100:00100000:0.0:1789997204.797536:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712892032 00010000:00010000:0.0:1789997204.797556:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b968 expref: 19 pid: 7594 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997204.797627:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789997204.797636:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712892032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997204.797645:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997204.797650:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b968 expref: 19 pid: 7594 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797689:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b968 expref: 19 pid: 7594 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797714:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592b96f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b968 expref: 19 pid: 7594 timeout: 1543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797726:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797733:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797745:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797751:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797758:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797764:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797769:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997204.797773:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797781:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797795:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997204.797804:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997204.797842:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712892032:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997204.797849:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:1.0:1789997204.797909:0:68279:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997204.797917:0:68279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997204.797922:0:68279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592b976 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997204.798181:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712892032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997204.939611:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712892160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997204.939726:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997204.939788:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997204.939796:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712892288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997204.939825:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997204.939870:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712892160 00000100:00100000:1.0:1789997204.939877:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712892160 00000100:00100000:1.0:1789997204.939929:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712892288 00000100:00100000:1.0:1789997204.939933:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712892288 00000100:00080000:2.0:1789997204.939936:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997204.939940:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997204.939951:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1789997204.939957:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1789997204.939960:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712892160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997204.939965:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712892288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997204.939993:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00002000:00000024:1.0:1789997204.939993:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997204.940043:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712892288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997204.940050:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1789997204.940119:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712892160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997204.940126:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1789997204.942233:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712892288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997204.942272:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712892160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997205.258823:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997206.221518:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997206.221526:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997206.221531:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997206.221575:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997206.221589:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997206.221601:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997206.221625:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712892416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997206.221738:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997206.221783:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789997206.221882:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712892416 00000100:00100000:1.0:1789997206.221899:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712892416 00000100:00100000:1.0:1789997206.222116:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1789997206.222269:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712892416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997206.222284:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997206.222299:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b97d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997206.222322:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b97d expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997206.222334:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b97d expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997206.222343:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997206.222398:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712892416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997206.222406:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:1.0:1789997206.222457:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712892416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997206.222473:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997206.222498:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997206.222516:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997206.222520:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997206.222527:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997206.284264:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997207.111227:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997207.111351:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704372096 00000100:00100000:1.0:1789997207.111362:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704372096 00000100:00080000:3.0:1789997207.111438:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997207.111444:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 527 00000100:00100000:1.0:1789997207.111455:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40186:x1876946704372096:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997207.111473:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997207.111495:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b98b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae954 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.111558:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b992 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.111573:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.111599:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997207.111637:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997207.111641:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997207.111693:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.111719:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592b98b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae954 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.111737:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b992 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae954 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.111745:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997207.111748:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997207.111751:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997207.111811:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40186:x1876946704372096:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 357us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997207.111818:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 527 00000100:00100000:1.0:1789997207.122442:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997207.124861:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704372224 00000100:00100000:2.0:1789997207.124888:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704372224 00000100:00100000:2.0:1789997207.124966:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 528 00000100:00100000:2.0:1789997207.124977:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40186:x1876946704372224:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997207.124999:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997207.125020:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b999 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae95b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125079:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125095:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125107:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125120:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125128:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125134:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125404:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b9ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125414:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125421:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997207.125449:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:2.0:1789997207.125453:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997207.125471:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b9ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125482:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125488:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125497:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125502:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997207.125506:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125513:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125525:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:2.0:1789997207.125528:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997207.125533:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125539:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592b9a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125551:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125558:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125564:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125569:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997207.125571:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125581:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125588:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997207.125591:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997207.125594:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125600:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592b9a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125631:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592b999 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae95b expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125644:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b9ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae95b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.125705:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997207.125709:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997207.125712:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997207.125787:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40186:x1876946704372224:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 811us (3354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997207.125794:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 528 00000100:00100000:1.0:1789997207.130233:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997207.130307:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704372480 00000100:00100000:2.0:1789997207.130317:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704372480 00000100:00100000:2.0:1789997207.130379:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 529 00000100:00100000:2.0:1789997207.130391:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40186:x1876946704372480:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997207.130452:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997207.130479:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592b9ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae95b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.130499:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997207.130511:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997207.130536:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.130549:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997207.130560:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789997207.155903:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00010000:2.0:1789997207.156018:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d787b8e reply state 0000000083c889c0 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997207.156033:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997207.156050:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00080000:2.0:1789997207.156198:0:12471:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789997207.156224:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40186:x1876946704372480:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 25831us (25999us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789997207.156233:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 529 00010000:00010000:0.0:1789997207.156315:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997207.156325:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997207.156333:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997207.156339:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997207.156344:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997207.156353:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997207.156368:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:0.0:1789997207.156371:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997207.156377:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997207.156383:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592b9b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997207.307642:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997207.719086:0:68476:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2ad4d880 20000000:00000080:1.0:1789997207.719104:0:68476:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb46f000 uarg=0000000000000000 00010000:00010000:1.0:1789997207.719579:0:68476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997207.719615:0:68476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997207.719618:0:68476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997207.719635:0:68476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b992 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae954 expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.719831:0:68476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997207.719849:0:68476:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997207.719863:0:68476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.719877:0:68476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b97d expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.719885:0:68476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.719922:0:68476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b97d expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.719936:0:68476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b97d expref: 18 pid: 5805 timeout: 1546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997207.719949:0:68476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68476:1876946712892544:0@lo:104: 00000100:00100000:1.0:1789997207.720012:0:68476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997207.720110:0:68476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b51240 going to sleep for 11 seconds 00000100:00100000:0.0:1789997207.720188:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712892544 00000100:00100000:0.0:1789997207.720195:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712892544 00000100:00100000:0.0:1789997207.720282:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789997207.720291:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:68476:x1876946712892544:12345-0@lo:104: 00010000:00010000:0.0:1789997207.720304:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997207.720375:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997207.720382:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:68476:x1876946712892544:12345-0@lo:104: Request processed in 92us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997207.720389:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00010000:3.0:1789997207.720437:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997207.720444:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720452:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997207.720456:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720465:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997207.720471:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997207.720477:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997207.720508:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720515:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997207.720535:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720555:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592b97d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b984 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720568:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997207.720570:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997207.720571:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997207.720590:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712892672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997207.720621:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997207.720690:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712892672 00000100:00100000:3.0:1789997207.720695:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712892672 00010000:00010000:3.0:1789997207.720714:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b97d expref: 19 pid: 5805 timeout: 1546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997207.720735:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789997207.720742:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712892672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997207.720753:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997207.720758:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b97d expref: 19 pid: 5805 timeout: 1546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720768:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b97d expref: 19 pid: 5805 timeout: 1546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720781:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720789:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720812:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720819:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720825:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720831:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720837:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997207.720840:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720848:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720856:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997207.720864:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997207.720893:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712892672:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997207.720900:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1789997207.720937:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712892672:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997207.721017:0:68476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b984 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b97d expref: 18 pid: 5805 timeout: 1546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997207.721027:0:68476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68476:1876946712892544:0@lo:104: 00010000:00010000:1.0:1789997207.721040:0:68476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.721048:0:68476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.721061:0:68476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997207.721067:0:68476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592b9bc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997208.011881:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712892928:0@lo:400:kworker.0 00000100:00100000:3.0:1789997208.011902:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712893184:0@lo:400:kworker.0 00000100:00100000:0.0:1789997208.011968:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712892800:0@lo:400:kworker.0 00000100:00100000:1.0:1789997208.012025:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712893056:0@lo:400:kworker.0 00000100:00100000:3.0:1789997208.012152:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997208.012153:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997208.012237:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712893184 00000100:00100000:3.0:1789997208.012254:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712893184 00000100:00100000:3.0:1789997208.012313:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1789997208.012322:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712893184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997208.012385:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712893184:12345-0@lo:400:kworker.0 Request processed in 64us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997208.012392:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:3.0:1789997208.012414:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997208.012455:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712893184:0@lo:400:kworker.0 00000100:00100000:1.0:1789997208.014229:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997208.014229:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997208.014397:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712893056 00000100:00100000:3.0:1789997208.014410:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712893056 00000100:00100000:3.0:1789997208.014468:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1789997208.014479:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712893056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997208.014523:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712893312:0@lo:400:kworker.0 00000100:00100000:3.0:1789997208.014560:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712893056:12345-0@lo:400:kworker.0 Request processed in 83us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997208.014568:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00080000:3.0:1789997208.014590:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997208.014614:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997208.018076:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712892928 00000100:00100000:3.0:1789997208.018092:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712892928 00000100:00100000:3.0:1789997208.018158:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712892800 00000100:00100000:3.0:1789997208.018161:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712892800 00000100:00100000:3.0:1789997208.018187:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712893312 00000100:00100000:3.0:1789997208.018190:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712893312 00000100:00100000:3.0:1789997208.018221:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00080000:2.0:1789997208.018225:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997208.018233:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712892928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997208.018265:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1789997208.018277:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712892800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997208.018399:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712892800:12345-0@lo:400:kworker.0 Request processed in 125us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997208.018408:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1789997208.018428:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:2.0:1789997208.018436:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712893312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997208.018470:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712893312:12345-0@lo:400:kworker.0 Request processed in 36us (3856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997208.018476:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:2.0:1789997208.018527:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712892800:0@lo:400:kworker.0 00000100:00100000:2.0:1789997208.018541:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712893312:0@lo:400:kworker.0 00000100:00100000:2.0:1789997208.018851:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712893056:0@lo:400:kworker.0 00000100:00100000:3.0:1789997208.019132:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712892928:12345-0@lo:400:kworker.0 Request processed in 902us (6981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997208.019140:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:3.0:1789997208.019229:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712892928:0@lo:400:kworker.0 00010000:00010000:3.0:1789997208.331770:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997208.971073:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997208.971082:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997208.971088:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997208.971140:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997208.971153:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997208.971165:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997208.971190:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712893440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997208.971273:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997208.971350:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59600 going to sleep for 11 seconds 00000100:00100000:1.0:1789997208.971696:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712893440 00000100:00100000:1.0:1789997208.971713:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712893440 00000100:00100000:1.0:1789997208.971794:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1789997208.971806:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712893440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997208.971826:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997208.971848:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592b9c3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997208.971882:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997208.971897:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997208.971908:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997208.972000:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712893440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997208.972009:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1789997208.972060:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712893440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997208.972085:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997208.972097:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997208.972118:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997208.972123:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997208.972131:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.354930:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997209.860000:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997209.860161:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704372608 00000100:00100000:0.0:1789997209.860173:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704372608 00000100:00080000:2.0:1789997209.860238:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997209.860256:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 530 00000100:00100000:0.0:1789997209.860269:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40262:x1876946704372608:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997209.860297:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997209.860323:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b9d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae962 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.860394:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.860409:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.860423:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.860438:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.860445:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.860451:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.860818:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b9e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861569:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861581:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997209.861635:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789997209.861650:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997209.861700:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861715:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861722:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861729:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861735:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997209.861739:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861746:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861759:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997209.861762:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997209.861767:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861773:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592b9d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861793:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861799:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861809:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.861814:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997209.861817:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.863360:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.863384:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997209.863388:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997209.863393:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.863401:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592b9df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.863462:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592b9d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae962 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.863488:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae962 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.863496:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997209.863498:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997209.863501:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997209.863582:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40262:x1876946704372608:12345-192.168.204.4@tcp:101:touch.0 Request processed in 3313us (3593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997209.863608:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 530 00000100:00100000:0.0:1789997209.880376:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997209.880430:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997209.880506:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704372864 00000100:00100000:2.0:1789997209.880513:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704372992 00000100:00100000:1.0:1789997209.880524:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704372864 00000100:00100000:2.0:1789997209.880525:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704372992 00000100:00100000:2.0:1789997209.880580:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 888 00000100:00100000:2.0:1789997209.880590:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704372992:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997209.880633:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 531 00000100:00100000:1.0:1789997209.880644:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40262:x1876946704372864:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997209.880690:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789997209.880699:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704372992:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997209.880707:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 888 00010000:00010000:1.0:1789997209.880713:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b9ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae969 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.880996:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.881013:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.881026:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.881042:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.881050:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.881056:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997209.883562:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11:0x0], index 1: 0 00010000:00010000:1.0:1789997209.884275:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592ba02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884293:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592ba02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884318:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592ba02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884364:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884372:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884380:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884386:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997209.884390:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884398:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884410:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:1.0:1789997209.884414:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997209.884419:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884425:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592b9f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997209.884438:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005246cb34 reply state 00000000dd603cde transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997209.884446:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997209.884490:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592b9ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae969 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884507:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592ba02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae969 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997209.884515:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997209.884518:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997209.884521:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997209.884619:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:40262:x1876946704372864:12345-192.168.204.4@tcp:101:touch.0 Request processed in 3977us (4251us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789997209.884629:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 531 00010000:00010000:2.0:1789997209.886310:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997209.886328:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997209.886337:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997209.886343:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997209.886347:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997209.886355:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997209.886371:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38e062d100) 00010000:00010000:2.0:1789997209.886375:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997209.886379:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997209.886457:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592b9fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997209.895550:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997209.896813:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704373248 00000100:00100000:0.0:1789997209.896835:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704373248 00000100:00100000:0.0:1789997209.896903:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 532 00000100:00100000:0.0:1789997209.896914:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:40262:x1876946704373248:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:0.0:1789997209.896976:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997209.897005:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592ba02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae969 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.897023:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997209.897034:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997209.897081:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.897094:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.897104:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997209.897260:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000931605ae reply state 0000000000a0d356 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997209.897270:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997209.897368:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:40262:x1876946704373248:12345-192.168.204.4@tcp:36:touch.0 Request processed in 455us (1827us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789997209.897378:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 532 00010000:00010000:0.0:1789997209.901981:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.901996:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.902004:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.902009:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997209.902013:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.902020:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.902037:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997209.902040:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997209.902045:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997209.902202:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997209.903292:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997209.903329:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704373376 00000100:00100000:3.0:1789997209.903413:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704373376 00000100:00100000:3.0:1789997209.903470:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 533 00000100:00100000:3.0:1789997209.903481:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:40262:x1876946704373376:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997209.903505:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997209.903525:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592ba17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae970 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997209.903589:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592ba17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae970 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997209.903635:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592ba17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae970 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997209.903678:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997209.903682:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997209.903686:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997209.903747:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:40262:x1876946704373376:12345-192.168.204.4@tcp:101:touch.0 Request processed in 266us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997209.903755:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 533 00000100:00100000:3.0:1789997209.908326:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997209.908376:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704373504 00000100:00100000:3.0:1789997209.908390:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704373504 00000100:00100000:3.0:1789997209.908456:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 271 00000100:00100000:3.0:1789997209.908465:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876946704373504:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:3.0:1789997209.908496:0:6659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1398 last 0 00000020:00000080:3.0:1789997209.908525:0:6659:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592ba1e 00002000:00100000:3.0:1789997209.908538:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38c53df000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789997209.908563:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789997209.909472:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789997209.909505:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c53de000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789997209.909582:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704373504:12345-192.168.204.4@tcp:8:touch.0 Request processed in 1115us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997209.909592:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 271 00000100:00100000:3.0:1789997209.911361:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997209.911425:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704373632 00000100:00100000:2.0:1789997209.911443:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704373632 00000100:00100000:2.0:1789997209.911546:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 272 00000100:00100000:2.0:1789997209.911559:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:0:x1876946704373632:12345-192.168.204.4@tcp:2:touch.0 00000100:00080000:3.0:1789997209.911572:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789997209.961974:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967329 is committed 00000001:00100000:3.0:1789997209.962000:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:2.0:1789997209.962529:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:0:x1876946704373632:12345-192.168.204.4@tcp:2:touch.0 Request processed in 50967us (51170us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789997209.962542:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 272 00000100:00100000:2.0:1789997209.964775:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997209.965149:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704373888 00000100:00100000:3.0:1789997209.965159:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704373888 00000100:00100000:3.0:1789997209.965224:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:3.0:1789997209.965235:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:40262:x1876946704373888:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:2.0:1789997209.966212:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:40262:x1876946704373888:12345-192.168.204.4@tcp:35:touch.0 Request processed in 963us (1432us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789997209.966224:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 58 00000100:00100000:3.0:1789997210.012129:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997210.012220:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704374016 00000100:00100000:0.0:1789997210.012234:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704374016 00000100:00100000:0.0:1789997210.012307:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 534 00000100:00100000:0.0:1789997210.012318:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:40266:x1876946704374016:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997210.012345:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997210.012367:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae977 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012435:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012449:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012460:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012474:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012480:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012487:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012575:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592ba3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012585:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592ba3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012592:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592ba3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997210.012641:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2c:0x0]: returning size 0 00000004:00200000:0.0:1789997210.012646:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997210.012694:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592ba3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012709:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592ba3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012717:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012724:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012731:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012737:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997210.012741:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012748:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012759:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997210.012762:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997210.012767:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012772:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012793:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012798:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012804:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012809:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997210.012811:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012817:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012824:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997210.012826:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997210.012829:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012834:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012867:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae977 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012882:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592ba3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae977 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.012889:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:0.0:1789997210.012891:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997210.012894:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:1.0:1789997210.013109:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:40266:x1876946704374016:12345-192.168.204.4@tcp:101:rm.0 Request processed in 791us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997210.013118:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 534 00000100:00100000:0.0:1789997210.020482:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997210.020630:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704374144 00000100:00100000:2.0:1789997210.020642:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704374144 00000100:00100000:2.0:1789997210.020800:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 273 00000100:00100000:2.0:1789997210.020815:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704374144:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997210.020834:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997210.020856:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae97e expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997210.020885:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x6ab13099, atime: 0x6ab13099, ctime: 0x6ab13099, blocks: 0x1 00010000:00010000:2.0:1789997210.020906:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=1398s v=(0 0) 00010000:00010000:2.0:1789997210.020911:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997210.020920:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997210.020941:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997210.020956:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997210.021017:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704374144:12345-192.168.204.4@tcp:101:rm.0 Request processed in 205us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997210.021543:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 273 00000100:00100000:2.0:1789997210.026356:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997210.026803:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704374400 00000100:00100000:0.0:1789997210.026815:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704374400 00000100:00100000:0.0:1789997210.027339:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 535 00000100:00100000:0.0:1789997210.027352:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:40266:x1876946704374400:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789997210.027415:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997210.027443:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592ba3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae977 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.027475:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592ba17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae970 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.027485:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:0.0:1789997210.029301:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997210.029466:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.029487:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.029501:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.029518:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.029524:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.029530:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.029854:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.029864:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.029871:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789997210.031304:0:12471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 64 off9280 00000004:00080000:0.0:1789997210.031317:0:12471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1398723663019ns, next at 1399723660239ns, rc = 0 00010000:00010000:0.0:1789997210.031387:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031401:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031412:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031421:0:12471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031428:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031434:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031517:0:12471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997210.031547:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031554:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031561:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031567:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997210.031572:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031579:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031591:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997210.031605:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997210.031609:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031614:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592ba56 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031632:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031637:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031642:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031646:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997210.031648:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031674:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031680:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997210.031682:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997210.031685:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997210.031690:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592ba48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997210.031705:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081dbf79f reply state 00000000d36a2f05 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997210.031714:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997210.031814:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:40266:x1876946704374400:12345-192.168.204.4@tcp:36:rm.0 Request processed in 4461us (5468us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789997210.031824:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 535 00010000:00010000:3.0:1789997210.032155:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997210.032163:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997210.032169:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997210.032172:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997210.032178:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997210.032187:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2c:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:3.0:1789997210.032190:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997210.032193:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997210.032198:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592ba5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997210.032215:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997210.032217:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997210.032218:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997210.034015:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997210.034034:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997210.034041:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997210.034046:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997210.034051:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997210.034059:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997210.034073:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997210.034076:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997210.034081:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997210.034088:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592ba4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997210.059527:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997210.059555:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712893568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997210.059798:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997210.059929:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712893568 00000100:00100000:3.0:1789997210.059953:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712893568 00000100:00100000:3.0:1789997210.060049:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1789997210.060061:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712893568:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997210.060077:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997210.060091:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712893696:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997210.060103:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997210.060129:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997210.060167:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712893568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997210.060170:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712893696 00000100:00100000:1.0:1789997210.060177:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712893696 00000100:00100000:3.0:1789997210.060179:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00080000:2.0:1789997210.060281:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997210.060285:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997210.060334:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712893568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997210.062774:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:1.0:1789997210.062799:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712893696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997210.062824:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997210.062909:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712893696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997210.062916:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1789997210.063846:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712893696:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997210.378839:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997211.403514:0:68722:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb0b86ea0 20000000:00000080:0.0:1789997211.403621:0:68722:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e4400 uarg=0000000000000000 00010000:00010000:1.0:1789997211.403879:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997211.404212:0:68722:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997211.404243:0:68722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997211.404248:0:68722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997211.404258:0:68722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592b9e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae962 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997211.404291:0:68722:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997211.404308:0:68722:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997211.404322:0:68722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997211.404336:0:68722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997211.404344:0:68722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997211.404381:0:68722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997211.404393:0:68722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 18 pid: 5803 timeout: 1550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997211.404407:0:68722:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68722:1876946712893824:0@lo:104: 00000100:00100000:0.0:1789997211.404474:0:68722:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997211.404607:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789997211.404621:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712893824 00000100:00100000:2.0:1789997211.404627:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712893824 00000100:00100000:2.0:1789997211.404695:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789997211.404704:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c63e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:68722:x1876946712893824:12345-0@lo:104: 00010000:00010000:2.0:1789997211.404717:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997211.404763:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997211.404769:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c63e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:68722:x1876946712893824:12345-0@lo:104: Request processed in 67us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997211.404776:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789997211.404888:0:68722:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0ccd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789997211.404910:0:68722:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68722:1876946712893824:0@lo:104: 00010000:00010000:0.0:1789997211.404926:0:68722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.406116:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997211.406141:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.406153:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997211.406158:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.406168:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997211.406237:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997211.406243:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997211.406424:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.406431:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997211.406461:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.406468:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592b9c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592b9ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997211.406479:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1789997211.406488:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997211.406491:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997211.406493:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997211.406499:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712893952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997211.406563:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997211.406878:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712893952 00000100:00100000:1.0:1789997211.406886:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712893952 00010000:00010000:1.0:1789997211.406917:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 19 pid: 5803 timeout: 1550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997211.406969:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789997211.406979:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712893952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997211.406991:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997211.406997:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 19 pid: 5803 timeout: 1550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407007:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 19 pid: 5803 timeout: 1550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407020:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592b9ca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592b9c3 expref: 19 pid: 5803 timeout: 1550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407033:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407042:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407057:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407064:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407072:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407078:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407094:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997211.407099:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407106:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407120:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997211.407130:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997211.407168:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712893952:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997211.407175:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:0.0:1789997211.407257:0:68722:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997211.407265:0:68722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997211.407272:0:68722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592ba64 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997211.407939:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712893952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997212.426893:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997212.654274:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1789997212.654288:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 47 committed 00000100:00100000:2.0:1789997212.654427:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712894080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997212.654497:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997212.654583:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712894080 00000100:00100000:2.0:1789997212.654591:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712894080 00000100:00100000:2.0:1789997212.654645:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789997212.654677:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712894080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789997212.654705:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:17 count 1 00010000:00010000:2.0:1789997212.654730:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997212.654752:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997212.654762:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1789997212.654766:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997212.654785:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997212.654814:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997212.654830:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 5 pid: 8169 timeout: 1501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997212.654843:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1876946712894208:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997212.654899:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e0d99540 going to sleep for 11 seconds 00000100:00080000:2.0:1789997212.654912:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997212.664908:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997212.664950:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704374528 00000100:00100000:1.0:1789997212.664960:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704374528 00010000:00010000:1.0:1789997212.665013:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 6 pid: 8169 timeout: 1501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997212.665051:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 309 00000100:00100000:1.0:1789997212.665063:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704374528:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997212.665077:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997212.665084:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 6 pid: 8169 timeout: 1501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.665099:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 6 pid: 8169 timeout: 1501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.665134:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997212.665140:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997212.665146:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.665156:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997212.665166:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ba41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x11:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae97e expref: 6 pid: 8169 timeout: 1501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.665181:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997212.665185:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1876946712894208:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997212.665210:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997212.665221:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997212.665228:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997212.665236:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704374528:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 173us (333us total) trans 0 rc 0/0 00010000:00010000:0.0:1789997212.665243:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997212.665248:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 309 00010000:00010000:0.0:1789997212.665258:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997212.665277:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997212.665985:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712894080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11328us (11484us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789997212.665994:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000004:00080000:2.0:1789997212.666366:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c571ed80/2, rc 0, transno 4294967330 00000100:00100000:2.0:1789997212.666374:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712894080:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1789997212.668632:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789997212.668776:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997212.668785:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.668798:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997212.668802:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.668813:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.668831:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.668846:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592ba6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.668866:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997212.668868:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997212.668870:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997212.876516:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997212.876526:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997212.876531:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997212.876586:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997212.876599:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997212.876610:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997212.877595:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712894336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997212.877755:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997212.877808:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997212.878506:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712894336 00000100:00100000:1.0:1789997212.878516:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712894336 00000100:00100000:1.0:1789997212.878577:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1789997212.878588:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712894336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997212.878606:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997212.879494:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ba72 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.879532:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ba72 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.879555:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ba72 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997212.879564:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997212.879731:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712894336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1143us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997212.879739:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1789997212.880767:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712894336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997212.880791:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997212.880803:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997212.880826:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997212.880832:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997212.880839:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997213.132637:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712894592:0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.132729:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997213.132783:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997213.132791:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712894464:0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.132813:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997213.132847:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712894720:0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.132875:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997213.132899:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997213.132904:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712894848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.132926:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997213.132956:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712894592 00000100:00100000:2.0:1789997213.132964:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712894592 00000100:00100000:2.0:1789997213.133011:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712894464 00000100:00100000:2.0:1789997213.133014:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712894464 00000100:00100000:2.0:1789997213.133031:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712894848 00000100:00100000:2.0:1789997213.133033:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712894848 00000100:00100000:2.0:1789997213.133052:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1789997213.133060:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712894592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.133114:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712894592:12345-0@lo:400:kworker.0 Request processed in 54us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997213.133121:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1789997213.133136:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1789997213.133142:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712894464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.133167:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712894464:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997213.133172:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1789997213.133182:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1789997213.133187:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712894848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.133211:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712894848:12345-0@lo:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997213.133217:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1789997213.133237:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712894720 00000100:00100000:2.0:1789997213.133240:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712894720 00000100:00100000:2.0:1789997213.133262:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1789997213.133266:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712894720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.133291:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712894720:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997213.133296:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1789997213.133342:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712894848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.133352:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712894720:0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.133378:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712894464:0@lo:400:kworker.0 00000100:00100000:2.0:1789997213.133387:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712894592:0@lo:400:kworker.0 00000100:00080000:1.0:1789997213.134091:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997213.134097:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789997213.450976:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997213.559432:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997213.559476:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704374656 00000100:00100000:2.0:1789997213.559495:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704374656 00000100:00100000:2.0:1789997213.559583:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 536 00000100:00100000:2.0:1789997213.559594:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40354:x1876946704374656:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997213.559616:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997213.559637:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ba80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae985 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997213.559743:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592ba87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997213.559758:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592ba87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997213.559777:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592ba87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997213.559812:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:2.0:1789997213.559816:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997213.559834:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592ba87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997213.559858:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ba80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae985 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997213.559890:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592ba87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae985 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997213.559900:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997213.559903:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997213.559907:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997213.559976:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40354:x1876946704374656:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 374us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997213.559984:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 536 00000100:00080000:2.0:1789997213.560006:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997213.568384:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997213.568912:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704374912 00000100:00100000:3.0:1789997213.568922:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704374912 00000100:00100000:3.0:1789997213.568975:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 537 00000100:00100000:3.0:1789997213.568985:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40354:x1876946704374912:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997213.569038:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997213.569072:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592ba87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae985 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.569089:0:11799:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b9e6) 00010000:00010000:3.0:1789997213.569094:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:3.0:1789997213.569105:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997213.570938:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.570958:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.570971:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997213.606699:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c2659bc reply state 00000000490b607c transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997213.606716:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997213.606732:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:3.0:1789997213.606852:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40354:x1876946704374912:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 37864us (38748us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789997213.606861:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 537 00000001:00080000:1.0:1789997213.607068:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00010000:00010000:3.0:1789997213.607802:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.607873:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.607881:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.607905:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997213.607910:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.607918:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.607934:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997213.607937:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997213.607941:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997213.607948:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ba8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789997214.309124:0:68917:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed4e1b9a0 20000000:00000080:3.0:1789997214.309142:0:68917:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faaf2c00 uarg=0000000000000000 00010000:00010000:3.0:1789997214.309933:0:68917:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997214.309950:0:68917:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997214.309965:0:68917:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997214.309983:0:68917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997214.310000:0:68917:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ba72 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997214.310008:0:68917:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997214.310046:0:68917:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ba72 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997214.310122:0:68917:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ba72 expref: 18 pid: 5803 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997214.310137:0:68917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68917:1876946712894976:0@lo:104: 00000100:00100000:3.0:1789997214.310199:0:68917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997214.310255:0:68917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32cbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997214.310282:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712894976 00000100:00100000:2.0:1789997214.310289:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712894976 00000100:00100000:2.0:1789997214.310345:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789997214.310355:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:68917:x1876946712894976:12345-0@lo:104: 00010000:00010000:2.0:1789997214.310370:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997214.310636:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997214.310643:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:68917:x1876946712894976:12345-0@lo:104: Request processed in 290us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997214.310651:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789997214.311172:0:68917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68917:1876946712894976:0@lo:104: 00010000:00010000:3.0:1789997214.311191:0:68917:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311490:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997214.311499:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311508:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997214.311524:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311535:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997214.311542:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997214.311547:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997214.311630:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311637:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997214.311686:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311693:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ba72 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ba79 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311709:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997214.311711:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997214.311713:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997214.311720:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997214.311733:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712895104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997214.311773:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997214.311815:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712895104 00000100:00100000:0.0:1789997214.311825:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712895104 00010000:00010000:0.0:1789997214.311849:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ba72 expref: 19 pid: 5803 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997214.311873:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789997214.311879:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712895104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997214.311890:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997214.311895:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ba72 expref: 19 pid: 5803 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311906:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ba72 expref: 19 pid: 5803 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311921:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592ba79 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ba72 expref: 19 pid: 5803 timeout: 1553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311934:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311941:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311954:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311960:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311966:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311972:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311978:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997214.311981:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.311989:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.312006:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997214.312017:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997214.312018:0:68917:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997214.312029:0:68917:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997214.312037:0:68917:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592ba95 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997214.312050:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712895104:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997214.312057:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789997214.312089:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712895104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997214.477353:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997215.002781:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997215.002850:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704375040 00000100:00100000:1.0:1789997215.002852:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997215.002865:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704375040 00000100:00100000:1.0:1789997215.002896:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704375168 00000100:00100000:1.0:1789997215.002902:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704375168 00000100:00100000:2.0:1789997215.002928:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 890 00000100:00100000:2.0:1789997215.002943:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704375040:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997215.002969:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1010 00000100:00100000:1.0:1789997215.002981:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704375168:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997215.003038:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704375168:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997215.003046:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1010 00000100:00080000:1.0:1789997215.003068:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997215.003125:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704375040:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 185us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997215.003133:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 890 00000100:00100000:2.0:1789997215.003967:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997215.004772:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704375296 00000100:00100000:1.0:1789997215.004782:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704375296 00000100:00100000:1.0:1789997215.004847:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 573 00000100:00100000:1.0:1789997215.004859:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704375296:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997215.004923:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7415850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704375296:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 67us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997215.004930:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 573 00000100:00080000:1.0:1789997215.005135:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997215.180404:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712895232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997215.180473:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997215.180583:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712895232 00000100:00100000:0.0:1789997215.180592:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712895232 00000100:00100000:0.0:1789997215.180670:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1789997215.180679:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712895232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997215.180714:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997215.181868:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712895232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997215.181883:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1789997215.182457:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712895232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997215.186946:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712895360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997215.187025:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789997215.187089:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997215.187446:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712895360 00000100:00100000:1.0:1789997215.187456:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712895360 00000100:00100000:1.0:1789997215.187520:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1789997215.187531:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712895360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997215.187570:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997215.187634:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712895360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997215.187642:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00080000:1.0:1789997215.187681:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997215.187714:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712895360:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789997215.268388:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00010000:00010000:1.0:1789997215.499620:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997215.499928:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997215.499932:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997215.499937:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997215.499985:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997215.499996:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997215.500008:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997215.500035:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712895488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997215.500106:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997215.500178:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c11ca780 going to sleep for 11 seconds 00000100:00100000:1.0:1789997215.500245:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712895488 00000100:00100000:1.0:1789997215.500253:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712895488 00000100:00100000:1.0:1789997215.500305:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1789997215.500314:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712895488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997215.500327:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997215.500339:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ba9c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997215.500361:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ba9c expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997215.500372:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ba9c expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997215.500380:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997215.500423:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712895488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997215.500430:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1789997215.500619:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712895488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997215.500633:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997215.500643:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997215.500683:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997215.500688:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997215.500701:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997216.525844:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997217.099923:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997217.099967:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704375424 00000100:00100000:0.0:1789997217.099979:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704375424 00000100:00100000:0.0:1789997217.100052:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 538 00000100:00100000:0.0:1789997217.100062:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40430:x1876946704375424:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997217.100081:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997217.100177:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592baaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae98c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100252:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100266:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100290:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100323:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100330:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100337:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100698:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592babf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100709:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592babf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100717:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592babf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997217.100741:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789997217.100745:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997217.100766:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592babf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100777:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100784:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100790:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100796:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997217.100801:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100808:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100821:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997217.100824:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997217.100828:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100838:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100859:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100864:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100870:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100875:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997217.100878:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100884:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100891:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997217.100893:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997217.100896:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100901:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bab8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100932:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592baaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae98c expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100949:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592babf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae98c expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.100957:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997217.100959:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997217.100961:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789997217.101025:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40430:x1876946704375424:12345-192.168.204.4@tcp:101:touch.0 Request processed in 964us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997217.101033:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 538 00000100:00080000:1.0:1789997217.111406:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997217.121333:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997217.125606:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704375680 00000100:00100000:0.0:1789997217.125620:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704375680 00000100:00100000:0.0:1789997217.125693:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 539 00000100:00100000:0.0:1789997217.125704:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40430:x1876946704375680:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997217.125724:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997217.125746:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bac6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae993 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125830:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125845:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125857:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125871:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125879:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125890:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997217.125904:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:0.0:1789997217.125923:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125931:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125938:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125944:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997217.125948:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125956:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125968:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997217.125971:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997217.125976:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.125983:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bacd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126002:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126012:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126018:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126023:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997217.126026:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126032:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126039:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38c28e9500) 00010000:00010000:0.0:1789997217.126041:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997217.126044:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126051:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bad4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126081:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bac6 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae993 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126092:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997217.126094:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997217.126113:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bac6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae993 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997217.126129:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997217.126188:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40430:x1876946704375680:12345-192.168.204.4@tcp:101:touch.0 Request processed in 486us (4863us total) trans 0 rc 301/301 00000100:00100000:0.0:1789997217.126195:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 539 00000100:00100000:3.0:1789997217.137772:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997217.137892:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704375808 00000100:00100000:1.0:1789997217.137902:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704375808 00000100:00100000:1.0:1789997217.137972:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 540 00000100:00100000:1.0:1789997217.137983:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40430:x1876946704375808:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997217.138017:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997217.138039:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592badb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae99a expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138112:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138128:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138140:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138156:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138163:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138169:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138188:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138196:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138203:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138209:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997217.138220:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138228:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138240:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:1.0:1789997217.138243:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997217.138248:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138255:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138267:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138287:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138294:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138299:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997217.138302:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138309:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138317:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38e062d100) 00010000:00010000:1.0:1789997217.138319:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997217.138328:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138335:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138504:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592badb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae99a expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138515:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:1.0:1789997217.138518:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997217.138523:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592badb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae99a expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997217.138534:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997217.138598:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40430:x1876946704375808:12345-192.168.204.4@tcp:101:touch.0 Request processed in 617us (833us total) trans 0 rc 301/301 00000100:00100000:1.0:1789997217.138606:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 540 00000100:00100000:0.0:1789997217.154360:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997217.154452:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704375936 00000100:00100000:2.0:1789997217.154474:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704375936 00000100:00100000:2.0:1789997217.154536:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 541 00000100:00100000:2.0:1789997217.154545:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40430:x1876946704375936:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997217.154566:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997217.154585:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592baf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9a1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154686:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154701:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154712:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154737:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154745:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154753:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154780:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154787:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154794:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154799:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997217.154803:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154810:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154822:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997217.154825:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997217.154830:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154836:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592baf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154849:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154855:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154861:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154879:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997217.154882:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154889:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154896:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997217.154898:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997217.154901:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154906:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bafe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154939:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592baf0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9a1 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154948:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997217.154950:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997217.154953:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592baf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9a1 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997217.154962:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3800, rc 0) 00000100:00100000:2.0:1789997217.155027:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40430:x1876946704375936:12345-192.168.204.4@tcp:101:touch.0 Request processed in 483us (675us total) trans 0 rc 301/301 00000100:00100000:2.0:1789997217.155036:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 541 00010000:00010000:3.0:1789997217.548060:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997218.252124:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712895744:0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.252207:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997218.252310:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712896256:0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.252331:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997218.252370:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997218.252391:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712895872:0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.252417:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997218.252461:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712895744 00000100:00100000:3.0:1789997218.252468:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712895744 00000100:00100000:3.0:1789997218.252508:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712896256 00000100:00100000:3.0:1789997218.252511:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712896256 00000100:00100000:3.0:1789997218.252538:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712895872 00000100:00100000:3.0:1789997218.252541:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712895872 00000100:00100000:3.0:1789997218.252564:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1789997218.252573:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712895744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.252622:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712895744:12345-0@lo:400:kworker.0 Request processed in 50us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997218.252629:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:3.0:1789997218.252645:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1789997218.252686:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712896256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.252714:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712896256:12345-0@lo:400:kworker.0 Request processed in 64us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997218.252720:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1789997218.252733:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1789997218.252739:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712895872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.252763:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712895872:12345-0@lo:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997218.252768:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00080000:3.0:1789997218.252788:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997218.252821:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712895872:0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.252830:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712895744:0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.252841:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712896256:0@lo:400:kworker.0 00000100:00100000:1.0:1789997218.255215:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712895616:0@lo:400:kworker.0 00000100:00100000:1.0:1789997218.255296:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997218.255346:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712896128:0@lo:400:kworker.0 00000100:00100000:1.0:1789997218.255370:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997218.255400:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997218.255405:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712896000:0@lo:400:kworker.0 00000100:00100000:1.0:1789997218.255421:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997218.255477:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712896128 00000100:00100000:1.0:1789997218.255484:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712896128 00000100:00100000:1.0:1789997218.255528:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712896000 00000100:00100000:1.0:1789997218.255544:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712896000 00000100:00100000:1.0:1789997218.255570:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1789997218.255579:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712896128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997218.255625:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712896128:12345-0@lo:400:kworker.0 Request processed in 47us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997218.255631:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:1.0:1789997218.255644:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1789997218.255650:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712896000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997218.255708:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712896000:12345-0@lo:400:kworker.0 Request processed in 58us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997218.255713:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00080000:1.0:1789997218.255732:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997218.255735:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997218.255757:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712896000:0@lo:400:kworker.0 00000100:00100000:1.0:1789997218.255765:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:1.0:1789997218.255769:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c571ed80, transno 4294967330 00000100:00100000:1.0:1789997218.255788:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712896128:0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.256424:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712895616 00000100:00100000:3.0:1789997218.256430:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712895616 00000100:00100000:3.0:1789997218.256481:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1789997218.256489:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712895616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997218.256543:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712895616:12345-0@lo:400:kworker.0 Request processed in 55us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997218.256549:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1789997218.256798:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712895616:0@lo:400:kworker.0 00010000:00010000:1.0:1789997218.570878:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997218.737146:0:69163:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7c4a64d0 20000000:00000080:2.0:1789997218.737165:0:69163:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae93000 uarg=0000000000000000 00010000:00010000:2.0:1789997218.737476:0:69163:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789997218.737508:0:69163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997218.737513:0:69163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997218.737523:0:69163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592babf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae98c expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997218.737550:0:69163:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789997218.737567:0:69163:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997218.737580:0:69163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997218.737594:0:69163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ba9c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997218.737602:0:69163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997218.737636:0:69163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ba9c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997218.737903:0:69163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ba9c expref: 18 pid: 5803 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997218.737919:0:69163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69163:1876946712896384:0@lo:104: 00000100:00100000:2.0:1789997218.738044:0:69163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997218.738190:0:69163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb648a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789997218.738312:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712896384 00000100:00100000:1.0:1789997218.738320:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712896384 00000100:00100000:1.0:1789997218.738357:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789997218.738365:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:69163:x1876946712896384:12345-0@lo:104: 00010000:00010000:1.0:1789997218.738377:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997218.738482:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997218.738488:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:69163:x1876946712896384:12345-0@lo:104: Request processed in 124us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997218.738496:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00010000:00010000:0.0:1789997218.738555:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997218.738562:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.738569:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997218.738573:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.738583:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997218.738591:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997218.738597:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997218.738634:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.738640:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997218.738686:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.738693:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592ba9c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592baa3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.738708:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997218.738709:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997218.738711:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997218.738910:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712896512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997218.738954:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997218.739030:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712896512 00000100:00100000:0.0:1789997218.739034:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712896512 00010000:00010000:0.0:1789997218.739054:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ba9c expref: 19 pid: 5803 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997218.739080:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789997218.739086:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712896512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997218.739096:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997218.739100:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ba9c expref: 19 pid: 5803 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739110:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ba9c expref: 19 pid: 5803 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739125:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739133:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739147:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739154:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739162:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739169:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739175:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997218.739179:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739186:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739194:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997218.739201:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997218.739339:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712896512:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997218.739346:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789997218.739450:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712896512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997218.739580:0:69163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592baa3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ba9c expref: 18 pid: 5803 timeout: 1557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997218.739591:0:69163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69163:1876946712896384:0@lo:104: 00010000:00010000:2.0:1789997218.739605:0:69163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997218.739614:0:69163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997218.739620:0:69163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997218.739626:0:69163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bb05 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997219.596692:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997220.118368:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997220.118424:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997220.118468:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997220.118638:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704376064 00000100:00100000:1.0:1789997220.118648:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704376064 00000100:00100000:1.0:1789997220.118727:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 893 00000100:00100000:1.0:1789997220.118737:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704376064:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997220.118815:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704376064:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997220.118822:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 893 00000100:00100000:0.0:1789997220.119228:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704376192 00000100:00100000:0.0:1789997220.119235:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704376192 00000100:00100000:0.0:1789997220.119293:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1014 00000100:00100000:0.0:1789997220.119301:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704376192:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997220.119339:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704376192:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997220.119346:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1014 00000100:00080000:1.0:1789997220.119430:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997220.119605:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704376320 00000100:00100000:2.0:1789997220.119611:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704376320 00000100:00100000:2.0:1789997220.119686:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 576 00000100:00100000:2.0:1789997220.119696:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704376320:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997220.119743:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704376320:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 49us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997220.119749:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 576 00000100:00080000:1.0:1789997220.120162:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997220.298874:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712896640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997220.298950:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997220.299805:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997220.299818:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712896768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997220.299856:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997220.300137:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712896640 00000100:00100000:1.0:1789997220.300146:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712896640 00000100:00100000:3.0:1789997220.300474:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712896768 00000100:00100000:3.0:1789997220.300479:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712896768 00000100:00100000:3.0:1789997220.300873:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1789997220.300883:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712896768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997220.300915:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997220.300975:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712896768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997220.300981:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:3.0:1789997220.301026:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712896768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997220.301210:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1789997220.301218:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712896640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997220.301239:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997220.301275:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712896640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997220.301282:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00080000:1.0:1789997220.301409:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997220.301413:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997220.303831:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712896640:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789997220.619509:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997220.619516:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997220.619521:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997220.619591:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997220.619606:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997220.619619:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997220.619683:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712896896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997220.619761:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997220.619823:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32bc240 going to sleep for 11 seconds 00000100:00100000:2.0:1789997220.619851:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712896896 00000100:00100000:2.0:1789997220.619860:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712896896 00000100:00100000:2.0:1789997220.619937:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1789997220.619950:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712896896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997220.619966:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997220.619982:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bb0c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997220.620009:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bb0c expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997220.620019:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bb0c expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997220.620029:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789997220.620069:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712896896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997220.620076:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00010000:00010000:3.0:1789997220.620082:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997220.620276:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712896896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997220.620305:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997220.620314:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997220.620334:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997220.620339:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997220.620345:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997221.362806:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997221.362858:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704376448 00000100:00100000:0.0:1789997221.362870:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704376448 00000100:00100000:0.0:1789997221.362931:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 542 00000100:00100000:0.0:1789997221.362941:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40517:x1876946704376448:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997221.362962:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997221.362986:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9a8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.363054:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.363068:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.363082:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997221.363116:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789997221.363120:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997221.363137:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.363160:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9a8 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.363194:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9a8 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.363202:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997221.363205:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997221.363208:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997221.363430:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40517:x1876946704376448:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 489us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997221.363437:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 542 00000100:00100000:3.0:1789997221.371999:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997221.372131:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704376704 00000100:00100000:0.0:1789997221.372142:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704376704 00000100:00100000:0.0:1789997221.372197:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 543 00000100:00100000:0.0:1789997221.372208:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40517:x1876946704376704:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997221.372262:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997221.372299:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9a8 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.372318:0:5812:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592babf) 00010000:00010000:0.0:1789997221.372323:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997221.372333:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997221.372358:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.372383:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.372394:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997221.372823:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d3c9fbb reply state 00000000bc6acb11 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997221.372835:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997221.372844:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:0.0:1789997221.372926:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40517:x1876946704376704:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 719us (935us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789997221.372934:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 543 00010000:00010000:0.0:1789997221.375822:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.375840:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.375847:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.376126:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997221.376135:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.376144:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.376160:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997221.376163:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997221.376167:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.376174:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997221.642878:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997222.128236:0:69360:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc122f060 20000000:00000080:0.0:1789997222.128253:0:69360:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e5000 uarg=0000000000000000 00010000:00010000:0.0:1789997222.128979:0:69360:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997222.128997:0:69360:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997222.129011:0:69360:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997222.129029:0:69360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997222.129046:0:69360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bb0c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997222.129054:0:69360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997222.129095:0:69360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bb0c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997222.129110:0:69360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bb0c expref: 18 pid: 5805 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997222.129124:0:69360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69360:1876946712897024:0@lo:104: 00000100:00100000:0.0:1789997222.129189:0:69360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997222.129318:0:69360:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997222.129462:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712897024 00000100:00100000:1.0:1789997222.129471:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712897024 00000100:00100000:1.0:1789997222.129568:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789997222.129579:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:69360:x1876946712897024:12345-0@lo:104: 00010000:00010000:1.0:1789997222.129591:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997222.129683:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997222.129699:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:69360:x1876946712897024:12345-0@lo:104: Request processed in 123us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997222.129707:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00010000:00010000:3.0:1789997222.129767:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997222.129774:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.129781:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997222.129785:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.129794:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997222.129802:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997222.129808:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997222.129838:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.129844:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997222.129863:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.129869:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592bb0c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bb13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.129886:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997222.129888:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997222.129890:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997222.129909:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712897152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997222.129941:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997222.129985:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712897152 00000100:00100000:3.0:1789997222.129989:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712897152 00010000:00010000:3.0:1789997222.130007:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bb0c expref: 19 pid: 5805 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997222.130029:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789997222.130036:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712897152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997222.130045:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997222.130050:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bb0c expref: 19 pid: 5805 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130059:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bb0c expref: 19 pid: 5805 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130074:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130082:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130095:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130103:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130110:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130119:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130124:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997222.130128:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130134:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130142:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.130150:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997222.130177:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712897152:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997222.130184:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789997222.130218:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712897152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997222.130433:0:69360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592bb13 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bb0c expref: 18 pid: 5805 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997222.130444:0:69360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69360:1876946712897024:0@lo:104: 00010000:00010000:0.0:1789997222.130457:0:69360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997222.130467:0:69360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997222.130473:0:69360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997222.130480:0:69360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592bb2f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997222.669751:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997223.372542:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712897664:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.372877:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712897280:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.372943:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997223.372996:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712897792:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373020:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997223.373073:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712897536:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373097:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997223.373118:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789997223.373125:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712897408:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373146:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997223.373163:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712897920:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373182:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997223.373210:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712897536 00000100:00100000:3.0:1789997223.373218:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712897536 00000100:00100000:3.0:1789997223.373270:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712897408 00000100:00100000:3.0:1789997223.373273:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712897408 00000100:00100000:3.0:1789997223.373291:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712897920 00000100:00100000:3.0:1789997223.373293:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712897920 00000100:00100000:3.0:1789997223.373313:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1789997223.373320:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712897536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373396:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712897536:12345-0@lo:400:kworker.0 Request processed in 75us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997223.373403:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1789997223.373422:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1789997223.373428:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712897408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373455:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712897408:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997223.373460:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1789997223.373471:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1789997223.373477:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712897920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373504:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712897920:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997223.373509:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1789997223.373575:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712897408:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373589:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712897920:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373597:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712897536:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373637:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712897792 00000100:00100000:3.0:1789997223.373640:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712897792 00000100:00100000:3.0:1789997223.373910:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1789997223.373918:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712897792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.373958:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712897792:12345-0@lo:400:kworker.0 Request processed in 42us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997223.373965:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1789997223.373983:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712897280 00000100:00100000:3.0:1789997223.373987:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712897280 00000100:00100000:3.0:1789997223.374010:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1789997223.374017:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712897280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.374045:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712897280:12345-0@lo:400:kworker.0 Request processed in 29us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997223.374051:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1789997223.374091:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712897280:0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.374102:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712897792:0@lo:400:kworker.0 00000100:00080000:3.0:1789997223.374129:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997223.374134:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997223.374224:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997223.375432:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712897664 00000100:00100000:3.0:1789997223.375440:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712897664 00000100:00100000:3.0:1789997223.375483:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:3.0:1789997223.375491:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712897664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997223.375543:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712897664:12345-0@lo:400:kworker.0 Request processed in 52us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997223.375549:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1789997223.375756:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712897664:0@lo:400:kworker.0 00000100:00080000:1.0:1789997223.380857:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1789997223.627007:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997223.627014:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997223.627018:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997223.627062:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997223.627075:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997223.627087:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997223.627180:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712898048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997223.627253:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997223.627342:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997223.627451:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712898048 00000100:00100000:3.0:1789997223.627460:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712898048 00000100:00100000:3.0:1789997223.627622:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1789997223.627633:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712898048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997223.627648:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997223.627692:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bb36 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997223.627720:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bb36 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997223.627732:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bb36 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997223.627741:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997223.627793:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712898048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997223.627799:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:2.0:1789997223.627920:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712898048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997223.627935:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997223.627944:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997223.627967:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997223.627972:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997223.627979:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997223.690866:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997223.933446:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00010000:00010000:3.0:1789997224.715013:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997224.895430:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997224.902211:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704376832 00000100:00100000:0.0:1789997224.902227:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704376832 00000100:00100000:0.0:1789997224.902326:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 544 00000100:00100000:0.0:1789997224.902337:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704376832:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997224.902477:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704376832:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 141us (7123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997224.902484:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 544 00000100:00080000:1.0:1789997224.904164:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997224.905855:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997224.906064:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704376960 00000100:00100000:3.0:1789997224.906075:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704376960 00000100:00100000:3.0:1789997224.906127:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 275 00000100:00100000:3.0:1789997224.906137:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876946704376960:12345-192.168.204.4@tcp:8:lfs.0 00010000:00080000:3.0:1789997224.906171:0:6658:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1413 last 0 00000020:00000080:3.0:1789997224.906204:0:6658:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592bb44 00002000:00100000:3.0:1789997224.906217:0:6658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38c53df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789997224.906244:0:6658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789997224.906489:0:6658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789997224.906520:0:6658:0:(import.c:65:import_set_state_nolock()) ffff8a38c53da800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789997224.906707:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704376960:12345-192.168.204.4@tcp:8:lfs.0 Request processed in 569us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997224.906716:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 275 00000100:00100000:2.0:1789997224.911431:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997224.911505:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704377088 00000100:00100000:3.0:1789997224.911516:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704377088 00000100:00100000:3.0:1789997224.912022:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 276 00000100:00100000:3.0:1789997224.912035:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40602:x1876946704377088:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997224.912440:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40602:x1876946704377088:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 406us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997224.912448:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 276 00000100:00080000:1.0:1789997224.913321:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997224.914486:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997224.914574:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704377216 00000100:00100000:3.0:1789997224.914583:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704377216 00000100:00100000:3.0:1789997224.914641:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 277 00000100:00100000:3.0:1789997224.914780:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377216:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:1.0:1789997224.915182:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997224.915220:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377216:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 569us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997224.915228:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 277 00000100:00100000:0.0:1789997224.924224:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997224.924371:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704377344 00000100:00100000:3.0:1789997224.924381:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704377344 00000100:00100000:3.0:1789997224.924456:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 545 00000100:00100000:3.0:1789997224.924466:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377344:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997224.925372:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377344:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 905us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997224.925383:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 545 00000100:00100000:2.0:1789997224.935637:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997224.935755:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704377472 00000100:00100000:3.0:1789997224.935765:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704377472 00000100:00100000:3.0:1789997224.935873:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 546 00000100:00100000:3.0:1789997224.935884:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377472:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997224.935976:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377472:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 94us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997224.935984:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 546 00000100:00100000:2.0:1789997224.939735:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997224.942141:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704377600 00000100:00100000:3.0:1789997224.942156:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704377600 00000100:00100000:3.0:1789997224.942227:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 278 00000100:00100000:3.0:1789997224.942238:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40602:x1876946704377600:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997224.942869:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40602:x1876946704377600:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 630us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997224.942877:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 278 00000100:00100000:0.0:1789997224.947420:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997224.947524:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704377728 00000100:00100000:3.0:1789997224.947596:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704377728 00000100:00100000:1.0:1789997224.947707:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 279 00000100:00100000:1.0:1789997224.947722:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377728:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997224.948084:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377728:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 366us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997224.948092:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 279 00000100:00100000:2.0:1789997224.953800:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997224.953965:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704377856 00000100:00100000:0.0:1789997224.953975:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704377856 00000100:00100000:0.0:1789997224.954041:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 547 00000100:00100000:0.0:1789997224.954050:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377856:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997224.954525:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40602:x1876946704377856:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 474us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997224.954544:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 547 00000100:00100000:2.0:1789997224.998050:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997224.998172:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704377984 00000100:00100000:0.0:1789997224.998183:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704377984 00000100:00100000:0.0:1789997224.998312:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 548 00000100:00100000:0.0:1789997224.998324:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40606:x1876946704377984:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997224.998349:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997224.998374:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9af expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997224.998443:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997224.998458:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997224.998471:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997224.998484:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997224.998492:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997224.998498:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.998909:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bb60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.998919:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.998939:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997224.998965:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:1.0:1789997224.998969:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997224.999002:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999026:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999034:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999041:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999047:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997224.999051:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999060:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999076:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:1.0:1789997224.999080:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997224.999085:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999091:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bb52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999104:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999110:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999116:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999127:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997224.999130:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999137:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999146:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9800) 00010000:00010000:1.0:1789997224.999148:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997224.999151:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999157:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bb59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999245:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bb4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9af expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999263:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bb60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9af expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997224.999270:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997224.999272:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997224.999275:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997224.999354:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40606:x1876946704377984:12345-192.168.204.4@tcp:101:dd.0 Request processed in 1032us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997224.999361:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 548 00000100:00100000:1.0:1789997225.003870:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997225.004444:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704378240 00000100:00100000:2.0:1789997225.004458:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704378240 00000100:00100000:2.0:1789997225.004570:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 549 00000100:00100000:2.0:1789997225.004581:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40606:x1876946704378240:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:2.0:1789997225.004604:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997225.004625:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bb67 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9b6 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.004963:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.004979:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.005005:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.005021:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.005029:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.005035:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997225.005802:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:2.0:1789997225.006134:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bb7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006148:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006158:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006198:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006206:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006213:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006219:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997225.006223:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006236:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006248:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:2.0:1789997225.006251:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997225.006256:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006262:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592bb6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997225.006275:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000669751a reply state 00000000d0fe0c22 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997225.006283:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997225.006327:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bb67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9b6 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006341:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bb7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9b6 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.006348:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997225.006350:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997225.006352:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789997225.006418:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:40606:x1876946704378240:12345-192.168.204.4@tcp:101:dd.0 Request processed in 1839us (2558us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789997225.006426:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 549 00010000:00010000:3.0:1789997225.014540:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997225.014560:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997225.014568:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997225.014575:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997225.014580:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997225.014588:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997225.014604:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38d0bdfb00) 00010000:00010000:3.0:1789997225.014607:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997225.014612:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997225.014619:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bb75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997225.018274:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997225.018348:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704378368 00000100:00100000:2.0:1789997225.018360:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704378368 00000100:00100000:2.0:1789997225.018426:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 280 00000100:00100000:2.0:1789997225.018437:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40606:x1876946704378368:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:2.0:1789997225.018456:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997225.018478:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9bd expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997225.018506:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789997225.018527:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1413s v=(0 0) 00010000:00010000:2.0:1789997225.018532:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997225.018542:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 7 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.018561:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 7 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997225.018574:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997225.018731:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40606:x1876946704378368:12345-192.168.204.4@tcp:101:dd.0 Request processed in 295us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997225.018738:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 280 00000100:00100000:2.0:1789997225.034485:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997225.034587:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704378496 00000100:00100000:1.0:1789997225.034599:0:6662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704378496 00002000:00100000:1.0:1789997225.034705:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff8a38f9d71c00 x1876946704378496/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:201/0 lens 488/0 e 0 to 0 dl 1789997236 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789997225.034717:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f9d71c00 with x1876946704378496 ext(0->1048575) 00002000:00010000:1.0:1789997225.034723:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38f9d71c00 00000100:00100000:1.0:1789997225.034755:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:1.0:1789997225.034766:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704378496:12345-192.168.204.4@tcp:4:dd.0 00000001:00100000:3.0:1789997225.149446:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:0.0:1789997225.164416:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2352:x1876946704378496:12345-192.168.204.4@tcp:4:dd.0 Request processed in 129637us (129925us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789997225.164433:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00002000:00100000:0.0:1789997225.164448:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x11:0x0] (0->1048575) req@ffff8a38f9d71c00 x1876946704378496/t4294967329(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:201/0 lens 488/448 e 0 to 0 dl 1789997236 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789997225.164465:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f9d71c00 with x1876946704378496 ext(0->1048575) 00002000:00010000:0.0:1789997225.164472:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38f9d71c00 00000100:00100000:2.0:1789997225.170350:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997225.170789:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704378624 00000100:00100000:0.0:1789997225.170801:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704378624 00000100:00100000:0.0:1789997225.170867:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 550 00000100:00100000:0.0:1789997225.170878:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:40606:x1876946704378624:12345-192.168.204.4@tcp:44:dd.0 00000100:00100000:3.0:1789997225.233995:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:40606:x1876946704378624:12345-192.168.204.4@tcp:44:dd.0 Request processed in 63108us (63645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997225.234008:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 550 00000001:00080000:1.0:1789997225.234079:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000100:00100000:2.0:1789997225.238950:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997225.239030:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704378752 00000100:00100000:3.0:1789997225.239041:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704378752 00000100:00100000:3.0:1789997225.239094:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 281 00000100:00100000:3.0:1789997225.239102:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704378752:12345-192.168.204.4@tcp:16:dd.0 00000100:00100000:2.0:1789997225.247395:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997225.247485:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997225.247561:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704378880 00000100:00100000:0.0:1789997225.247572:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704378880 00000100:00100000:0.0:1789997225.247627:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 897 00000100:00100000:0.0:1789997225.247636:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704378880:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997225.247719:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704378880:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997225.247727:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 897 00000100:00100000:3.0:1789997225.248882:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704379008 00000100:00100000:3.0:1789997225.248891:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704379008 00000100:00100000:3.0:1789997225.248955:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 579 00000100:00100000:3.0:1789997225.248963:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704379008:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997225.249019:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704379008:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 57us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997225.249029:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 579 00000001:00080000:1.0:1789997225.278023:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000100:00100000:0.0:1789997225.278357:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704378752:12345-192.168.204.4@tcp:16:dd.0 Request processed in 39084us (39246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997225.278369:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 281 00000100:00100000:0.0:1789997225.282057:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997225.282120:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704379264 00000100:00100000:1.0:1789997225.282131:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704379264 00000100:00100000:1.0:1789997225.282255:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 59 00000100:00100000:1.0:1789997225.282279:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40606:x1876946704379264:12345-192.168.204.4@tcp:35:dd.0 00000001:00080000:1.0:1789997225.282787:0:11802:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000100:00100000:1.0:1789997225.282955:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:40606:x1876946704379264:12345-192.168.204.4@tcp:35:dd.0 Request processed in 688us (908us total) trans 4294967510 rc 0/0 00000100:00100000:1.0:1789997225.282963:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 59 00000020:00080000:1.0:1789997225.282969:0:11802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789997225.418983:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712898304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997225.419058:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997225.419149:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712898304 00000100:00100000:2.0:1789997225.419158:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712898304 00000100:00100000:3.0:1789997225.419218:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997225.419228:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712898176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997225.419228:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1789997225.419237:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712898304:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997225.419258:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789997225.419261:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789997225.419312:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712898176 00000100:00100000:2.0:1789997225.419313:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712898304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997225.419316:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712898176 00000100:00100000:2.0:1789997225.419320:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1789997225.419335:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1789997225.419341:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712898176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997225.419363:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789997225.419382:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997225.419385:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997225.419396:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712898176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997225.420127:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712898304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997225.420188:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712898176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997225.429571:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00010000:00010000:3.0:1789997225.740776:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997226.267294:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00010000:00010000:0.0:1789997226.762936:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997227.223834:0:69608:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1415916177527ns, next at 1336289532262ns, rc = 0 00000004:00080000:0.0:1789997227.223958:0:69608:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1415916303721ns, next at 1399723660239ns, rc = 0 00000004:00080000:2.0:1789997227.229927:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000004:00080000:2.0:1789997227.230382:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 48 committed 00010000:00010000:3.0:1789997227.786965:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997228.381955:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997228.382032:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704379392 00000100:00100000:3.0:1789997228.382042:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704379392 00000100:00100000:3.0:1789997228.382147:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 551 00000100:00100000:3.0:1789997228.382159:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40799:x1876946704379392:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997228.382268:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40799:x1876946704379392:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997228.382275:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 551 00000100:00080000:1.0:1789997228.385184:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997228.388772:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997228.389823:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704379520 00000100:00100000:1.0:1789997228.389835:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704379520 00000100:00100000:1.0:1789997228.389949:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 282 00000100:00100000:1.0:1789997228.389961:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40799:x1876946704379520:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997228.390326:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40799:x1876946704379520:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 367us (1562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997228.390340:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 282 00000100:00080000:3.0:1789997228.396210:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997228.397633:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997228.397686:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704379648 00000100:00100000:2.0:1789997228.397696:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704379648 00000100:00100000:2.0:1789997228.397756:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 283 00000100:00100000:2.0:1789997228.397768:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40799:x1876946704379648:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997228.398101:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40799:x1876946704379648:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 335us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997228.398108:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 283 00000100:00080000:3.0:1789997228.398208:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997228.406025:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997228.410058:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704379776 00000100:00100000:3.0:1789997228.410074:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704379776 00000100:00100000:3.0:1789997228.410174:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 552 00000100:00100000:3.0:1789997228.410185:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40799:x1876946704379776:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997228.410624:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40799:x1876946704379776:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 440us (4605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997228.410632:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 552 00000100:00100000:0.0:1789997228.424345:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997228.427551:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704379904 00000100:00100000:3.0:1789997228.427563:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704379904 00000100:00100000:3.0:1789997228.427620:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 553 00000100:00100000:3.0:1789997228.427631:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40799:x1876946704379904:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997228.427761:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40799:x1876946704379904:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 131us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997228.427769:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 553 00000100:00100000:3.0:1789997228.429793:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997228.429935:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704380032 00000100:00100000:2.0:1789997228.429943:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704380032 00000100:00100000:2.0:1789997228.429999:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 284 00000100:00100000:2.0:1789997228.430010:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40799:x1876946704380032:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997228.430437:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:40799:x1876946704380032:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 426us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997228.430446:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 284 00000100:00100000:2.0:1789997228.436989:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997228.437164:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704380160 00000100:00100000:3.0:1789997228.437174:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704380160 00000100:00100000:3.0:1789997228.437275:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 285 00000100:00100000:3.0:1789997228.437285:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40799:x1876946704380160:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997228.437706:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:40799:x1876946704380160:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 421us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997228.437715:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 285 00000100:00100000:0.0:1789997228.439392:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997228.439539:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704380288 00000100:00100000:2.0:1789997228.439546:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704380288 00000100:00100000:2.0:1789997228.439634:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 554 00000100:00100000:2.0:1789997228.439645:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40799:x1876946704380288:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997228.440149:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40799:x1876946704380288:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 504us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997228.440157:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 554 00000100:00100000:0.0:1789997228.486512:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997228.486606:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704380544 00000100:00100000:2.0:1789997228.486617:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704380544 00000100:00100000:2.0:1789997228.486779:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 555 00000100:00100000:2.0:1789997228.486801:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:40803:x1876946704380544:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997228.486857:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997228.486888:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bb7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9b6 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.486908:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997228.486919:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997228.486944:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.486958:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.486973:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.486987:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.486995:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.487002:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.487340:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.487361:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.487368:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997228.488328:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9280 00000004:00080000:2.0:1789997228.488341:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1417180686372ns, next at 1418180683641ns, rc = 0 00010000:00010000:2.0:1789997228.488432:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488445:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488454:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488468:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488475:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488481:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488509:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997228.488531:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488537:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488543:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488549:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997228.488553:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488561:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488571:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997228.488574:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997228.488579:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488588:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592bb9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488606:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488612:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488617:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488622:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997228.488625:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488631:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488639:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:2.0:1789997228.488642:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997228.488645:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997228.488682:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bb91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997228.488692:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010e67170 reply state 000000008ff2980d transno 4294967511 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997228.488701:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997228.488798:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:40803:x1876946704380544:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1996us (2294us total) trans 4294967511 rc 0/0 00000100:00100000:2.0:1789997228.488806:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 555 00010000:00010000:3.0:1789997228.488968:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997228.488975:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997228.488982:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997228.488985:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997228.488992:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997228.489002:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:3.0:1789997228.489005:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997228.489008:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997228.489013:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bba6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997228.489029:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997228.489031:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997228.489033:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997228.491684:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712898432:0@lo:400:kworker.0 00000100:00100000:0.0:1789997228.491684:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712898560:0@lo:400:kworker.0 00000100:00100000:2.0:1789997228.491759:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712898816:0@lo:400:kworker.0 00000100:00100000:1.0:1789997228.494677:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997228.494751:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712898944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997228.494760:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997228.494797:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997228.494797:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997228.494842:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712898688:0@lo:400:kworker.0 00000100:00100000:0.0:1789997228.494856:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712899072:0@lo:400:kworker.0 00000100:00100000:1.0:1789997228.494869:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997228.494875:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712898432 00000100:00100000:3.0:1789997228.494886:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712898432 00000100:00100000:0.0:1789997228.494892:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997228.494940:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1789997228.494948:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712898432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997228.495011:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712898432:12345-0@lo:400:kworker.0 Request processed in 63us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997228.495018:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1789997228.495050:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712898816 00000100:00100000:3.0:1789997228.495053:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712898816 00000100:00100000:3.0:1789997228.495081:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712898944 00000100:00100000:3.0:1789997228.495083:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712898944 00000100:00100000:2.0:1789997228.495106:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712898688 00000100:00100000:1.0:1789997228.495106:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712898560 00000100:00100000:3.0:1789997228.495111:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1789997228.495113:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712898688 00000100:00100000:1.0:1789997228.495115:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712898560 00000100:00100000:3.0:1789997228.495120:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712898816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997228.495140:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1789997228.495147:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712899072 00000100:00100000:2.0:1789997228.495153:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712899072 00000100:00100000:0.0:1789997228.495153:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712898944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997228.495160:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1789997228.495167:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712898816:12345-0@lo:400:kworker.0 Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997228.495173:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712898688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997228.495178:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1789997228.495183:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1789997228.495192:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712898560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997228.495203:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712898944:12345-0@lo:400:kworker.0 Request processed in 54us (408us total) trans 0 rc 0/0 00000100:00080000:3.0:1789997228.495204:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997228.495211:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997228.495216:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00080000:3.0:1789997228.495217:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997228.495226:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712898688:12345-0@lo:400:kworker.0 Request processed in 57us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997228.495247:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1789997228.495257:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1789997228.495267:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712899072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997228.495303:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712898688:0@lo:400:kworker.0 00000100:00100000:0.0:1789997228.495314:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712899072:12345-0@lo:400:kworker.0 Request processed in 47us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997228.495321:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:1.0:1789997228.495334:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712898432:0@lo:400:kworker.0 00000100:00100000:1.0:1789997228.495346:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712898944:0@lo:400:kworker.0 00010000:00010000:0.0:1789997228.495400:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997228.495411:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997228.495420:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997228.495428:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997228.495434:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997228.495437:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712899072:0@lo:400:kworker.0 00010000:00010000:0.0:1789997228.495447:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997228.495530:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38d0bdf600) 00010000:00010000:0.0:1789997228.495534:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997228.495539:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997228.495546:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bb98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997228.495631:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712898816:0@lo:400:kworker.0 00000100:00100000:2.0:1789997228.496602:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712898560:12345-0@lo:400:kworker.0 Request processed in 1410us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997228.496612:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1789997228.497187:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712898560:0@lo:400:kworker.0 00010000:00010000:0.0:1789997228.811926:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997229.835649:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997230.172303:0:69752:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1418864646546ns, next at 1418180683641ns, rc = 0 00000004:00080000:1.0:1789997230.233598:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 48 committed 00000100:00100000:3.0:1789997230.235841:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997230.235864:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712899200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789997230.235943:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997230.236313:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712899200 00000100:00100000:0.0:1789997230.236322:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712899200 00000100:00100000:0.0:1789997230.236385:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789997230.236398:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712899200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997230.236429:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:17 count 1 00010000:00010000:0.0:1789997230.236462:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997230.236485:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 5 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997230.236508:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000004:00080000:1.0:1789997230.236516:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 47 committed 00000100:00080000:3.0:1789997230.236583:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997230.236857:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x11:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1789997230.236861:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997230.236867:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 4/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997230.236901:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 5 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997230.236916:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 5 pid: 8169 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997230.236930:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946712899328:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997230.238460:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789997230.243884:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946712899328:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997230.243919:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997230.244814:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997230.244888:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704380672 00000100:00100000:1.0:1789997230.244897:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704380672 00010000:00010000:1.0:1789997230.244979:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 6 pid: 8169 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997230.245015:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 313 00000100:00100000:1.0:1789997230.245024:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704380672:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997230.245043:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997230.245048:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 6 pid: 8169 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.245061:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 6 pid: 8169 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.245085:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a9fd3d5/0x65b43101d592bb8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9bd expref: 6 pid: 8169 timeout: 1518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.245103:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997230.245107:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997230.245113:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.245123:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.245159:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997230.245219:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704380672:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 195us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997230.245227:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 313 00010000:00010000:2.0:1789997230.245250:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997230.245263:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997230.245274:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997230.245283:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997230.245314:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997230.246187:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997230.246195:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.246215:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997230.246219:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.246229:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.246243:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997230.246250:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592bbad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789997230.246270:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997230.246271:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997230.246273:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997230.246275:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997230.246456:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712899200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10060us (10510us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789997230.246466:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000004:00080000:3.0:1789997230.246548:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38ffdf8700/2, rc 0, transno 4294967330 00000100:00100000:3.0:1789997230.246567:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712899200:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789997230.246807:0:69752:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1418939152320ns, next at 1399723660239ns, rc = 0 00000004:00080000:0.0:1789997230.251381:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 49 committed 00000100:00100000:1.0:1789997230.357980:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997230.358029:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997230.358030:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704380800 00000100:00100000:0.0:1789997230.358041:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704380800 00000100:00100000:1.0:1789997230.358078:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997230.358091:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 899 00000100:00100000:0.0:1789997230.358102:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704380800:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997230.358110:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704381056 00000100:00100000:1.0:1789997230.358116:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704381056 00000100:00100000:2.0:1789997230.358148:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704380928 00000100:00100000:2.0:1789997230.358155:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704380928 00000100:00100000:1.0:1789997230.358168:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 582 00000100:00100000:0.0:1789997230.358174:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704380800:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997230.358183:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 899 00000100:00100000:1.0:1789997230.358205:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704381056:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997230.358212:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1021 00000100:00100000:2.0:1789997230.358224:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704380928:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997230.358258:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704381056:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997230.358266:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 582 00000100:00100000:2.0:1789997230.358272:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704380928:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997230.358281:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1021 00000100:00080000:1.0:1789997230.358293:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997230.358299:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997230.538835:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997230.538856:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712899456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997230.538940:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997230.539011:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712899456 00000100:00100000:0.0:1789997230.539019:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712899456 00000100:00100000:0.0:1789997230.539071:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1789997230.539079:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712899456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997230.539115:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997230.539162:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712899456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997230.539169:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00080000:0.0:1789997230.539192:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997230.539249:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712899456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997230.539386:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712899584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997230.539413:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997230.546076:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712899584 00000100:00100000:2.0:1789997230.546091:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712899584 00000100:00100000:2.0:1789997230.546149:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1789997230.546159:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712899584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997230.546206:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789997230.546293:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712899584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (6879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997230.546301:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1789997230.546416:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712899584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789997230.858917:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997231.882955:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997232.907824:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997233.614553:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712899840:0@lo:400:kworker.0 00000100:00100000:0.0:1789997233.614722:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997233.614779:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712900352:0@lo:400:kworker.0 00000100:00100000:0.0:1789997233.614803:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997233.614829:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789997233.614835:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712899712:0@lo:400:kworker.0 00000100:00100000:0.0:1789997233.614862:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997233.614883:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712900224:0@lo:400:kworker.0 00000100:00100000:0.0:1789997233.614905:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997233.614934:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712899840 00000100:00100000:0.0:1789997233.614943:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712899840 00000100:00100000:0.0:1789997233.614981:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712900352 00000100:00100000:0.0:1789997233.614984:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712900352 00000100:00100000:0.0:1789997233.615012:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1789997233.615020:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712899840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997233.615275:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1789997233.615284:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712900352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997233.615333:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712900352:12345-0@lo:400:kworker.0 Request processed in 51us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997233.615340:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1789997233.615382:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712900352:0@lo:400:kworker.0 00000100:00100000:0.0:1789997233.615945:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712900224 00000100:00100000:0.0:1789997233.615951:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712900224 00000100:00100000:0.0:1789997233.615985:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1789997233.615993:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712900224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997233.616247:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712900224:0@lo:400:kworker.0 00000100:00100000:1.0:1789997233.616735:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712900096:0@lo:400:kworker.0 00000100:00100000:2.0:1789997233.617740:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712899968:0@lo:400:kworker.0 00000100:00100000:3.0:1789997233.620796:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712899712 00000100:00100000:3.0:1789997233.621121:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712899712 00000100:00100000:3.0:1789997233.621191:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1789997233.621202:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712899712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997233.621615:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997233.621692:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712900096 00000100:00100000:1.0:1789997233.621698:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712900096 00000100:00100000:1.0:1789997233.621732:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1789997233.621741:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712900096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997233.621786:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712900096:12345-0@lo:400:kworker.0 Request processed in 46us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997233.621793:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1789997233.621837:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712900096:0@lo:400:kworker.0 00000100:00100000:1.0:1789997233.621918:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712899840:12345-0@lo:400:kworker.0 Request processed in 6898us (7195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997233.621925:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00080000:1.0:1789997233.621952:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997233.621957:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997233.621960:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997233.622300:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712899840:0@lo:400:kworker.0 00000100:00100000:0.0:1789997233.622548:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712900224:12345-0@lo:400:kworker.0 Request processed in 6553us (7639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997233.622557:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1789997233.622789:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997233.622819:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712899968 00000100:00100000:2.0:1789997233.622825:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712899968 00000100:00100000:2.0:1789997233.622861:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1789997233.622868:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712899968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997233.622903:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712899968:12345-0@lo:400:kworker.0 Request processed in 35us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997233.622909:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00080000:2.0:1789997233.622922:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997233.622948:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712899968:0@lo:400:kworker.0 00000100:00100000:3.0:1789997233.625537:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712899712:12345-0@lo:400:kworker.0 Request processed in 4328us (10664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997233.625552:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:1.0:1789997233.625796:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712899712:0@lo:400:kworker.0 00000001:00080000:0.0:1789997233.664797:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00010000:00010000:0.0:1789997233.931295:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997234.956757:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997235.480288:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997235.480333:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997235.480380:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704381312 00000100:00100000:2.0:1789997235.480391:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704381312 00000100:00100000:0.0:1789997235.480432:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997235.480468:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1025 00000100:00100000:0.0:1789997235.480470:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997235.480479:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704381312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1789997235.480519:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997235.480563:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704381184 00000100:00100000:3.0:1789997235.480568:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704381184 00000100:00100000:3.0:1789997235.480690:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 901 00000100:00100000:3.0:1789997235.480698:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704381184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997235.480772:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704381184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997235.480780:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 901 00000100:00100000:2.0:1789997235.481399:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704381312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 921us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997235.481406:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1025 00000100:00100000:1.0:1789997235.485906:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704381568 00000100:00100000:1.0:1789997235.485922:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704381568 00000100:00100000:1.0:1789997235.485991:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704381440 00000100:00100000:1.0:1789997235.485995:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704381440 00000100:00100000:1.0:1789997235.486028:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 585 00000100:00100000:1.0:1789997235.486039:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704381568:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997235.486143:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704381568:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 107us (5808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997235.486151:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 585 00000100:00100000:1.0:1789997235.486166:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 586 00000100:00100000:1.0:1789997235.486173:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704381440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997235.486196:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704381440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (5726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997235.486202:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 586 00000100:00080000:3.0:1789997235.487722:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997235.487730:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997235.659974:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712900480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997235.660055:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997235.660382:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712900608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997235.660417:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997235.660493:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712900480 00000100:00100000:3.0:1789997235.660502:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712900480 00000100:00100000:3.0:1789997235.660553:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712900608 00000100:00100000:3.0:1789997235.660556:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712900608 00000100:00100000:3.0:1789997235.660576:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1789997235.660585:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712900480:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997235.660765:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:0.0:1789997235.660776:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712900608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997235.660800:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00002000:00000024:3.0:1789997235.661029:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997235.661076:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712900480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 491us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997235.661082:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00080000:3.0:1789997235.661121:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997235.661125:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997235.661160:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712900480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997235.665551:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712900608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4766us (5121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997235.665567:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1789997235.665759:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:1.0:1789997235.665766:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38ffdf8700, transno 4294967330 00000100:00100000:1.0:1789997235.665800:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712900608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997235.979456:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997237.003839:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997238.026828:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997238.731541:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712901120:0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.731614:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997238.731703:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997238.731710:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712900992:0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.731739:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997238.731790:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712901120 00000100:00100000:2.0:1789997238.731798:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712901120 00000100:00100000:2.0:1789997238.731848:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1789997238.731858:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712901120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.731907:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712901120:12345-0@lo:400:kworker.0 Request processed in 51us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997238.731918:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1789997238.731941:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712900864:0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.731965:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997238.731983:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712901376:0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.732002:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997238.732020:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789997238.732026:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712900736:0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.732064:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997238.732086:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712901248:0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.732129:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997238.732147:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712900992 00000100:00100000:1.0:1789997238.732153:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712900992 00000100:00080000:2.0:1789997238.732163:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997238.732170:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997238.732182:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712901248 00000100:00100000:2.0:1789997238.732185:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712901248 00000100:00100000:2.0:1789997238.732213:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1789997238.732219:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712901248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.732254:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712901248:12345-0@lo:400:kworker.0 Request processed in 34us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997238.732260:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1789997238.732269:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712900864 00000100:00100000:1.0:1789997238.732274:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712900864 00000100:00100000:2.0:1789997238.732282:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712901376 00000100:00100000:2.0:1789997238.732287:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712901376 00000100:00100000:1.0:1789997238.732303:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1789997238.732312:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712900992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997238.732362:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712900992:12345-0@lo:400:kworker.0 Request processed in 51us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997238.732518:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1789997238.732526:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712900864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.732559:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712900864:12345-0@lo:400:kworker.0 Request processed in 36us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997238.732565:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1789997238.732578:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1789997238.732588:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:2.0:1789997238.732593:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712901376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.732623:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712901376:12345-0@lo:400:kworker.0 Request processed in 39us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997238.733263:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712900736 00000100:00100000:0.0:1789997238.733269:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712900736 00000100:00100000:0.0:1789997238.733319:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1789997238.733328:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712900736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997238.733386:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712900736:12345-0@lo:400:kworker.0 Request processed in 60us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997238.733393:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00080000:0.0:1789997238.733423:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997238.733427:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997238.733474:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712900992:0@lo:400:kworker.0 00000100:00100000:0.0:1789997238.733492:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712901120:0@lo:400:kworker.0 00000100:00100000:0.0:1789997238.733625:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712900736:0@lo:400:kworker.0 00000100:00100000:0.0:1789997238.733639:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712901248:0@lo:400:kworker.0 00000100:00100000:0.0:1789997238.733668:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712900864:0@lo:400:kworker.0 00000100:00100000:0.0:1789997238.733682:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712901376:0@lo:400:kworker.0 00000100:00100000:2.0:1789997238.735847:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00010000:00010000:1.0:1789997239.051608:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997240.075439:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997240.600341:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997240.600406:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997240.600491:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704381696 00000100:00100000:3.0:1789997240.600502:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704381696 00000100:00100000:2.0:1789997240.600609:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704381952 00000100:00100000:2.0:1789997240.600614:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704381952 00000100:00100000:2.0:1789997240.600702:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 589 00000100:00100000:2.0:1789997240.600714:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704381952:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997240.600783:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704381952:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997240.600791:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 589 00000100:00100000:3.0:1789997240.600952:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 903 00000100:00100000:3.0:1789997240.600961:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704381696:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997240.601015:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704381696:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 56us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997240.601023:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 903 00000100:00080000:1.0:1789997240.601090:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997240.602357:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997240.602542:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997240.602812:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704382080 00000100:00100000:0.0:1789997240.602820:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704382080 00000100:00100000:0.0:1789997240.602914:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 590 00000100:00100000:0.0:1789997240.602925:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704382080:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997240.602988:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704382080:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 65us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997240.602995:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 590 00000100:00080000:1.0:1789997240.603051:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997240.603549:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704381824 00000100:00100000:2.0:1789997240.603555:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704381824 00000100:00100000:2.0:1789997240.603607:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1029 00000100:00100000:2.0:1789997240.603694:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704381824:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997240.603737:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704381824:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997240.603743:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1029 00000100:00080000:1.0:1789997240.604605:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997240.779934:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712901504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997240.779979:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712901632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997240.781761:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997240.782099:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997240.782645:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712901632 00000100:00100000:2.0:1789997240.782675:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712901632 00000100:00100000:2.0:1789997240.782729:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712901504 00000100:00100000:2.0:1789997240.782733:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712901504 00000100:00100000:2.0:1789997240.782751:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1789997240.782761:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712901632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997240.782801:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997240.782857:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712901632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997240.782863:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1789997240.782881:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1789997240.782887:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712901504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997240.782906:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997240.782934:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712901504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997240.782940:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1789997240.784110:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712901504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997240.784912:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997240.784919:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997240.786313:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712901632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997241.099946:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997242.122887:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997243.147012:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997243.851036:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712901760:0@lo:400:kworker.0 00000100:00100000:0.0:1789997243.851056:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712901888:0@lo:400:kworker.0 00000100:00100000:2.0:1789997243.851118:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997243.851121:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997243.851188:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712902400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997243.851193:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712902272:0@lo:400:kworker.0 00000100:00100000:0.0:1789997243.851224:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997243.851231:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997243.851274:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712901760 00000100:00100000:2.0:1789997243.851278:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712902272 00000100:00100000:2.0:1789997243.851284:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712902272 00000100:00100000:0.0:1789997243.851284:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712901760 00000100:00100000:2.0:1789997243.851344:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1789997243.851351:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1789997243.851356:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712902272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997243.851364:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712901760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997243.851395:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712902144:0@lo:400:kworker.0 00000100:00100000:2.0:1789997243.851418:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712902272:12345-0@lo:400:kworker.0 Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997243.851423:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712901760:12345-0@lo:400:kworker.0 Request processed in 61us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997243.851432:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1789997243.851437:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1789997243.851440:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997243.851457:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712902144 00000100:00100000:2.0:1789997243.851462:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712902144 00000100:00100000:3.0:1789997243.851472:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997243.851479:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712901888 00000100:00100000:3.0:1789997243.851481:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712902016:0@lo:400:kworker.0 00000100:00100000:0.0:1789997243.851486:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712901888 00000100:00100000:2.0:1789997243.851494:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1789997243.851504:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712902144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997243.851512:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997243.851541:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712902144:12345-0@lo:400:kworker.0 Request processed in 38us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997243.851548:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00080000:2.0:1789997243.851570:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997243.851574:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997243.851613:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712901760:0@lo:400:kworker.0 00000100:00100000:2.0:1789997243.851629:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712902272:0@lo:400:kworker.0 00000100:00100000:0.0:1789997243.852761:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712902400 00000100:00100000:0.0:1789997243.852770:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712902400 00000100:00100000:3.0:1789997243.852872:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712902144:0@lo:400:kworker.0 00000100:00080000:3.0:1789997243.852926:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997243.852950:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712902016 00000100:00100000:3.0:1789997243.852955:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712902016 00000100:00100000:0.0:1789997243.852994:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1789997243.853001:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1789997243.853007:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712901888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997243.853014:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712902400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997243.853064:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712901888:12345-0@lo:400:kworker.0 Request processed in 63us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997243.853074:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1789997243.853089:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1789997243.853131:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712902016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997243.853198:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712902400:12345-0@lo:400:kworker.0 Request processed in 188us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997243.853205:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00080000:3.0:1789997243.853225:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997243.853243:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712902016:12345-0@lo:400:kworker.0 Request processed in 146us (1731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997243.853250:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1789997243.853275:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712901888:0@lo:400:kworker.0 00000100:00100000:3.0:1789997243.853288:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712902400:0@lo:400:kworker.0 00000100:00100000:3.0:1789997243.853320:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712902016:0@lo:400:kworker.0 00010000:00010000:3.0:1789997244.171069:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997245.198454:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997245.718425:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997245.718467:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997245.718520:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997245.718609:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704382592 00000100:00100000:2.0:1789997245.718621:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704382592 00000100:00100000:3.0:1789997245.718746:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704382336 00000100:00100000:3.0:1789997245.718751:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704382336 00000100:00100000:0.0:1789997245.718820:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704382208 00000100:00100000:0.0:1789997245.718825:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704382208 00000100:00100000:0.0:1789997245.718890:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 905 00000100:00100000:0.0:1789997245.718911:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704382208:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997245.718984:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704382208:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997245.718991:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 905 00000100:00100000:2.0:1789997245.719264:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 593 00000100:00100000:2.0:1789997245.719317:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704382592:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997245.719352:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704382592:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997245.723351:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1033 00000100:00100000:3.0:1789997245.723366:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704382336:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997245.723443:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704382336:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 81us (5029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997245.723450:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1033 00000100:00100000:0.0:1789997245.724801:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997245.725147:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704382464 00000100:00100000:3.0:1789997245.725157:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704382464 00000100:00100000:3.0:1789997245.725215:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 594 00000100:00100000:3.0:1789997245.725226:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704382464:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997245.725283:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704382464:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 59us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997245.725291:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 594 00000100:00100000:2.0:1789997245.725587:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 593 00000100:00080000:1.0:1789997245.726966:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997245.726975:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997245.726977:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997245.899569:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712902528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997245.899644:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997245.899802:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712902656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997245.900276:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997245.904857:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712902528 00000100:00100000:3.0:1789997245.904875:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712902528 00000100:00100000:0.0:1789997245.904908:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712902656 00000100:00100000:0.0:1789997245.904914:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712902656 00000100:00100000:0.0:1789997245.904971:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:0.0:1789997245.904981:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712902656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997245.905022:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997245.905038:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1789997245.905049:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712902528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997245.905074:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997245.905236:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712902656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (4959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997245.905246:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1789997245.905253:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712902528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (5608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997245.905262:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00080000:1.0:1789997245.905341:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997245.905347:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997245.905436:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712902528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997245.905470:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712902656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997246.219528:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997246.967314:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997246.967474:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704382720 00000100:00100000:3.0:1789997246.967484:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704382720 00000100:00100000:3.0:1789997246.967544:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 556 00000100:00100000:3.0:1789997246.967556:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41061:x1876946704382720:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997246.967701:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41061:x1876946704382720:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 147us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997246.967709:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 556 00000100:00100000:0.0:1789997246.973956:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997246.976807:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704382848 00000100:00100000:2.0:1789997246.976824:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704382848 00000100:00100000:2.0:1789997246.976915:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 287 00000100:00100000:2.0:1789997246.976925:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41061:x1876946704382848:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997246.977269:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41061:x1876946704382848:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 345us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997246.977278:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 287 00000100:00100000:1.0:1789997246.980286:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997246.980734:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704382976 00000100:00100000:2.0:1789997246.980745:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704382976 00000100:00100000:2.0:1789997246.980805:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 288 00000100:00100000:2.0:1789997246.980817:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41061:x1876946704382976:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997246.983598:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41061:x1876946704382976:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 2774us (3312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997246.983610:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 288 00000100:00100000:0.0:1789997246.991494:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997246.991573:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704383104 00000100:00100000:1.0:1789997246.991584:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704383104 00000100:00100000:1.0:1789997246.991641:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 557 00000100:00100000:1.0:1789997246.991651:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41061:x1876946704383104:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997246.992185:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41061:x1876946704383104:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 533us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997246.992203:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 557 00000100:00100000:0.0:1789997246.995160:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997246.995239:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704383232 00000100:00100000:3.0:1789997246.995248:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704383232 00000100:00100000:3.0:1789997246.995326:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 558 00000100:00100000:3.0:1789997246.995336:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41061:x1876946704383232:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997246.995432:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41061:x1876946704383232:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 97us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997246.995440:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 558 00000100:00100000:0.0:1789997246.997199:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997246.997288:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704383360 00000100:00100000:2.0:1789997246.997296:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704383360 00000100:00100000:2.0:1789997246.997371:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 289 00000100:00100000:2.0:1789997246.997380:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41061:x1876946704383360:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997246.997899:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41061:x1876946704383360:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 519us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997246.997908:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 289 00000100:00100000:1.0:1789997246.999744:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997246.999822:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704383488 00000100:00100000:0.0:1789997246.999830:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704383488 00000100:00100000:0.0:1789997246.999926:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 290 00000100:00100000:0.0:1789997246.999938:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41061:x1876946704383488:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997247.000276:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41061:x1876946704383488:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 339us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997247.000283:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 290 00000100:00100000:3.0:1789997247.002199:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997247.002324:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704383616 00000100:00100000:1.0:1789997247.002332:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704383616 00000100:00100000:1.0:1789997247.002391:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 559 00000100:00100000:1.0:1789997247.002401:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41061:x1876946704383616:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997247.002858:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41061:x1876946704383616:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 456us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997247.002866:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 559 00000100:00080000:3.0:1789997247.003542:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997247.243645:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997248.266902:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997248.680985:0:70071:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe48a0f860 20000000:00000080:0.0:1789997248.681003:0:70071:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4dc4400 uarg=0000000000000000 00010000:00010000:0.0:1789997248.682057:0:70071:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997248.682095:0:70071:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:0.0:1789997248.682099:0:70071:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997248.682110:0:70071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bb60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9af expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.682131:0:70071:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997248.682148:0:70071:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997248.682163:0:70071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.682177:0:70071:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bb36 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.682185:0:70071:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.682221:0:70071:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bb36 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.682236:0:70071:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bb36 expref: 18 pid: 5805 timeout: 1587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997248.682250:0:70071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab33480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70071:1876946712902784:0@lo:104: 00000100:00100000:0.0:1789997248.682314:0:70071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997248.682415:0:70071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61480 going to sleep for 11 seconds 00000100:00100000:3.0:1789997248.682624:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712902784 00000100:00100000:3.0:1789997248.682632:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712902784 00000100:00100000:3.0:1789997248.682917:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789997248.682927:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70071:x1876946712902784:12345-0@lo:104: 00010000:00010000:3.0:1789997248.682941:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997248.683055:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997248.683062:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70071:x1876946712902784:12345-0@lo:104: Request processed in 137us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997248.683070:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00010000:00010000:1.0:1789997248.683126:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997248.683134:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997248.683142:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997248.683146:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997248.683154:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997248.683161:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997248.683166:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997248.683203:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997248.683209:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997248.683247:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997248.683255:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bb36 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bb3d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997248.683269:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997248.683271:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997248.683273:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997248.683315:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712902912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997248.683364:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997248.683412:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712902912 00000100:00100000:2.0:1789997248.683418:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712902912 00010000:00010000:2.0:1789997248.683442:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bb36 expref: 19 pid: 5805 timeout: 1587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997248.683475:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789997248.683482:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712902912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997248.683493:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997248.683498:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bb36 expref: 19 pid: 5805 timeout: 1587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683509:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bb36 expref: 19 pid: 5805 timeout: 1587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683525:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683534:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683549:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683557:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683564:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683571:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683578:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997248.683582:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.683631:0:70071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a400/0x65b43101d592bb3d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bb36 expref: 19 pid: 5805 timeout: 1587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997248.683644:0:70071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab33480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70071:1876946712902784:0@lo:104: 00010000:00010000:2.0:1789997248.683677:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.683919:0:70071:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683920:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997248.683948:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997248.684012:0:70071:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.684021:0:70071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997248.684027:0:70071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592bbb4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997248.684583:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712902912:12345-0@lo:103:ldlm_bl.0 Request processed in 1098us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997248.684739:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789997248.684944:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712902912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997248.971930:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712903424:0@lo:400:kworker.0 00000100:00100000:3.0:1789997248.972004:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997248.972072:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789997248.972079:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712903040:0@lo:400:kworker.0 00000100:00100000:3.0:1789997248.972108:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997248.972195:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712903296:0@lo:400:kworker.0 00000100:00100000:2.0:1789997248.972239:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997248.972267:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997248.972274:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712903168:0@lo:400:kworker.0 00000100:00100000:2.0:1789997248.972304:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712903424 00000100:00100000:2.0:1789997248.972312:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712903424 00000100:00100000:2.0:1789997248.972359:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712903296 00000100:00100000:2.0:1789997248.972361:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712903296 00000100:00100000:2.0:1789997248.972384:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1789997248.972393:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712903424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997248.972441:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712903424:12345-0@lo:400:kworker.0 Request processed in 50us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997248.972448:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1789997248.972466:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1789997248.972472:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712903296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997248.972502:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712903296:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997248.972508:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00080000:2.0:1789997248.972550:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997248.972554:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997248.972611:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712903552:0@lo:400:kworker.0 00000100:00100000:3.0:1789997248.972634:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997248.982404:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997248.983573:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712903040 00000100:00100000:1.0:1789997248.983587:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712903040 00000100:00100000:1.0:1789997248.983674:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712903552 00000100:00100000:1.0:1789997248.983678:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712903552 00000100:00100000:1.0:1789997248.983715:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1789997248.983726:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712903040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997248.983819:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712903040:12345-0@lo:400:kworker.0 Request processed in 95us (11711us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997248.983827:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1789997248.983855:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1789997248.983862:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712903552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997248.983891:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712903552:12345-0@lo:400:kworker.0 Request processed in 30us (11256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997248.983896:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:1.0:1789997248.983915:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997248.988312:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712903168 00000100:00100000:1.0:1789997248.988325:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712903168 00000100:00100000:3.0:1789997248.988328:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712903296:0@lo:400:kworker.0 00000100:00100000:3.0:1789997248.988367:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712903552:0@lo:400:kworker.0 00000100:00100000:3.0:1789997248.988378:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712903424:0@lo:400:kworker.0 00000100:00100000:1.0:1789997248.988400:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1789997248.988402:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712903040:0@lo:400:kworker.0 00000100:00100000:1.0:1789997248.988409:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712903168:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997248.988506:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997248.988568:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712903168:12345-0@lo:400:kworker.0 Request processed in 159us (6170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997248.988575:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1789997248.988581:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712903168:0@lo:400:kworker.0 00010000:00010000:3.0:1789997249.291702:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997250.315490:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997250.701628:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997250.701637:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997250.701641:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997250.701717:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997250.701730:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997250.701742:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997250.701768:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712903680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997250.701854:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997250.701923:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3395300 going to sleep for 11 seconds 00000100:00100000:1.0:1789997250.702676:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712903680 00000100:00100000:1.0:1789997250.702686:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712903680 00000100:00100000:1.0:1789997250.702742:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1789997250.702752:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712903680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997250.702778:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997250.702798:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bbbb expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997250.702830:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bbbb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997250.702841:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bbbb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997250.702849:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997250.702900:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712903680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997250.702910:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1789997250.702952:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712903680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997250.702970:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997250.702979:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997250.703003:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997250.703008:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997250.703016:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997250.842796:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997250.842849:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997250.842879:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997250.842903:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997250.842929:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704384128 00000100:00100000:0.0:1789997250.842939:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704384128 00000100:00100000:0.0:1789997250.842992:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704384000 00000100:00100000:0.0:1789997250.842995:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704384000 00000100:00100000:0.0:1789997250.843018:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 597 00000100:00100000:0.0:1789997250.843038:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704384128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997250.843108:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704384128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997250.843116:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 597 00000100:00100000:0.0:1789997250.843133:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 598 00000100:00100000:0.0:1789997250.843141:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704384000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997250.843166:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704384000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997250.843171:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 598 00000100:00100000:0.0:1789997250.843189:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704383744 00000100:00100000:0.0:1789997250.843193:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704383744 00000100:00100000:0.0:1789997250.843217:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 907 00000100:00100000:0.0:1789997250.843223:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704383744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997250.843248:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704383744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997250.843254:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 907 00000100:00080000:0.0:1789997250.843282:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997250.843287:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997250.845089:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704383872 00000100:00100000:3.0:1789997250.845100:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704383872 00000100:00100000:3.0:1789997250.845174:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1037 00000100:00100000:3.0:1789997250.845184:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704383872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997250.845246:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704383872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 64us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997250.845253:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1037 00000100:00080000:2.0:1789997250.848850:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997251.021083:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997251.021105:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997251.021173:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997251.022616:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712903936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997251.022694:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997251.022743:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712903808 00000100:00100000:3.0:1789997251.022751:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712903808 00000100:00100000:3.0:1789997251.022815:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712903936 00000100:00100000:3.0:1789997251.022819:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712903936 00000100:00100000:3.0:1789997251.022841:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1789997251.022851:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712903808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997251.022889:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997251.022939:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712903808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997251.022946:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1789997251.022963:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1789997251.022969:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712903936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997251.022987:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997251.023015:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712903936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997251.023020:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1789997251.023073:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712903936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997251.023087:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712903808:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997251.026304:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997251.026313:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997251.047599:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997251.047640:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704384256 00000100:00100000:2.0:1789997251.047650:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704384256 00000100:00100000:2.0:1789997251.047818:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 560 00000100:00100000:2.0:1789997251.047830:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41147:x1876946704384256:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997251.047850:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997251.047873:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592bbc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9c4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.047939:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592bbd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.047953:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592bbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.047967:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592bbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997251.048067:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:2.0:1789997251.048072:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997251.048094:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592bbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.048119:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592bbc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9c4 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.048140:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592bbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9c4 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.048149:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997251.048151:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997251.048155:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789997251.048228:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41147:x1876946704384256:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 400us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997251.048235:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 560 00000100:00100000:1.0:1789997251.052595:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997251.052811:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704384512 00000100:00100000:3.0:1789997251.052825:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704384512 00000100:00100000:3.0:1789997251.052878:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 561 00000100:00100000:3.0:1789997251.052889:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41147:x1876946704384512:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997251.052942:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997251.052969:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592bbd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9c4 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997251.052985:0:5811:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592bb60) 00010000:00010000:3.0:1789997251.052989:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:3.0:1789997251.053001:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997251.053094:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997251.053108:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997251.053121:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997251.096185:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000004:00010000:3.0:1789997251.096250:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5444d4b reply state 00000000821ff7aa transno 4294967512 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997251.096264:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997251.096278:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00080000:3.0:1789997251.096376:0:5811:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997251.096401:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41147:x1876946704384512:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 43510us (43811us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789997251.096410:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 561 00010000:00010000:0.0:1789997251.096500:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.096509:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.096517:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.096523:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997251.096527:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.096535:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.096550:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:0.0:1789997251.096554:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997251.096559:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.096566:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bbd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997251.339220:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997251.755312:0:70268:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee08844f0 20000000:00000080:2.0:1789997251.755331:0:70268:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4d06400 uarg=0000000000000000 00010000:00010000:2.0:1789997251.755910:0:70268:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997251.755926:0:70268:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997251.756106:0:70268:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997251.756126:0:70268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.756143:0:70268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bbbb expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.756151:0:70268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.756186:0:70268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bbbb expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.756196:0:70268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bbbb expref: 18 pid: 5805 timeout: 1590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997251.756207:0:70268:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70268:1876946712904064:0@lo:104: 00000100:00100000:2.0:1789997251.756254:0:70268:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997251.756595:0:70268:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c29ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997251.756703:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712904064 00000100:00100000:1.0:1789997251.756710:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712904064 00000100:00100000:1.0:1789997251.756819:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789997251.756829:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70268:x1876946712904064:12345-0@lo:104: 00010000:00010000:1.0:1789997251.756850:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997251.756901:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997251.756907:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70268:x1876946712904064:12345-0@lo:104: Request processed in 80us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997251.756915:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00010000:00010000:0.0:1789997251.756927:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997251.756934:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.756942:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1aa8c20) 00000100:00100000:2.0:1789997251.757001:0:70268:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70268:1876946712904064:0@lo:104: 00010000:00010000:2.0:1789997251.757018:0:70268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997251.757064:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757075:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997251.757083:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997251.757090:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997251.757124:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757131:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997251.757162:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757169:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592bbbb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bbc2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997251.757179:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789997251.757185:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997251.757187:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997251.757188:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997251.757190:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712904192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997251.757222:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997251.757304:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712904192 00000100:00100000:0.0:1789997251.757308:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712904192 00010000:00010000:0.0:1789997251.757328:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bbbb expref: 19 pid: 5805 timeout: 1590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997251.757349:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789997251.757356:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712904192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997251.757366:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997251.757371:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bbbb expref: 19 pid: 5805 timeout: 1590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757381:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bbbb expref: 19 pid: 5805 timeout: 1590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757394:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592bbc2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bbbb expref: 19 pid: 5805 timeout: 1590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757405:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757411:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757421:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757425:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757429:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757433:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757436:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997251.757439:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757731:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757748:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997251.757762:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997251.757809:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712904192:12345-0@lo:103:ldlm_bl.0 Request processed in 453us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997251.757817:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789997251.757888:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712904192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997251.757939:0:70268:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.757947:0:70268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997251.757953:0:70268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592bbde lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997252.365848:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997253.387158:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997253.706723:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997253.706732:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997253.706739:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997253.706795:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.706809:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.706821:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997253.706849:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712904320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997253.706923:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997253.706974:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997253.707059:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712904320 00000100:00100000:0.0:1789997253.707069:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712904320 00000100:00100000:0.0:1789997253.707120:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:0.0:1789997253.707130:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712904320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997253.707143:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997253.707157:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bbe5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.707180:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.707191:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.707200:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789997253.707248:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712904320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997253.707255:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1789997253.707443:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712904320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997253.707459:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.707467:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997253.707485:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997253.707490:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.707497:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997253.708625:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997253.709761:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704384640 00000100:00100000:0.0:1789997253.709771:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704384640 00000100:00100000:0.0:1789997253.709860:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 562 00000100:00100000:0.0:1789997253.709871:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41223:x1876946704384640:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:0.0:1789997253.709893:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997253.709927:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bbf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9cb expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710093:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710108:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710120:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710134:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710140:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710147:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710481:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bc08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710490:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710498:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997253.710526:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789997253.710530:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997253.710550:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710562:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710569:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710575:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710582:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997253.710586:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710594:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710618:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997253.710622:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997253.710627:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710641:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592bbfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710689:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710696:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710702:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710708:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997253.710711:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710718:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710726:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997253.710729:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997253.710732:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710738:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bc01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710790:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592bbf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9cb expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710809:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bc08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9cb expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997253.710817:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997253.710831:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997253.710833:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997253.710900:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41223:x1876946704384640:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1031us (2280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997253.710907:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 562 00000100:00080000:3.0:1789997253.710965:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997253.714329:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997253.714479:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704384896 00000100:00100000:1.0:1789997253.714490:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704384896 00000100:00100000:1.0:1789997253.714562:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 563 00000100:00100000:1.0:1789997253.714573:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41223:x1876946704384896:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997253.714595:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997253.714622:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9d2 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.714937:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.714952:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.714963:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.714977:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.714984:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.714998:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997253.717273:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00010000:00010000:1.0:1789997253.717867:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.717887:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.717900:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.717940:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.717948:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.717955:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.717961:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997253.717965:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.718029:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.718044:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:1.0:1789997253.718047:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997253.718059:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.718066:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997253.718080:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca1fb257 reply state 00000000a260c531 transno 4294967513 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997253.718089:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997253.718126:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9d2 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.718141:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9d2 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.718148:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997253.718150:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997253.718153:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997253.718279:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:41223:x1876946704384896:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 3706us (3972us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1789997253.718289:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 563 00000100:00100000:1.0:1789997253.718385:0:7604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7604:1876946712904448:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789997253.718443:0:7604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997253.718486:0:7604:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae10540 going to sleep for 11 seconds 00000100:00100000:2.0:1789997253.718737:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712904448 00000100:00100000:2.0:1789997253.718755:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712904448 00000100:00100000:2.0:1789997253.718818:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789997253.718829:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7604:x1876946712904448:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789997253.718873:0:6656:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:1.0:1789997253.720461:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997253.730879:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:1.0:1789997253.730915:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.730933:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.730942:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.730948:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997253.730953:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.730961:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.730983:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38e062d000) 00010000:00010000:1.0:1789997253.730987:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997253.730992:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.730999:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997253.731041:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704385152 00000100:00100000:1.0:1789997253.731052:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704385152 00000100:00100000:1.0:1789997253.731102:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 564 00000100:00100000:1.0:1789997253.731114:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:41223:x1876946704385152:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:1.0:1789997253.731174:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997253.731193:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9d2 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.731211:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997253.731218:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997253.731263:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.731277:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.731288:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997253.731432:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056a36f67 reply state 00000000140e14bf transno 4294967514 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997253.731441:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997253.731548:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:41223:x1876946704385152:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 436us (678us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789997253.731556:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 564 00010000:00010000:3.0:1789997253.733613:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.733631:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.733639:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.733645:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997253.733650:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.733685:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.733700:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:3.0:1789997253.733703:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997253.733708:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.733715:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997253.734966:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997253.735461:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704385280 00000100:00100000:3.0:1789997253.735473:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704385280 00000100:00100000:3.0:1789997253.735538:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 565 00000100:00100000:3.0:1789997253.735551:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:41223:x1876946704385280:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997253.735575:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997253.735598:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bc39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9d9 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.735681:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bc39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9d9 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.735698:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bc39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9d9 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.735720:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997253.735724:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997253.735728:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997253.735807:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:41223:x1876946704385280:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 258us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997253.735816:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 565 00000100:00100000:2.0:1789997253.747811:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7604:x1876946712904448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 28978us (29362us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789997253.747826:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789997253.747941:0:7604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7604:1876946712904448:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789997253.747963:0:7604:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1789997253.748973:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997253.749246:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704385408 00000100:00100000:0.0:1789997253.749256:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704385408 00000100:00100000:0.0:1789997253.749319:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 292 00000100:00080000:2.0:1789997253.749328:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997253.749330:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704385408:12345-192.168.204.4@tcp:2:touch.60003 00000100:00100000:0.0:1789997253.749673:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704385408:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 325us (685us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789997253.749681:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 292 00000100:00100000:3.0:1789997253.752565:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997253.752612:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704385664 00000100:00100000:3.0:1789997253.752622:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704385664 00000100:00100000:3.0:1789997253.752685:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:3.0:1789997253.752695:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:41223:x1876946704385664:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:3.0:1789997253.753205:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:41223:x1876946704385664:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 510us (647us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789997253.753212:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 60 00000100:00100000:2.0:1789997253.798879:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997253.799152:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704385792 00000100:00100000:3.0:1789997253.799163:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704385792 00000100:00100000:3.0:1789997253.799225:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 566 00000100:00100000:3.0:1789997253.799236:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:41227:x1876946704385792:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:3.0:1789997253.799797:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997253.799822:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bc40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9e0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800001:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800018:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800030:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800050:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800057:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800063:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800145:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bc55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800153:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bc55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800160:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bc55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997253.800211:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2f:0x0]: returning size 0 00000004:00200000:2.0:1789997253.800217:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997253.800240:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bc55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800251:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bc55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800259:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800265:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800276:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800283:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997253.800287:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800295:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800305:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:2.0:1789997253.800308:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997253.800313:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800318:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592bc47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800330:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800336:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800342:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800347:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997253.800351:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800361:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800367:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997253.800370:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997253.800372:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800378:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592bc4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800408:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bc40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e0 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800422:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bc55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e0 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997253.800429:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:2.0:1789997253.800432:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997253.800434:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3800, rc 0) 00000100:00100000:2.0:1789997253.800500:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:41227:x1876946704385792:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 1267us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997253.800509:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 566 00000100:00100000:2.0:1789997253.803201:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997253.803395:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704385920 00000100:00100000:3.0:1789997253.803407:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704385920 00000100:00100000:3.0:1789997253.803467:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 293 00000100:00100000:3.0:1789997253.803478:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704385920:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:3.0:1789997253.803497:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997253.803518:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9e7 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997253.803549:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x6ab130c5, atime: 0x6ab130c5, ctime: 0x6ab130c5, blocks: 0x1 00010000:00010000:3.0:1789997253.803813:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=1442s v=(0 0) 00010000:00010000:3.0:1789997253.803818:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997253.803828:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.803850:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.803864:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997253.804124:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704385920:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 647us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997253.804132:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 293 00000100:00100000:3.0:1789997253.809187:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997253.809299:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704386176 00000100:00100000:1.0:1789997253.809310:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704386176 00000100:00100000:1.0:1789997253.809378:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 567 00000100:00100000:1.0:1789997253.809389:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:41227:x1876946704386176:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:1.0:1789997253.809450:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997253.809481:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bc55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e0 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.809507:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bc39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9d9 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.809520:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:1.0:1789997253.809531:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997253.809557:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.809572:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.809582:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.809596:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.809603:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.809609:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810093:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810103:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810111:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997253.810736:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 64 off9344 00000004:00080000:1.0:1789997253.810760:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1442503105480ns, next at 1443503103300ns, rc = 0 00010000:00010000:1.0:1789997253.810824:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810834:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810842:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810849:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810855:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810861:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810888:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997253.810918:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810925:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810931:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810937:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997253.810942:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810950:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810961:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:1.0:1789997253.810964:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997253.810969:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810974:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592bc71 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810990:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.810997:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.811003:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.811008:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997253.811010:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.811017:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.811024:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:1.0:1789997253.811026:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997253.811029:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.811035:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592bc63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997253.811048:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002843d3f9 reply state 0000000089699eeb transno 4294967516 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997253.811056:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997253.811141:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:41227:x1876946704386176:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1752us (1962us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789997253.811149:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 567 00010000:00010000:3.0:1789997253.812777:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997253.812788:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.812799:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997253.812802:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.812811:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.812825:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:3.0:1789997253.812828:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997253.812833:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.812839:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592bc78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997253.812861:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997253.812862:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997253.812864:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997253.815341:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.815360:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.815368:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.815374:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997253.815379:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.815386:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.815403:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38e062d900) 00010000:00010000:1.0:1789997253.815406:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997253.815411:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997253.815418:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592bc6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997254.090880:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712904576:0@lo:400:kworker.0 00000100:00100000:3.0:1789997254.090955:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997254.091025:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997254.091032:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712904960:0@lo:400:kworker.0 00000100:00100000:3.0:1789997254.091056:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997254.091084:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712904704:0@lo:400:kworker.0 00000100:00100000:3.0:1789997254.091112:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997254.091124:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712904576 00000100:00100000:1.0:1789997254.091133:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712904576 00000100:00100000:3.0:1789997254.091136:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997254.091144:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712904832:0@lo:400:kworker.0 00000100:00100000:1.0:1789997254.091176:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712904960 00000100:00100000:1.0:1789997254.091179:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712904960 00000100:00100000:3.0:1789997254.091185:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997254.091216:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712904704 00000100:00100000:1.0:1789997254.091219:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712904704 00000100:00100000:1.0:1789997254.091243:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1789997254.091251:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712904576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997254.091264:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1789997254.091281:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712904960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997254.091310:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712904576:12345-0@lo:400:kworker.0 Request processed in 58us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997254.091318:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1789997254.091328:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712904960:12345-0@lo:400:kworker.0 Request processed in 55us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997254.091336:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1789997254.092232:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712904832 00000100:00100000:0.0:1789997254.092238:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712904832 00000100:00100000:1.0:1789997254.092298:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1789997254.092326:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712904704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997254.092373:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712904704:12345-0@lo:400:kworker.0 Request processed in 68us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997254.092380:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1789997254.092423:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712904704:0@lo:400:kworker.0 00000100:00080000:1.0:1789997254.092526:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997254.092533:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997254.092568:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712904960:0@lo:400:kworker.0 00000100:00100000:1.0:1789997254.092581:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712904576:0@lo:400:kworker.0 00000100:00100000:0.0:1789997254.093514:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1789997254.093525:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712904832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997254.093585:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712904832:12345-0@lo:400:kworker.0 Request processed in 63us (2401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997254.093591:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1789997254.093855:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712904832:0@lo:400:kworker.0 00000001:00080000:2.0:1789997254.152560:0:68636:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967332 is committed 00000001:00080000:2.0:1789997254.152677:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967331 is committed 00010000:00010000:1.0:1789997254.410937:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997255.084222:0:70514:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe6d099400 20000000:00000080:1.0:1789997255.084241:0:70514:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9b17c00 uarg=0000000000000000 00010000:00010000:1.0:1789997255.084477:0:70514:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997255.084513:0:70514:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:1.0:1789997255.084517:0:70514:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997255.084529:0:70514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bc08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9cb expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.084558:0:70514:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997255.084573:0:70514:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997255.084588:0:70514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.084600:0:70514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.084608:0:70514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.084643:0:70514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.086401:0:70514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 18 pid: 5804 timeout: 1593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997255.086428:0:70514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70514:1876946712905088:0@lo:104: 00000100:00100000:1.0:1789997255.086516:0:70514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997255.086639:0:70514:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae100c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997255.087237:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712905088 00000100:00100000:2.0:1789997255.087247:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712905088 00000100:00100000:2.0:1789997255.087359:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789997255.087370:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70514:x1876946712905088:12345-0@lo:104: 00010000:00010000:2.0:1789997255.087387:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997255.087468:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997255.087476:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70514:x1876946712905088:12345-0@lo:104: Request processed in 108us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997255.087482:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00010000:0.0:1789997255.087535:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997255.087542:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997255.087550:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997255.087555:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997255.087563:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997255.087575:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997255.087581:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997255.087620:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997255.087627:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997255.087648:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997255.087678:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592bbe5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bbec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997255.087695:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997255.087697:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997255.087699:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997255.087713:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712905216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997255.087758:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997255.087871:0:70514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70514:1876946712905088:0@lo:104: 00010000:00010000:1.0:1789997255.087904:0:70514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997255.087962:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712905216 00000100:00100000:1.0:1789997255.087967:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712905216 00010000:00010000:1.0:1789997255.087988:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 19 pid: 5804 timeout: 1593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997255.088023:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789997255.088031:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712905216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997255.088043:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997255.088049:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 19 pid: 5804 timeout: 1593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088059:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 19 pid: 5804 timeout: 1593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088073:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592bbec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bbe5 expref: 19 pid: 5804 timeout: 1593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088088:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088096:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088111:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088119:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088125:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088132:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088142:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997255.088146:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088154:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088168:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088177:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997255.088208:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712905216:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997255.088215:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:1.0:1789997255.088249:0:70514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088256:0:70514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997255.088261:0:70514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592bc7f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997255.089192:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712905216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997255.434849:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997255.958826:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997255.958880:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997255.958999:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704386688 00000100:00100000:2.0:1789997255.959012:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704386688 00000100:00100000:0.0:1789997255.959081:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704386432 00000100:00100000:0.0:1789997255.959087:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704386432 00000100:00100000:2.0:1789997255.959094:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 600 00000100:00080000:1.0:1789997255.959104:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997255.959108:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704386688:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:1.0:1789997255.959112:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997255.959135:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1041 00000100:00100000:0.0:1789997255.959146:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:2352:x1876946704386432:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997255.959185:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704386688:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 80us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997255.959194:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 600 00000100:00100000:1.0:1789997255.959214:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:2352:x1876946704386432:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 68us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997255.959223:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1041 00000100:00100000:3.0:1789997255.959514:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997255.959739:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997255.959859:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704386560 00000100:00100000:1.0:1789997255.959865:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704386560 00000100:00100000:1.0:1789997255.959922:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 601 00000100:00100000:1.0:1789997255.959930:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704386560:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997255.959951:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704386304 00000100:00100000:0.0:1789997255.959957:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704386304 00000100:00100000:1.0:1789997255.959969:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704386560:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997255.959977:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 601 00000100:00100000:0.0:1789997255.959995:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 909 00000100:00100000:0.0:1789997255.960005:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704386304:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997255.960053:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704386304:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 50us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997255.960059:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 909 00000100:00080000:2.0:1789997255.960153:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789997256.139166:0:7604:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1444831509468ns, next at 1445831506943ns, rc = 0 00000100:00100000:3.0:1789997256.139254:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712905344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997256.139320:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997256.139473:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712905344 00000100:00100000:3.0:1789997256.139481:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712905344 00000100:00100000:3.0:1789997256.139548:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1789997256.139558:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712905344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997256.139591:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997256.139938:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997256.139981:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712905344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 423us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997256.139989:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1789997256.140013:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712905472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997256.140138:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997256.140199:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712905472 00000100:00100000:3.0:1789997256.140204:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712905472 00000100:00100000:3.0:1789997256.140239:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1789997256.140246:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712905472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997256.140269:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997256.140308:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712905472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997256.140316:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:3.0:1789997256.140812:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712905472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997256.142575:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997256.143005:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967331 gen 2 00000100:00100000:2.0:1789997256.143040:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712905344:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789997256.168086:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000004:00080000:0.0:1789997256.168096:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 50 committed 00000100:00100000:2.0:1789997256.168350:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712905600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997256.168417:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997256.168483:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712905600 00000100:00100000:2.0:1789997256.168490:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712905600 00000100:00100000:2.0:1789997256.168529:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789997256.168538:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712905600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789997256.168566:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:18 count 1 00010000:00010000:2.0:1789997256.168590:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997256.168611:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 5 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997256.168620:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789997256.168624:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997256.168629:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997256.168676:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 5 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997256.168691:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 5 pid: 6659 timeout: 1544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997256.168715:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712905728:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997256.168771:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c780 going to sleep for 11 seconds 00000004:00080000:0.0:1789997256.169171:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 51 committed 00000100:00100000:2.0:1789997256.171033:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997256.171097:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704386816 00000100:00100000:3.0:1789997256.171104:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704386816 00010000:00010000:3.0:1789997256.171140:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 6 pid: 6659 timeout: 1544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997256.171183:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 317 00000100:00100000:3.0:1789997256.171198:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704386816:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997256.171212:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997256.171217:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 6 pid: 6659 timeout: 1544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997256.171231:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 6 pid: 6659 timeout: 1544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997256.171241:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712905728:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997256.171252:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f253c5b0/0x65b43101d592bc5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9e7 expref: 6 pid: 6659 timeout: 1544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997256.171263:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997256.171265:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997256.171270:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997256.171274:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997256.172203:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997256.172803:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997256.172804:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997256.172814:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997256.172824:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997256.172831:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997256.172863:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704386816:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1668us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997256.172873:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 317 00010000:00010000:1.0:1789997256.173005:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997256.173410:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997256.173418:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997256.173426:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997256.173430:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997256.173439:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997256.173454:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997256.173461:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2ba087f/0x65b43101d592bc86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997256.173480:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997256.173482:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997256.173484:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997256.173488:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712905600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4949us (5069us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789997256.173497:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000004:00080000:2.0:1789997256.174567:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38f9fdfb80/2, rc 0, transno 4294967333 00000100:00100000:2.0:1789997256.174577:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712905600:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789997256.459608:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997256.971834:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997256.971842:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997256.971847:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997256.971895:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997256.971906:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997256.971917:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997256.971955:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712905856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997256.972026:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997256.972121:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789997256.975539:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712905856 00000100:00100000:0.0:1789997256.975556:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712905856 00000100:00100000:0.0:1789997256.975629:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1789997256.975639:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712905856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997256.975697:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997256.975719:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bc8d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997256.975749:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bc8d expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997256.975760:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bc8d expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997256.975769:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997256.975845:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712905856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (3818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997256.975852:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1789997256.975996:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712905856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997256.976017:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997256.976027:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997256.976049:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997256.976054:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997256.976066:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997257.232850:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997257.233039:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704386944 00000100:00100000:1.0:1789997257.233050:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704386944 00000100:00100000:1.0:1789997257.233131:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 568 00000100:00100000:1.0:1789997257.233142:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41319:x1876946704386944:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997257.233162:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997257.233186:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9ee expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.233266:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bca2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.233281:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.233295:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789997257.233329:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789997257.233335:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:1.0:1789997257.233340:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997257.233359:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.233383:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bc9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9ee expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.233406:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9ee expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.233415:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789997257.233418:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997257.233422:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997257.233493:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41319:x1876946704386944:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 352us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997257.233502:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 568 00000100:00100000:3.0:1789997257.237025:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997257.237539:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704387200 00000100:00100000:1.0:1789997257.237550:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704387200 00000100:00100000:1.0:1789997257.237601:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 569 00000100:00100000:1.0:1789997257.237611:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41319:x1876946704387200:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997257.237690:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997257.237716:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bca2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9ee expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.237731:0:5811:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592bc08) 00010000:00010000:1.0:1789997257.237735:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789997257.237746:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997257.237773:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.237788:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.237798:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789997257.266234:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000004:00010000:0.0:1789997257.266315:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000daf454e8 reply state 0000000057f7ebfc transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997257.266330:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997257.266347:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00080000:0.0:1789997257.266446:0:5811:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997257.266464:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41319:x1876946704387200:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 28850us (29441us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789997257.266474:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 569 00010000:00010000:3.0:1789997257.266728:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.266738:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.266744:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.266750:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997257.266755:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.266762:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.266777:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:3.0:1789997257.266780:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997257.266785:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.266791:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bca9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.486778:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997257.895632:0:70711:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf0a06e10 20000000:00000080:3.0:1789997257.895966:0:70711:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c5c0c400 uarg=0000000000000000 00010000:00010000:3.0:1789997257.896506:0:70711:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997257.896523:0:70711:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997257.896619:0:70711:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997257.896639:0:70711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.896698:0:70711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bc8d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.896707:0:70711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.896747:0:70711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bc8d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.896762:0:70711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bc8d expref: 18 pid: 5804 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997257.896777:0:70711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70711:1876946712905984:0@lo:104: 00000100:00100000:3.0:1789997257.896855:0:70711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997257.897046:0:70711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa7b16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997257.897177:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789997257.897191:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712905984 00000100:00100000:1.0:1789997257.897197:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712905984 00000100:00100000:1.0:1789997257.897250:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789997257.897260:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafb1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70711:x1876946712905984:12345-0@lo:104: 00010000:00010000:1.0:1789997257.897274:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997257.897383:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997257.897389:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafb1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70711:x1876946712905984:12345-0@lo:104: Request processed in 131us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997257.897396:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789997257.897474:0:70711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70711:1876946712905984:0@lo:104: 00010000:00010000:3.0:1789997257.897492:0:70711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997257.897619:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997257.897627:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997257.897635:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997257.897639:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997257.897648:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997257.897799:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997257.897805:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997257.897865:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997257.897872:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789997257.897984:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712906112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997257.898025:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997257.898097:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712906112 00000100:00100000:3.0:1789997257.898101:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712906112 00010000:00010000:3.0:1789997257.898122:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bc8d expref: 19 pid: 5804 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997257.898145:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789997257.898152:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712906112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997257.898163:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997257.898168:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bc8d expref: 19 pid: 5804 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898178:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bc8d expref: 19 pid: 5804 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898191:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592bc94 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bc8d expref: 19 pid: 5804 timeout: 1596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898206:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898214:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898228:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898235:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898242:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898248:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898253:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997257.898257:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898269:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898282:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898291:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997257.898338:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997257.898346:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bc8d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bc94 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997257.898361:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997257.898363:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997257.898365:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997257.898499:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712906112:12345-0@lo:103:ldlm_bl.0 Request processed in 347us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997257.898506:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:3.0:1789997257.898565:0:70711:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898575:0:70711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997257.898581:0:70711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b400/0x65b43101d592bcb0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997257.900281:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712906112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997258.508172:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997259.211535:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712906496:0@lo:400:kworker.0 00000100:00100000:3.0:1789997259.211601:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997259.211681:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997259.211687:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712906624:0@lo:400:kworker.0 00000100:00100000:3.0:1789997259.211713:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997259.211748:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712906496 00000100:00100000:3.0:1789997259.211755:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712906496 00000100:00100000:3.0:1789997259.211803:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1789997259.211811:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712906496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997259.211866:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712906496:12345-0@lo:400:kworker.0 Request processed in 56us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997259.211874:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1789997259.211900:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712906624 00000100:00100000:3.0:1789997259.211903:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712906624 00000100:00100000:1.0:1789997259.211911:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712906368:0@lo:400:kworker.0 00000100:00100000:3.0:1789997259.211930:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1789997259.211939:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712906624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997259.211951:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997259.211978:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712906880:0@lo:400:kworker.0 00000100:00100000:3.0:1789997259.211984:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712906624:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997259.211991:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1789997259.212011:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712906368 00000100:00100000:1.0:1789997259.212013:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997259.212017:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712906368 00000100:00100000:3.0:1789997259.212043:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712906880 00000100:00100000:1.0:1789997259.212046:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789997259.212047:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712906880 00000100:00100000:1.0:1789997259.212053:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712906240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997259.212076:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1789997259.212081:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997259.212088:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712906368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997259.212105:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712906752:0@lo:400:kworker.0 00000100:00080000:2.0:1789997259.212190:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997259.212195:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997259.212282:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997259.212322:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712906368:0@lo:400:kworker.0 00000100:00100000:1.0:1789997259.212375:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1789997259.212386:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712906880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997259.212434:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712906880:12345-0@lo:400:kworker.0 Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997259.212445:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:1.0:1789997259.212478:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712906240 00000100:00100000:1.0:1789997259.212483:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712906240 00000100:00100000:1.0:1789997259.212516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1789997259.212526:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712906240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997259.212545:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712906752 00000100:00100000:2.0:1789997259.212551:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712906752 00000100:00100000:1.0:1789997259.212572:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712906240:12345-0@lo:400:kworker.0 Request processed in 48us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997259.212580:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1789997259.212585:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1789997259.212594:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712906752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997259.212636:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712906752:12345-0@lo:400:kworker.0 Request processed in 43us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997259.212765:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00080000:2.0:1789997259.212928:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997259.213881:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712906624:0@lo:400:kworker.0 00000100:00100000:2.0:1789997259.213897:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712906496:0@lo:400:kworker.0 00000100:00100000:2.0:1789997259.215861:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712906240:0@lo:400:kworker.0 00000100:00100000:2.0:1789997259.215880:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712906752:0@lo:400:kworker.0 00000100:00100000:2.0:1789997259.215891:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712906880:0@lo:400:kworker.0 00000100:00100000:3.0:1789997259.219883:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712906368:12345-0@lo:400:kworker.0 Request processed in 7789us (7924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997259.219896:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000001:00080000:2.0:1789997259.262572:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 10000000:01000000:1.0:1789997259.275928:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997259.275937:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997259.275942:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997259.275985:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997259.275997:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997259.276008:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997259.276032:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712907008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997259.276096:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997259.276142:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee4cbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789997259.276263:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712907008 00000100:00100000:2.0:1789997259.276270:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712907008 00000100:00100000:2.0:1789997259.276327:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:2.0:1789997259.276337:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712907008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997259.276351:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997259.276363:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bcb7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997259.276386:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997259.276396:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997259.276404:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997259.276442:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712907008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997259.276448:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1789997259.276562:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712907008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997259.276576:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997259.276584:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997259.276604:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997259.276608:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997259.276616:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997259.531948:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997260.014558:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997260.014643:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704387328 00000100:00100000:3.0:1789997260.014711:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704387328 00000100:00100000:3.0:1789997260.014802:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 570 00000100:00100000:3.0:1789997260.014864:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41395:x1876946704387328:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997260.014889:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997260.014910:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bcc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9f5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.014979:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.014994:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015007:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015020:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015028:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015035:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015325:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bcda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015334:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bcda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015342:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bcda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997260.015365:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:3.0:1789997260.015368:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997260.015389:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bcda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015404:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015410:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015417:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015422:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997260.015427:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015434:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015446:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997260.015448:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997260.015453:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015459:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015469:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015474:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015479:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015485:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997260.015487:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015492:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015498:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997260.015500:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997260.015502:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015507:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bcd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015533:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bcc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9f5 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015548:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bcda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9f5 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997260.015554:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997260.015556:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997260.015558:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997260.015642:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41395:x1876946704387328:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 782us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997260.015650:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 570 00000100:00080000:0.0:1789997260.015744:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997260.556466:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997261.080976:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997261.081020:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997261.081111:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997261.081148:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997261.081170:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704387456 00000100:00100000:2.0:1789997261.081181:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704387712 00000100:00100000:1.0:1789997261.081182:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704387456 00000100:00100000:2.0:1789997261.081188:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704387712 00000100:00100000:1.0:1789997261.081236:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 913 00000100:00100000:2.0:1789997261.081242:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704387840 00000100:00100000:2.0:1789997261.081247:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704387840 00000100:00100000:1.0:1789997261.081248:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704387456:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997261.081275:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 604 00000100:00100000:2.0:1789997261.081284:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704387712:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997261.081319:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704387456:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997261.081327:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704387712:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997261.081332:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 913 00000100:00100000:2.0:1789997261.081342:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 604 00000100:00100000:2.0:1789997261.081361:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 605 00000100:00100000:2.0:1789997261.081370:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704387840:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997261.081398:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704387840:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997261.081406:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 605 00000100:00100000:0.0:1789997261.081496:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704387584 00000100:00100000:0.0:1789997261.081501:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704387584 00000100:00100000:0.0:1789997261.081582:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1045 00000100:00100000:0.0:1789997261.081590:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704387584:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997261.081632:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704387584:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997261.081639:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1045 00000100:00080000:1.0:1789997261.081988:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997261.081993:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789997261.218926:0:70956:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb47902c0 20000000:00000080:0.0:1789997261.218945:0:70956:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38ffd50400 uarg=0000000000000000 00010000:00010000:0.0:1789997261.219411:0:70956:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997261.219446:0:70956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:0.0:1789997261.219450:0:70956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997261.219460:0:70956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bcda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9f5 expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997261.219486:0:70956:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997261.219502:0:70956:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997261.219517:0:70956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997261.219530:0:70956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997261.219537:0:70956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997261.219725:0:70956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997261.219741:0:70956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 18 pid: 5804 timeout: 1599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997261.219756:0:70956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70956:1876946712907136:0@lo:104: 00000100:00100000:0.0:1789997261.219819:0:70956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997261.220006:0:70956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c35813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997261.220135:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712907136 00000100:00100000:3.0:1789997261.220143:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712907136 00000100:00100000:3.0:1789997261.220225:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789997261.220244:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70956:x1876946712907136:12345-0@lo:104: 00010000:00010000:3.0:1789997261.220258:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997261.220325:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997261.220331:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:70956:x1876946712907136:12345-0@lo:104: Request processed in 99us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997261.220338:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00010000:1.0:1789997261.220388:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997261.220395:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220402:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997261.220406:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220414:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997261.220425:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997261.220431:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997261.220462:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220468:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997261.220490:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220496:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592bcb7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bcbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220509:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997261.220510:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997261.220512:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997261.220528:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712907264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997261.220568:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997261.220610:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712907264 00000100:00100000:1.0:1789997261.220614:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712907264 00010000:00010000:1.0:1789997261.220632:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 19 pid: 5804 timeout: 1599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997261.220681:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789997261.220688:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712907264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997261.220698:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997261.220702:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 19 pid: 5804 timeout: 1599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220712:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 19 pid: 5804 timeout: 1599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220727:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220735:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220747:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220754:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220762:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220768:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220774:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997261.220778:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220785:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220792:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997261.220805:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997261.220828:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712907264:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997261.220835:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789997261.220877:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712907264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997261.220967:0:70956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592bcbe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bcb7 expref: 18 pid: 5804 timeout: 1599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997261.220977:0:70956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70956:1876946712907136:0@lo:104: 00010000:00010000:0.0:1789997261.220989:0:70956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997261.220998:0:70956:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997261.221005:0:70956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997261.221011:0:70956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592bce1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997261.265343:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997261.265372:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712907392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997261.265445:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997261.265522:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712907392 00000100:00100000:0.0:1789997261.265530:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712907392 00000100:00100000:0.0:1789997261.265583:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1789997261.265592:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712907392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997261.265640:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997261.265709:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712907392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997261.265716:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1789997261.265758:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:0.0:1789997261.265764:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38f9fdfb80, transno 4294967333 00000100:00100000:0.0:1789997261.265793:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712907392:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997261.265884:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997261.266425:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712907520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997261.266460:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997261.266529:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712907520 00000100:00100000:1.0:1789997261.266534:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712907520 00000100:00100000:1.0:1789997261.266572:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1789997261.266580:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712907520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997261.266611:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997261.271373:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712907520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4783us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997261.271386:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1789997261.274222:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712907520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997261.274730:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997261.580399:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997262.605537:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997263.051402:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997263.051409:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997263.051415:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997263.051456:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.051469:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.051480:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997263.051505:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712907648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997263.052156:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997263.052215:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c35fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789997263.052235:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712907648 00000100:00100000:2.0:1789997263.052242:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712907648 00000100:00100000:2.0:1789997263.052284:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1789997263.052293:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712907648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997263.052306:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997263.052318:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bce8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.052341:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bce8 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.052352:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bce8 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.052365:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997263.052405:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712907648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997263.052411:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1789997263.052466:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712907648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997263.052481:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.052490:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997263.052507:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997263.052511:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.052518:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997263.229610:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997263.229779:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704387968 00000100:00100000:2.0:1789997263.229790:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704387968 00000100:00100000:2.0:1789997263.229889:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 571 00000100:00100000:2.0:1789997263.229901:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41486:x1876946704387968:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997263.229921:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997263.229943:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bcf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aae9fc expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.230016:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bcfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.230029:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bcfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.230042:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bcfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997263.230078:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:2.0:1789997263.230081:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997263.230214:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bcfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.230241:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bcf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9fc expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.230258:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bcfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9fc expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.230266:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997263.230269:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997263.230272:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3000, rc 0) 00000100:00100000:2.0:1789997263.230437:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41486:x1876946704387968:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 538us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997263.230445:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 571 00000100:00080000:1.0:1789997263.230885:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997263.239167:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997263.239321:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704388224 00000100:00100000:0.0:1789997263.239331:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704388224 00000100:00100000:0.0:1789997263.239387:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 572 00000100:00100000:0.0:1789997263.239398:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41486:x1876946704388224:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997263.239454:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997263.239482:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bcfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae9fc expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997263.239499:0:11799:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592bcda) 00010000:00010000:0.0:1789997263.239504:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:0.0:1789997263.239517:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997263.239543:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997263.239556:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997263.239580:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997263.240004:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6d88b5c reply state 00000000fd7bdba7 transno 4294967518 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997263.240018:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997263.240026:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000100:00100000:0.0:1789997263.240122:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41486:x1876946704388224:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 724us (962us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789997263.240130:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 572 00010000:00010000:1.0:1789997263.244606:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.244623:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.244632:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.244638:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997263.244644:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.244677:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.244693:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:1.0:1789997263.244696:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997263.244702:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.244707:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.626912:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997263.887086:0:71152:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb3e5cab0 20000000:00000080:3.0:1789997263.887105:0:71152:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c5c0e400 uarg=0000000000000000 00010000:00010000:3.0:1789997263.887776:0:71152:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997263.887874:0:71152:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997263.887896:0:71152:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997263.887915:0:71152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997263.887934:0:71152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bce8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997263.887943:0:71152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997263.887982:0:71152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bce8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997263.887998:0:71152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bce8 expref: 18 pid: 5804 timeout: 1602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997263.888013:0:71152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa898700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71152:1876946712907776:0@lo:104: 00000100:00100000:3.0:1789997263.888078:0:71152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997263.888153:0:71152:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e09a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789997263.888157:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712907776 00000100:00100000:0.0:1789997263.888167:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712907776 00000100:00100000:0.0:1789997263.888226:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789997263.888237:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:71152:x1876946712907776:12345-0@lo:104: 00010000:00010000:0.0:1789997263.888251:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997263.888325:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997263.888331:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:71152:x1876946712907776:12345-0@lo:104: Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997263.888339:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00010000:1.0:1789997263.888361:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997263.888370:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.888378:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997263.888382:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.888392:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997263.888399:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997263.888405:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997263.888442:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.888449:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997263.888481:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.888489:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592bce8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bcef expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997263.888507:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997263.888509:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997263.888511:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997263.888524:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712907904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997263.888571:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997263.888585:0:71152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa898700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71152:1876946712907776:0@lo:104: 00010000:00010000:3.0:1789997263.888608:0:71152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997263.888690:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712907904 00000100:00100000:1.0:1789997263.888695:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712907904 00010000:00010000:1.0:1789997263.888715:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bce8 expref: 19 pid: 5804 timeout: 1602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997263.888944:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789997263.888955:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712907904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997263.888968:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997263.888975:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bce8 expref: 19 pid: 5804 timeout: 1602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.888987:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bce8 expref: 19 pid: 5804 timeout: 1602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.888999:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592bcef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bce8 expref: 19 pid: 5804 timeout: 1602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889012:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889020:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889034:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889041:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889047:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889069:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889074:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997263.889078:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889085:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997263.889165:0:71152:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889166:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997263.889187:0:71152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 2/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997263.889191:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997263.889197:0:71152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052aa00/0x65b43101d592bd0b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997263.889239:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712907904:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997263.889246:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789997263.889317:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712907904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997264.331048:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997264.331224:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712908160:0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.331270:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712908544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.331416:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997264.331457:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997264.331468:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997264.331474:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712908672:0@lo:400:kworker.0 00000100:00100000:1.0:1789997264.331477:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712908032:0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.331570:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997264.331570:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997264.331600:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712908288:0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.331626:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997264.331680:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712908032 00000100:00100000:0.0:1789997264.331689:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712908032 00000100:00100000:1.0:1789997264.331710:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712908160 00000100:00100000:1.0:1789997264.331715:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712908160 00000100:00100000:0.0:1789997264.331739:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:0.0:1789997264.331751:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712908032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997264.331752:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712908672 00000100:00100000:1.0:1789997264.331757:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712908672 00000100:00100000:1.0:1789997264.331786:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712908288 00000100:00100000:1.0:1789997264.331788:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712908288 00000100:00100000:2.0:1789997264.331791:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997264.331797:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712908416:0@lo:400:kworker.0 00000100:00100000:1.0:1789997264.331810:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1789997264.331816:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712908160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.331820:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997264.331847:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712908544 00000100:00100000:2.0:1789997264.331851:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712908544 00000100:00100000:1.0:1789997264.331853:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712908160:12345-0@lo:400:kworker.0 Request processed in 38us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997264.331859:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1789997264.331873:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712908416 00000100:00100000:1.0:1789997264.331875:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1789997264.331876:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712908416 00000100:00100000:1.0:1789997264.331880:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712908672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.331893:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1789997264.331898:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712908544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997264.331909:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712908672:12345-0@lo:400:kworker.0 Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997264.331915:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1789997264.331927:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1789997264.331933:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712908288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997264.331977:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712908288:12345-0@lo:400:kworker.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997264.331983:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00080000:1.0:1789997264.332006:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997264.332011:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997264.332014:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997264.332059:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712908288:0@lo:400:kworker.0 00000100:00100000:1.0:1789997264.332100:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712908672:0@lo:400:kworker.0 00000100:00100000:1.0:1789997264.332112:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712908544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.332116:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712908544:12345-0@lo:400:kworker.0 Request processed in 218us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997264.332124:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1789997264.332134:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712908160:0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.332136:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1789997264.332141:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712908416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997264.332173:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712908416:12345-0@lo:400:kworker.0 Request processed in 32us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997264.332178:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:1.0:1789997264.332187:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712908416:0@lo:400:kworker.0 00000100:00100000:0.0:1789997264.332418:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712908032:12345-0@lo:400:kworker.0 Request processed in 670us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997264.332429:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1789997264.332554:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712908032:0@lo:400:kworker.0 00010000:00010000:3.0:1789997264.650796:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997265.674892:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997265.867875:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997265.867883:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997265.867888:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997265.867934:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997265.867947:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997265.867957:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997265.867985:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712908800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997265.868068:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997265.868113:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c574f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789997265.868257:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712908800 00000100:00100000:0.0:1789997265.868266:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712908800 00000100:00100000:0.0:1789997265.868329:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1789997265.868338:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712908800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997265.868351:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997265.868364:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bd12 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997265.868387:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bd12 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997265.868397:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bd12 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997265.868406:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789997265.868451:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712908800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997265.868457:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1789997265.868521:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712908800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997265.868536:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997265.868545:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997265.868564:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997265.868569:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997265.868577:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997266.201265:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997266.201331:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997266.201343:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704388352 00000100:00100000:2.0:1789997266.201354:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704388352 00000100:00100000:3.0:1789997266.201527:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 917 00000100:00100000:3.0:1789997266.201538:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704388352:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997266.201606:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704388352:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997266.201614:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 917 00000100:00100000:1.0:1789997266.204789:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704388736 00000100:00100000:1.0:1789997266.204810:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704388736 00000100:00080000:2.0:1789997266.204885:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997266.204970:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 608 00000100:00100000:1.0:1789997266.204982:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704388736:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997266.205079:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704388736:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 99us (3748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997266.205087:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 608 00000100:00100000:3.0:1789997266.206281:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997266.206441:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704388608 00000100:00100000:2.0:1789997266.206449:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704388608 00000100:00080000:1.0:1789997266.206720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997266.207849:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 295 00000100:00100000:2.0:1789997266.207866:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704388608:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:2.0:1789997266.207897:0:8169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592bb44 00000100:00080000:2.0:1789997266.207907:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38c53da800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789997266.207954:0:8169:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967330 00010000:00010000:1.0:1789997266.207960:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997266.208235:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704388608:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 374us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997266.208247:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 295 00000100:00100000:3.0:1789997266.211359:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997266.211605:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704388480 00000100:00100000:1.0:1789997266.211616:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704388480 00000100:00100000:1.0:1789997266.212556:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1049 00000100:00100000:1.0:1789997266.212575:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704388480:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997266.212664:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704388480:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997266.212673:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1049 00000100:00080000:2.0:1789997266.212870:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997266.307785:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997266.307890:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704388864 00000100:00100000:1.0:1789997266.307901:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704388864 00000100:00100000:1.0:1789997266.308036:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 573 00000100:00100000:1.0:1789997266.308048:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41571:x1876946704388864:12345-192.168.204.4@tcp:48:lfs.60003 00000001:00080000:3.0:1789997266.358359:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000100:00100000:2.0:1789997266.379238:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712909056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997266.379312:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997266.379372:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997266.379379:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712908928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997266.379400:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997266.379431:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712909056 00000100:00100000:2.0:1789997266.379438:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712909056 00000100:00100000:2.0:1789997266.379486:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712908928 00000100:00100000:2.0:1789997266.379490:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712908928 00000100:00100000:2.0:1789997266.379520:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1789997266.379529:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712909056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997266.379567:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997266.379615:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712909056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997266.379622:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1789997266.379638:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1789997266.379645:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712908928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997266.379691:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997266.379719:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712908928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997266.379791:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00080000:2.0:1789997266.379812:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997266.379816:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997266.379861:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712908928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997266.379876:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712909056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997266.388148:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704388864:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 80092us (80362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997266.388163:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 573 00000100:00100000:1.0:1789997266.392085:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997266.392381:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704388992 00000100:00100000:2.0:1789997266.392391:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704388992 00000100:00100000:2.0:1789997266.392438:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 296 00000100:00100000:2.0:1789997266.392447:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876946704388992:12345-192.168.204.4@tcp:8:lfs.60003 00010000:00080000:2.0:1789997266.392479:0:6656:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1455 last 0 00000020:00000080:2.0:1789997266.392524:0:6656:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592bd20 00002000:00100000:2.0:1789997266.392536:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38fd738000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789997266.392547:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789997266.392698:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789997266.392743:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a38fd73e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789997266.392817:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704388992:12345-192.168.204.4@tcp:8:lfs.60003 Request processed in 369us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997266.392825:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 296 00000100:00100000:0.0:1789997266.396586:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997266.396728:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704389120 00000100:00100000:3.0:1789997266.396749:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704389120 00000100:00100000:3.0:1789997266.396826:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 297 00000100:00100000:3.0:1789997266.396837:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41571:x1876946704389120:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:2.0:1789997266.397240:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997266.397417:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41571:x1876946704389120:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 581us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997266.397426:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 297 00000100:00100000:3.0:1789997266.404520:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997266.406083:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704389248 00000100:00100000:2.0:1789997266.406095:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704389248 00000100:00100000:2.0:1789997266.406209:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 298 00000100:00100000:2.0:1789997266.406218:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389248:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997266.407618:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389248:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1394us (3112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997266.407630:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 298 00000100:00100000:1.0:1789997266.414823:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997266.414957:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704389376 00000100:00100000:3.0:1789997266.414967:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704389376 00000100:00100000:3.0:1789997266.415028:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 574 00000100:00100000:3.0:1789997266.415037:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389376:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997266.415474:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389376:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 436us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997266.415482:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 574 00000100:00100000:0.0:1789997266.422819:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997266.422971:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704389504 00000100:00100000:1.0:1789997266.422983:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704389504 00000100:00100000:1.0:1789997266.423054:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 575 00000100:00100000:1.0:1789997266.423065:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389504:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997266.493928:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389504:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 70855us (71110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997266.493941:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 575 00000100:00100000:2.0:1789997266.496510:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997266.496689:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704389632 00000100:00100000:3.0:1789997266.496699:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704389632 00000100:00100000:3.0:1789997266.496769:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 299 00000100:00100000:3.0:1789997266.496779:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41571:x1876946704389632:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997266.497840:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41571:x1876946704389632:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1058us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997266.497851:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 299 00000100:00100000:1.0:1789997266.500625:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997266.500804:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704389760 00000100:00100000:2.0:1789997266.500815:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704389760 00000100:00100000:2.0:1789997266.500906:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 300 00000100:00100000:2.0:1789997266.500917:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389760:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997266.501388:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389760:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 471us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997266.501397:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 300 00000100:00100000:1.0:1789997266.505363:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997266.505484:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704389888 00000100:00100000:0.0:1789997266.505495:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704389888 00000100:00100000:0.0:1789997266.505578:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 576 00000100:00100000:0.0:1789997266.505589:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389888:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997266.506195:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41571:x1876946704389888:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 606us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997266.506204:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 576 00000100:00100000:3.0:1789997266.570983:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997266.574782:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704390016 00000100:00100000:0.0:1789997266.574801:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704390016 00000100:00100000:0.0:1789997266.574914:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 577 00000100:00100000:0.0:1789997266.574927:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41575:x1876946704390016:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997266.575455:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997266.575488:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bd27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea03 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.575738:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.575754:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.575770:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.575784:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.575792:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.575800:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577292:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577311:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577543:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997266.577585:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789997266.577590:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997266.577614:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577628:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577639:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577646:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577689:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997266.577694:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577703:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577717:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997266.577721:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997266.577726:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577733:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bd2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577748:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577755:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577761:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577767:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997266.577770:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577777:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577784:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997266.577787:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997266.577790:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577796:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592bd35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577837:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bd27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea03 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577855:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea03 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997266.577862:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997266.577864:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997266.577867:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997266.577959:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41575:x1876946704390016:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 3033us (6984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997266.577969:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 577 00000100:00100000:1.0:1789997266.583602:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997266.584738:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704390272 00000100:00100000:3.0:1789997266.584750:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704390272 00000100:00100000:3.0:1789997266.584823:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 578 00000100:00100000:3.0:1789997266.584833:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41575:x1876946704390272:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997266.584854:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997266.584875:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea0a expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.585271:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.585288:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.585300:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.585315:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.585321:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.585327:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997266.586156:0:7602:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c62680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7602:1876946712909184:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789997266.586227:0:7602:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997266.586290:0:7602:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c574fa80 going to sleep for 11 seconds 00000004:00080000:3.0:1789997266.586491:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00010000:00010000:3.0:1789997266.586841:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586856:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586865:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586903:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586910:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586917:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586924:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997266.586928:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586936:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586948:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:3.0:1789997266.586951:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997266.586956:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.586962:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997266.586975:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008de7932e reply state 00000000b1d273a7 transno 4294967519 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997266.586984:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997266.588812:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712909184 00000100:00100000:0.0:1789997266.588828:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712909184 00000100:00100000:0.0:1789997266.589139:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789997266.589151:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7602:x1876946712909184:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1789997266.589354:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea0a expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.589386:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea0a expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.589396:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997266.589399:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997266.589403:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b600, rc 0) 00002000:00080000:0.0:1789997266.589449:0:6658:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1789997266.589559:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:41575:x1876946704390272:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 4726us (5967us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789997266.589568:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 578 00010000:00010000:3.0:1789997266.592799:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.593208:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.593217:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.593224:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997266.593228:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.593237:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.593252:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38ee49ea00) 00010000:00010000:3.0:1789997266.593255:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997266.593260:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.593268:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bd51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997266.605316:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997266.605873:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704390400 00000100:00100000:3.0:1789997266.605884:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704390400 00000100:00100000:3.0:1789997266.605946:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 302 00000100:00100000:3.0:1789997266.605957:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41575:x1876946704390400:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997266.605976:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997266.606002:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea11 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997266.606030:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789997266.606053:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=1455s v=(0 0) 00010000:00010000:3.0:1789997266.606058:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997266.606067:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.606085:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997266.606098:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997266.606171:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41575:x1876946704390400:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 216us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997266.606179:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 302 00000100:00100000:2.0:1789997266.622605:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7602:x1876946712909184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 33450us (36370us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789997266.622619:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1789997266.622948:0:7602:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c62680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7602:1876946712909184:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789997266.622966:0:7602:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:1.0:1789997266.638230:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997266.638353:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704390528 00000100:00100000:2.0:1789997266.638364:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704390528 00002000:00100000:2.0:1789997266.638441:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->1048575) req@ffff8a37c6a02680 x1876946704390528/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:242/0 lens 488/0 e 0 to 0 dl 1789997277 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789997266.638454:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c6a02680 with x1876946704390528 ext(0->1048575) 00002000:00010000:2.0:1789997266.638461:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c6a02680 00000100:00100000:2.0:1789997266.638536:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:2.0:1789997266.638547:0:6663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704390528:12345-192.168.204.4@tcp:4:dd.60003 00010000:00010000:3.0:1789997266.698764:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997266.701417:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00000001:00100000:1.0:1789997266.701428:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000001:00100000:1.0:1789997266.701433:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997266.701436:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a38c53df800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:2.0:1789997266.701741:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38c53df800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:2.0:1789997266.701802:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38c53da800 for lustre-OST0000 00000001:00080000:1.0:1789997266.759142:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967332 is committed 00000100:00100000:1.0:1789997266.759273:0:6663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704390528:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 120723us (121049us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789997266.759285:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00002000:00100000:1.0:1789997266.759299:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x12:0x0] (0->1048575) req@ffff8a37c6a02680 x1876946704390528/t4294967332(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:242/0 lens 488/448 e 0 to 0 dl 1789997277 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789997266.759310:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c6a02680 with x1876946704390528 ext(0->1048575) 00002000:00010000:1.0:1789997266.759685:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c6a02680 00000100:00100000:2.0:1789997266.763608:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997266.763887:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704390656 00000100:00100000:1.0:1789997266.763899:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704390656 00000100:00100000:1.0:1789997266.763965:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 579 00000100:00100000:1.0:1789997266.763977:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:41575:x1876946704390656:12345-192.168.204.4@tcp:44:dd.60003 00000001:00080000:2.0:1789997266.828274:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000100:00100000:3.0:1789997266.828613:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41575:x1876946704390656:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 64633us (65013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997266.828624:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 579 00000100:00100000:0.0:1789997266.834206:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997266.834871:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704390784 00000100:00100000:1.0:1789997266.834882:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704390784 00000100:00100000:1.0:1789997266.834985:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 303 00000100:00100000:1.0:1789997266.834996:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704390784:12345-192.168.204.4@tcp:16:dd.60003 00000100:00100000:1.0:1789997266.835120:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704390784:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 125us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997266.835130:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 303 00000100:00100000:2.0:1789997266.837797:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997266.837883:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704391040 00000100:00100000:3.0:1789997266.837892:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704391040 00000100:00100000:3.0:1789997266.837975:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 61 00000100:00100000:3.0:1789997266.837996:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41575:x1876946704391040:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:3.0:1789997266.838484:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:41575:x1876946704391040:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 498us (695us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789997266.838503:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 61 00010000:00010000:3.0:1789997267.722771:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997267.807762:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000004:00080000:0.0:1789997268.658839:0:71398:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1457351182508ns, next at 1418180683641ns, rc = 0 00000004:00080000:0.0:1789997268.658940:0:71398:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1457351285357ns, next at 1445831506943ns, rc = 0 00000004:00080000:1.0:1789997268.661212:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 52 committed 00000004:00080000:1.0:1789997268.661235:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 49 committed 00010000:00010000:1.0:1789997268.747824:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997269.451958:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712909440:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452062:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997269.452107:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712909952:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452129:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997269.452154:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789997269.452160:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712909312:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452202:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997269.452222:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712909824:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452247:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997269.452273:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712909568:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452297:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997269.452313:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997269.452318:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712909696:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452336:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997269.452368:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712909440 00000100:00100000:0.0:1789997269.452375:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712909440 00000100:00100000:0.0:1789997269.452414:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712909952 00000100:00100000:0.0:1789997269.452417:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712909952 00000100:00100000:0.0:1789997269.452454:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712909568 00000100:00100000:0.0:1789997269.452457:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712909568 00000100:00100000:0.0:1789997269.452548:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1789997269.452556:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712909440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452608:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712909440:12345-0@lo:400:kworker.0 Request processed in 52us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.452616:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1789997269.452632:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1789997269.452638:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712909952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452693:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712909952:12345-0@lo:400:kworker.0 Request processed in 55us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.452699:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1789997269.452710:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1789997269.452716:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712909568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452747:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712909568:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.452752:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1789997269.452774:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712909312 00000100:00100000:0.0:1789997269.452778:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712909312 00000100:00100000:0.0:1789997269.452803:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1789997269.452809:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712909312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452835:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712909312:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.452841:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1789997269.452866:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712909824 00000100:00100000:0.0:1789997269.452869:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712909824 00000100:00100000:0.0:1789997269.452892:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712909696 00000100:00100000:0.0:1789997269.452895:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712909696 00000100:00100000:0.0:1789997269.452913:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1789997269.452919:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712909824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452948:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712909824:12345-0@lo:400:kworker.0 Request processed in 29us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.452954:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1789997269.452965:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1789997269.452970:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712909696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.452993:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712909696:12345-0@lo:400:kworker.0 Request processed in 23us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.452998:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00080000:0.0:1789997269.453023:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997269.453027:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997269.453030:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997269.453069:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967331 gen 2 00000100:00100000:0.0:1789997269.453085:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712909696:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.453095:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712909568:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.453119:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712909312:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.453129:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712909824:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.453138:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712909440:0@lo:400:kworker.0 00000100:00100000:0.0:1789997269.453146:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712909952:0@lo:400:kworker.0 00000100:00100000:2.0:1789997269.759151:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997269.759377:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704391168 00000100:00100000:0.0:1789997269.759387:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704391168 00000100:00080000:2.0:1789997269.759454:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997269.759522:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 580 00000100:00100000:0.0:1789997269.759534:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41767:x1876946704391168:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997269.759641:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41767:x1876946704391168:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 109us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.759649:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 580 00000100:00100000:2.0:1789997269.764997:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997269.765620:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704391296 00000100:00100000:0.0:1789997269.765630:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704391296 00000100:00080000:2.0:1789997269.765699:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997269.765732:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 304 00000100:00100000:0.0:1789997269.765744:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41767:x1876946704391296:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997269.766207:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41767:x1876946704391296:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 464us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.766216:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 304 00000100:00100000:3.0:1789997269.767702:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997269.767944:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704391424 00000100:00100000:0.0:1789997269.767951:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704391424 00000100:00100000:0.0:1789997269.768003:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 305 00000100:00100000:0.0:1789997269.768013:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41767:x1876946704391424:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997269.768432:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41767:x1876946704391424:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 418us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.768452:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 305 00000100:00080000:3.0:1789997269.768618:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789997269.770793:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997269.773479:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997269.773570:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704391552 00000100:00100000:0.0:1789997269.773581:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704391552 00000100:00100000:0.0:1789997269.773646:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 581 00000100:00100000:0.0:1789997269.773686:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41767:x1876946704391552:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997269.774648:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41767:x1876946704391552:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 989us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.774681:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 581 00000100:00100000:0.0:1789997269.784428:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997269.785688:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704391680 00000100:00100000:1.0:1789997269.785701:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704391680 00000100:00100000:2.0:1789997269.785810:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 582 00000100:00100000:2.0:1789997269.785823:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41767:x1876946704391680:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997269.785960:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41767:x1876946704391680:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 140us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997269.785967:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 582 00000100:00100000:3.0:1789997269.792492:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997269.792640:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704391808 00000100:00100000:2.0:1789997269.792651:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704391808 00000100:00100000:2.0:1789997269.792736:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 306 00000100:00100000:2.0:1789997269.792747:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41767:x1876946704391808:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997269.793157:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:41767:x1876946704391808:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 411us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997269.793164:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 306 00000100:00100000:0.0:1789997269.801781:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997269.802303:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704391936 00000100:00100000:1.0:1789997269.802316:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704391936 00000100:00100000:1.0:1789997269.802401:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 307 00000100:00100000:1.0:1789997269.802414:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41767:x1876946704391936:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997269.802974:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:41767:x1876946704391936:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 561us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997269.802985:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 307 00000100:00100000:0.0:1789997269.806849:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997269.806890:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704392064 00000100:00100000:0.0:1789997269.806898:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704392064 00000100:00100000:0.0:1789997269.806945:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 583 00000100:00100000:0.0:1789997269.806954:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41767:x1876946704392064:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997269.807587:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41767:x1876946704392064:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 632us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997269.807605:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 583 00000100:00100000:0.0:1789997269.869086:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997269.870103:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704392320 00000100:00100000:3.0:1789997269.870116:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704392320 00000100:00100000:3.0:1789997269.870173:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 584 00000100:00100000:3.0:1789997269.870184:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:41771:x1876946704392320:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997269.870237:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997269.870265:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea0a expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.870284:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997269.870296:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997269.870318:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.870331:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.870342:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.870356:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.870362:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.870369:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.872922:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.872941:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.872953:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997269.875785:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9344 00000004:00080000:2.0:1789997269.875804:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1458568149780ns, next at 1459568145414ns, rc = 0 00010000:00010000:2.0:1789997269.875925:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.875947:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.875961:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.875971:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.875978:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.875984:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876006:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997269.876033:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876040:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876046:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876051:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997269.876057:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876066:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876081:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:2.0:1789997269.876084:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997269.876090:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876096:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bd7b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876114:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876120:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876125:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876130:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997269.876133:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876139:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876146:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:2.0:1789997269.876149:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997269.876152:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997269.876158:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bd6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997269.876170:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da151c5e reply state 000000006108f74e transno 4294967521 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997269.876179:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997269.876273:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:41771:x1876946704392320:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 6088us (7194us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789997269.876282:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 584 00010000:00010000:3.0:1789997269.876937:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997269.876945:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.876954:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997269.876957:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.876964:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.876975:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997269.876978:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997269.876981:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.876987:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592bd82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.877003:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997269.877006:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997269.877007:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997269.880274:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.880294:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.880303:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.880309:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997269.880314:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.880464:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.880486:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0xa8fa037c (ffff8a38ee49e300) 00010000:00010000:3.0:1789997269.880489:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997269.880494:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997269.880501:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997270.794860:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997271.318821:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997271.318862:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997271.318901:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997271.318927:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704392576 00000100:00100000:0.0:1789997271.318933:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997271.318950:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704392576 00000100:00100000:0.0:1789997271.318960:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704392448 00000100:00100000:0.0:1789997271.318967:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704392448 00000100:00100000:0.0:1789997271.319014:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 919 00000100:00100000:2.0:1789997271.319020:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1053 00000100:00100000:0.0:1789997271.319027:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704392448:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997271.319034:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704392576:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997271.319111:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704392832 00000100:00100000:3.0:1789997271.319116:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704392832 00000100:00100000:3.0:1789997271.319144:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704392704 00000100:00100000:3.0:1789997271.319147:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704392704 00000100:00100000:3.0:1789997271.319168:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 611 00000100:00100000:3.0:1789997271.319175:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704392832:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997271.319234:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704392448:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 211us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997271.319245:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 919 00000100:00100000:2.0:1789997271.319246:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704392576:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 214us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997271.319257:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1053 00000100:00100000:0.0:1789997271.319288:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 612 00000100:00100000:0.0:1789997271.319296:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704392704:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997271.319338:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704392704:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997271.319344:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 612 00000100:00100000:3.0:1789997271.320554:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704392832:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1373us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997271.320565:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 611 00000100:00080000:3.0:1789997271.320593:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997271.320598:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997271.320601:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997271.500610:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997271.500633:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712910080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997271.500723:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997271.500791:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712910080 00000100:00100000:0.0:1789997271.500799:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712910080 00000100:00100000:0.0:1789997271.500867:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1789997271.500876:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712910080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997271.500909:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997271.500950:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712910080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997271.500957:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1789997271.501003:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712910080:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997271.501361:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789997271.509747:0:7602:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1460202090339ns, next at 1461202087944ns, rc = 0 00000100:00100000:3.0:1789997271.509799:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712910208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997271.509876:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997271.509969:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712910208 00000100:00100000:3.0:1789997271.509979:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712910208 00000100:00100000:3.0:1789997271.510045:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1789997271.510055:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712910208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997271.510096:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997271.510149:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712910208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997271.510157:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:3.0:1789997271.510211:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712910208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997271.510758:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789997271.555184:0:71542:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1460247527931ns, next at 1461202087944ns, rc = 0 00000004:00080000:2.0:1789997271.594152:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 52 committed 00000004:00080000:2.0:1789997271.594177:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 51 committed 00000001:00080000:2.0:1789997271.594187:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:2.0:1789997271.594191:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 50 committed 00000100:00100000:2.0:1789997271.594317:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712910336:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789997271.594643:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997271.594848:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712910336 00000100:00100000:1.0:1789997271.594858:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712910336 00000100:00100000:1.0:1789997271.594915:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789997271.594925:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712910336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789997271.594954:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:18 count 1 00010000:00010000:1.0:1789997271.594980:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.595004:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.595020:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x12:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1789997271.595025:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997271.595030:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.595062:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.595077:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 5 pid: 6656 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997271.595089:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712910464:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997271.595166:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789997271.602604:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712910464:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997271.602641:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997271.605684:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997271.605966:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704392960 00000100:00100000:1.0:1789997271.605980:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704392960 00010000:00010000:1.0:1789997271.606043:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 6 pid: 6656 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997271.606093:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 321 00000100:00100000:1.0:1789997271.606105:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704392960:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997271.606124:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997271.606130:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 6 pid: 6656 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.606145:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 6 pid: 6656 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.606174:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083db9721/0x65b43101d592bd66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea11 expref: 6 pid: 6656 timeout: 1560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.606205:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997271.606209:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997271.606216:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.606225:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.606259:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997271.606319:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704392960:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 216us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997271.606327:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 321 00010000:00010000:0.0:1789997271.606500:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997271.606512:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997271.606523:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997271.606532:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997271.606560:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997271.608786:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712910336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13857us (14138us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789997271.608802:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000004:00080000:2.0:1789997271.611629:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c7c62d80/2, rc 0, transno 4294967333 00000100:00100000:2.0:1789997271.611694:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712910336:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789997271.611942:0:71542:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1460304286882ns, next at 1445831506943ns, rc = 0 00010000:00010000:1.0:1789997271.613884:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997271.613901:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.613915:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997271.613922:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.613933:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.613955:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.613962:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592bd89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997271.613989:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997271.613992:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997271.613994:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789997271.618890:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 53 committed 00010000:00010000:3.0:1789997271.818851:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997272.846221:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997273.872717:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997274.570842:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712910976:0@lo:400:kworker.0 00000100:00100000:0.0:1789997274.570915:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997274.570977:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789997274.570984:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712910592:0@lo:400:kworker.0 00000100:00100000:0.0:1789997274.571019:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997274.571036:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712910720:0@lo:400:kworker.0 00000100:00100000:0.0:1789997274.571045:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712911104:0@lo:400:kworker.0 00000100:00100000:0.0:1789997274.571083:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997274.571089:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997274.571119:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712910592 00000100:00100000:3.0:1789997274.571126:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712911232:0@lo:400:kworker.0 00000100:00100000:0.0:1789997274.571127:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712910592 00000100:00100000:3.0:1789997274.571172:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997274.571178:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1789997274.571189:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712910592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997274.571198:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997274.571206:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712910848:0@lo:400:kworker.0 00000100:00100000:0.0:1789997274.571246:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712910592:12345-0@lo:400:kworker.0 Request processed in 57us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997274.571254:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:3.0:1789997274.571258:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997274.571306:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712910976 00000100:00100000:3.0:1789997274.571311:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712910976 00000100:00100000:0.0:1789997274.571316:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712910592:0@lo:400:kworker.0 00000100:00100000:3.0:1789997274.571377:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712911104 00000100:00100000:3.0:1789997274.571381:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712911104 00000100:00100000:3.0:1789997274.571411:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1789997274.571420:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712910976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997274.571478:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712910976:12345-0@lo:400:kworker.0 Request processed in 60us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997274.571484:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1789997274.571499:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1789997274.571505:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712911104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997274.571546:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712911104:12345-0@lo:400:kworker.0 Request processed in 41us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997274.571553:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1789997274.571588:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712910720 00000100:00100000:3.0:1789997274.571592:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712910720 00000100:00100000:3.0:1789997274.571624:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712911232 00000100:00100000:3.0:1789997274.571628:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712911232 00000100:00100000:1.0:1789997274.571644:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712911104:0@lo:400:kworker.0 00000100:00100000:1.0:1789997274.571689:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712910976:0@lo:400:kworker.0 00000100:00100000:3.0:1789997274.571691:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712910848 00000100:00100000:3.0:1789997274.571697:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712910848 00000100:00100000:3.0:1789997274.571743:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1789997274.571751:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712910720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997274.571804:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1789997274.571805:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712910720:12345-0@lo:400:kworker.0 Request processed in 52us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997274.571816:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1789997274.571817:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712911232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997274.571836:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1789997274.571845:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712910848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997274.571858:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712911232:12345-0@lo:400:kworker.0 Request processed in 45us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997274.571865:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1789997274.571887:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712910848:12345-0@lo:400:kworker.0 Request processed in 42us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997274.571893:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:3.0:1789997274.571920:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997274.571924:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997274.571926:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997274.572171:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712910848:0@lo:400:kworker.0 00000100:00100000:0.0:1789997274.572181:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712910720:0@lo:400:kworker.0 00000100:00100000:0.0:1789997274.572189:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712911232:0@lo:400:kworker.0 00010000:00010000:3.0:1789997274.892840:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997275.148457:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00010000:00010000:1.0:1789997275.915177:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997276.438696:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997276.438733:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997276.438752:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997276.438773:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997276.438841:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704393344 00000100:00100000:3.0:1789997276.438851:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704393344 00000100:00100000:3.0:1789997276.438910:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704393472 00000100:00100000:3.0:1789997276.438914:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704393472 00000100:00100000:3.0:1789997276.438938:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 615 00000100:00100000:3.0:1789997276.438948:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704393344:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997276.439015:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704393344:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997276.439023:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 615 00000100:00100000:3.0:1789997276.439039:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 616 00000100:00100000:3.0:1789997276.439045:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704393472:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997276.439070:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704393472:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997276.439076:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 616 00000100:00080000:2.0:1789997276.439247:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997276.439251:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997276.439420:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704393088 00000100:00100000:1.0:1789997276.439426:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704393088 00000100:00100000:1.0:1789997276.439455:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 921 00000100:00100000:1.0:1789997276.439462:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704393088:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997276.439506:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704393088:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997276.439513:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 921 00000100:00100000:1.0:1789997276.439617:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704393216 00000100:00100000:1.0:1789997276.439621:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704393216 00000100:00100000:1.0:1789997276.439675:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1057 00000100:00100000:1.0:1789997276.439682:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704393216:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997276.439712:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704393216:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997276.439718:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1057 00000100:00080000:1.0:1789997276.439733:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997276.620011:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997276.620037:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712911360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997276.620104:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997276.620410:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712911360 00000100:00100000:3.0:1789997276.620418:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712911360 00000100:00100000:3.0:1789997276.620495:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1789997276.620506:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712911360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997276.620545:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997276.620595:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712911360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997276.620602:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1789997276.620623:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997276.620632:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712911488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997276.620687:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997276.620714:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712911488 00000100:00100000:3.0:1789997276.620718:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712911488 00000100:00100000:3.0:1789997276.620741:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:3.0:1789997276.620748:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712911488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997276.620767:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997276.620810:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712911488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997276.620816:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:1.0:1789997276.620909:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:1.0:1789997276.620915:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c7c62d80, transno 4294967333 00000100:00100000:0.0:1789997276.620938:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712911488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997276.620939:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712911360:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997276.621178:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997276.621183:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997276.938952:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997277.962827:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997278.986874:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997279.691129:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712911744:0@lo:400:kworker.0 00000100:00100000:1.0:1789997279.691140:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712912000:0@lo:400:kworker.0 00000100:00100000:0.0:1789997279.691263:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712911616:0@lo:400:kworker.0 00000100:00100000:1.0:1789997279.691409:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997279.691554:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712911872:0@lo:400:kworker.0 00000100:00100000:1.0:1789997279.691584:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997279.691604:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997279.691636:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712912256:0@lo:400:kworker.0 00000100:00100000:1.0:1789997279.691639:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712911872 00000100:00100000:1.0:1789997279.691649:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712911872 00000100:00100000:3.0:1789997279.691692:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997279.691736:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712911744 00000100:00100000:3.0:1789997279.691739:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712912256 00000100:00100000:1.0:1789997279.691740:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712911744 00000100:00100000:3.0:1789997279.691746:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712912256 00000100:00100000:1.0:1789997279.691770:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1789997279.691787:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712911872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997279.691820:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997279.691851:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712911872:12345-0@lo:400:kworker.0 Request processed in 64us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997279.691854:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712912128:0@lo:400:kworker.0 00000100:00100000:0.0:1789997279.691883:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997279.693704:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1789997279.693722:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712911744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997279.693806:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712911744:12345-0@lo:400:kworker.0 Request processed in 92us (2204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997279.693813:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1789997279.693834:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1789997279.693841:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712912256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997279.693870:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712912256:12345-0@lo:400:kworker.0 Request processed in 30us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997279.693876:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1789997279.693931:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712911744:0@lo:400:kworker.0 00000100:00100000:3.0:1789997279.693946:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712912256:0@lo:400:kworker.0 00000100:00080000:3.0:1789997279.694010:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997279.694041:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712911872:0@lo:400:kworker.0 00000100:00100000:3.0:1789997279.694071:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712911616 00000100:00100000:3.0:1789997279.694077:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712911616 00000100:00100000:3.0:1789997279.694110:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1789997279.694117:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712911616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997279.694152:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712911616:12345-0@lo:400:kworker.0 Request processed in 35us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997279.694158:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:1.0:1789997279.694376:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1789997279.694696:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712911616:0@lo:400:kworker.0 00000100:00100000:2.0:1789997279.694737:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712912000 00000100:00100000:2.0:1789997279.694743:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712912000 00000100:00100000:3.0:1789997279.694761:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712912128 00000100:00100000:3.0:1789997279.694767:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712912128 00000100:00100000:3.0:1789997279.694856:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:3.0:1789997279.694865:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712912128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997279.694912:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712912128:12345-0@lo:400:kworker.0 Request processed in 48us (3027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997279.694918:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1789997279.694926:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1789997279.694931:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712912000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997279.694984:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712912000:12345-0@lo:400:kworker.0 Request processed in 57us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997279.694992:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1789997279.695006:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712912000:0@lo:400:kworker.0 00000100:00080000:0.0:1789997279.695085:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997279.695089:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997279.695110:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712912128:0@lo:400:kworker.0 00010000:00010000:1.0:1789997280.011028:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997281.034862:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997281.558820:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997281.558868:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997281.558909:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704393600 00000100:00100000:3.0:1789997281.558913:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997281.558923:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704393600 00000100:00100000:3.0:1789997281.558959:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997281.558990:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704393856 00000100:00100000:1.0:1789997281.558990:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 923 00000100:00100000:3.0:1789997281.558995:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704393856 00000100:00100000:1.0:1789997281.559016:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704393600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997281.559033:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704393984 00000100:00100000:3.0:1789997281.559037:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704393984 00000100:00100000:3.0:1789997281.559063:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 619 00000100:00100000:3.0:1789997281.559072:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704393856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997281.559097:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704393600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 83us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997281.559106:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 923 00000100:00100000:3.0:1789997281.559112:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704393856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997281.559120:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 619 00000100:00100000:3.0:1789997281.559139:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 620 00000100:00100000:3.0:1789997281.559147:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704393984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997281.559178:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704393984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997281.559184:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 620 00000100:00100000:2.0:1789997281.559391:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704393728 00000100:00100000:2.0:1789997281.559397:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704393728 00000100:00100000:2.0:1789997281.559443:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1061 00000100:00100000:2.0:1789997281.559452:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704393728:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997281.559499:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704393728:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997281.559507:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1061 00000100:00080000:0.0:1789997281.559513:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997281.559520:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997281.559524:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997281.738956:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997281.738983:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712912384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997281.739057:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997281.739244:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712912384 00000100:00100000:0.0:1789997281.739253:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712912384 00000100:00100000:0.0:1789997281.739330:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1789997281.739339:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712912384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997281.739375:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997281.739426:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712912384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997281.739433:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1789997281.739488:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712912384:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997281.739621:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997281.739823:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997281.739833:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712912512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997281.739863:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997281.739942:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712912512 00000100:00100000:2.0:1789997281.739946:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712912512 00000100:00100000:2.0:1789997281.739989:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1789997281.739997:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712912512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997281.740017:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997281.740054:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712912512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997281.740060:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1789997281.740092:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712912512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997281.740351:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997282.059036:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997283.083010:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997284.108111:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997284.811509:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712912768:0@lo:400:kworker.0 00000100:00100000:1.0:1789997284.811533:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712912896:0@lo:400:kworker.0 00000100:00100000:3.0:1789997284.811612:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712913024:0@lo:400:kworker.0 00000100:00100000:2.0:1789997284.811673:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712912640:0@lo:400:kworker.0 00000100:00100000:0.0:1789997284.811773:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997284.811826:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712913280:0@lo:400:kworker.0 00000100:00100000:0.0:1789997284.811847:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997284.811892:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712912768 00000100:00100000:0.0:1789997284.811901:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712912768 00000100:00100000:0.0:1789997284.811947:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712913280 00000100:00100000:0.0:1789997284.811951:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712913280 00000100:00100000:0.0:1789997284.811984:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1789997284.811993:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712912768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997284.812044:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712912768:12345-0@lo:400:kworker.0 Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997284.812051:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1789997284.812068:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1789997284.812073:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712913280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997284.812101:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712913280:12345-0@lo:400:kworker.0 Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997284.812106:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00080000:0.0:1789997284.812126:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997284.812168:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712912768:0@lo:400:kworker.0 00000100:00100000:0.0:1789997284.812192:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712913280:0@lo:400:kworker.0 00000100:00100000:1.0:1789997284.812645:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997284.812798:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712912896 00000100:00100000:0.0:1789997284.812804:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712912896 00000100:00100000:0.0:1789997284.812882:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1789997284.812888:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712912896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997284.812926:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712912896:12345-0@lo:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997284.812943:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1789997284.812978:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712912896:0@lo:400:kworker.0 00000100:00080000:1.0:1789997284.813076:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997284.818407:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997284.818601:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997284.818642:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712913152:0@lo:400:kworker.0 00000100:00100000:2.0:1789997284.818701:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997284.818794:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712912640 00000100:00100000:0.0:1789997284.818801:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712913024 00000100:00100000:3.0:1789997284.818803:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712912640 00000100:00100000:0.0:1789997284.818808:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712913024 00000100:00100000:3.0:1789997284.818860:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1789997284.818866:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712913152 00000100:00100000:0.0:1789997284.818870:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712913152 00000100:00100000:3.0:1789997284.818874:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712912640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997284.818932:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712912640:12345-0@lo:400:kworker.0 Request processed in 62us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997284.818939:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1789997284.819025:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1789997284.819035:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712913024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997284.819081:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712913024:12345-0@lo:400:kworker.0 Request processed in 49us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997284.819088:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:2.0:1789997284.819101:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1789997284.819108:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712913152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997284.819134:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712913152:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997284.819140:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00080000:2.0:1789997284.819171:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997284.819175:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997284.819206:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712912640:0@lo:400:kworker.0 00000100:00100000:2.0:1789997284.819219:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712913152:0@lo:400:kworker.0 00000100:00100000:3.0:1789997284.819376:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712913024:0@lo:400:kworker.0 00010000:00010000:1.0:1789997285.132151:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997286.154927:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997286.681749:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997286.681798:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997286.681835:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997286.681872:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997286.681908:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704394240 00000100:00100000:2.0:1789997286.681908:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704394368 00000100:00100000:2.0:1789997286.681919:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704394368 00000100:00100000:3.0:1789997286.681920:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704394240 00000100:00100000:2.0:1789997286.681981:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704394496 00000100:00100000:2.0:1789997286.681984:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704394496 00000100:00100000:1.0:1789997286.682044:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704394112 00000100:00100000:1.0:1789997286.682049:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704394112 00000100:00100000:1.0:1789997286.682080:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 925 00000100:00100000:1.0:1789997286.682089:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704394112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997286.682186:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704394112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 98us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997286.682194:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 925 00000100:00100000:1.0:1789997286.682332:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 623 00000100:00100000:1.0:1789997286.682341:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704394368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997286.682381:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704394368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997286.682388:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 623 00000100:00100000:2.0:1789997286.683263:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 624 00000100:00100000:2.0:1789997286.683273:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704394496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997286.683322:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704394496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 51us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997286.683329:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 624 00000100:00080000:1.0:1789997286.683969:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997286.683976:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997286.683979:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997286.686248:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1065 00000100:00100000:3.0:1789997286.686262:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704394240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997286.686359:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704394240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 100us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997286.686369:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1065 00000100:00100000:2.0:1789997286.858851:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997286.858866:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997286.858872:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712913536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997286.858881:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712913408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997286.860818:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997286.860982:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997286.861441:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712913408 00000100:00100000:3.0:1789997286.861450:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712913408 00000100:00100000:0.0:1789997286.861557:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712913536 00000100:00100000:0.0:1789997286.861561:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712913536 00000100:00100000:3.0:1789997286.861687:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1789997286.861699:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712913408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997286.861744:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997286.861815:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712913408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997286.861823:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1789997286.861886:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712913408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997286.862219:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:0.0:1789997286.862228:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712913536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997286.862248:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997286.862292:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712913536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997286.862299:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1789997286.862377:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712913536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997286.862503:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997286.862507:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789997287.178985:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997288.202857:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997288.447417:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997288.447499:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704394624 00000100:00100000:0.0:1789997288.447509:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704394624 00000100:00100000:0.0:1789997288.447572:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 585 00000100:00100000:0.0:1789997288.447582:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42029:x1876946704394624:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00080000:1.0:1789997288.447746:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997288.447949:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42029:x1876946704394624:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 368us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997288.447958:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 585 00000100:00100000:1.0:1789997288.449791:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997288.450931:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704394752 00000100:00100000:3.0:1789997288.450942:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704394752 00000100:00100000:3.0:1789997288.451019:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 309 00000100:00100000:3.0:1789997288.451031:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42029:x1876946704394752:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997288.451508:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42029:x1876946704394752:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 476us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997288.451522:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 309 00000100:00080000:3.0:1789997288.451881:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997288.453713:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997288.453747:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704394880 00000100:00100000:3.0:1789997288.453756:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704394880 00000100:00100000:3.0:1789997288.453812:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 310 00000100:00100000:3.0:1789997288.453823:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42029:x1876946704394880:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997288.454186:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42029:x1876946704394880:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 364us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997288.454194:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 310 00000100:00080000:3.0:1789997288.455789:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997288.459731:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997288.461029:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704395008 00000100:00100000:2.0:1789997288.461041:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704395008 00000100:00100000:2.0:1789997288.461105:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 586 00000100:00100000:2.0:1789997288.461117:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42029:x1876946704395008:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997288.464417:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42029:x1876946704395008:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 3294us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997288.464431:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 586 00000100:00100000:3.0:1789997288.470871:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997288.470922:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704395136 00000100:00100000:1.0:1789997288.470933:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704395136 00000100:00100000:1.0:1789997288.470994:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 587 00000100:00100000:1.0:1789997288.471016:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42029:x1876946704395136:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997288.471143:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42029:x1876946704395136:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 139us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997288.471154:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 587 00000100:00100000:3.0:1789997288.473370:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997288.473453:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704395264 00000100:00100000:1.0:1789997288.473461:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704395264 00000100:00100000:1.0:1789997288.473512:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 311 00000100:00100000:1.0:1789997288.473522:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42029:x1876946704395264:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997288.474006:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42029:x1876946704395264:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 484us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997288.474014:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 311 00000100:00100000:2.0:1789997288.478604:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997288.479908:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704395392 00000100:00100000:3.0:1789997288.479919:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704395392 00000100:00100000:3.0:1789997288.479971:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 312 00000100:00100000:3.0:1789997288.479982:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42029:x1876946704395392:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997288.480584:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42029:x1876946704395392:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 602us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997288.480593:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 312 00000100:00100000:3.0:1789997288.483891:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997288.484005:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704395520 00000100:00100000:2.0:1789997288.484084:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704395520 00000100:00100000:2.0:1789997288.484149:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 588 00000100:00100000:2.0:1789997288.484160:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42029:x1876946704395520:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997288.484777:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42029:x1876946704395520:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 616us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997288.484786:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 588 00000100:00100000:3.0:1789997288.519895:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997288.519935:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704395648 00000100:00100000:3.0:1789997288.519945:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704395648 00000100:00100000:3.0:1789997288.519999:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 589 00000100:00100000:3.0:1789997288.520011:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42030:x1876946704395648:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997288.520032:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997288.520098:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea18 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997288.520187:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997288.520202:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997288.520221:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997288.520258:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:3.0:1789997288.520262:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997288.520280:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997288.520303:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bd90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea18 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997288.520325:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea18 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997288.520335:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:3.0:1789997288.520338:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997288.520343:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b600, rc 0) 00000100:00100000:3.0:1789997288.520400:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42030:x1876946704395648:12345-192.168.204.4@tcp:101:rm.0 Request processed in 391us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997288.520408:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 589 00000100:00100000:3.0:1789997288.522998:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997288.523047:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704395904 00000100:00100000:3.0:1789997288.523057:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704395904 00000100:00100000:3.0:1789997288.523118:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 590 00000100:00100000:3.0:1789997288.523130:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42030:x1876946704395904:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997288.523151:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997288.523174:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592bd9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea1f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997288.523264:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:3.0:1789997288.523540:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592bd9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea1f expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997288.523556:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997288.523559:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789997288.523565:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592bd9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea1f expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997288.523582:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997288.523636:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42030:x1876946704395904:12345-192.168.204.4@tcp:101:rm.0 Request processed in 510us (645us total) trans 4294967522 rc 301/301 00000100:00100000:3.0:1789997288.523644:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 590 00000100:00100000:1.0:1789997288.530888:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997288.531931:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704396032 00000100:00100000:3.0:1789997288.531944:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704396032 00000100:00100000:3.0:1789997288.532002:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:3.0:1789997288.532012:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42030:x1876946704396032:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:1.0:1789997288.537409:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42030:x1876946704396032:12345-192.168.204.4@tcp:37:rm.0 Request processed in 5387us (6519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997288.537423:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 62 00000100:00100000:2.0:1789997288.540397:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997288.542650:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704396288 00000100:00100000:3.0:1789997288.542679:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704396288 00000100:00100000:3.0:1789997288.542754:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:3.0:1789997288.542764:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de235050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42030:x1876946704396288:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:3.0:1789997288.543208:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de235050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42030:x1876946704396288:12345-192.168.204.4@tcp:35:rm.0 Request processed in 443us (2821us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789997288.543216:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 63 00000100:00100000:3.0:1789997288.548306:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997288.548819:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704396544 00000100:00100000:2.0:1789997288.548831:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704396544 00000100:00100000:2.0:1789997288.550571:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 591 00000100:00100000:2.0:1789997288.550589:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42030:x1876946704396544:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997288.550648:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789997288.550692:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592bd97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea18 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.550715:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bd3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea03 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.550734:0:5812:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592b992) 00010000:00010000:2.0:1789997288.550739:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:2.0:1789997288.550754:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997288.550779:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.550791:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.550802:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.550861:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.550870:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.550878:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551309:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551318:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551326:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551360:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551367:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551374:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551380:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997288.551384:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551392:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551400:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:2.0:1789997288.551403:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997288.551407:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551414:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bdba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551431:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551438:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551444:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551448:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997288.551451:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551457:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551464:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997288.551467:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997288.551470:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551476:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bdac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551487:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551493:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551501:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551506:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997288.551509:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551516:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551523:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997288.551525:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997288.551528:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997288.551533:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592bdb3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997288.551638:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42030:x1876946704396544:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1053us (3341us total) trans 0 rc -13/-13 00000100:00100000:2.0:1789997288.551647:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 591 00010000:00010000:1.0:1789997289.226849:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997289.931159:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712913664:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931229:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997289.931348:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712914176:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931378:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997289.931405:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997289.931411:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712914048:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931431:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997289.931460:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712913792:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931501:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997289.931523:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712914304:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931547:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997289.931565:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997289.931571:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712913920:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931593:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997289.931627:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712913664 00000100:00100000:0.0:1789997289.931635:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712913664 00000100:00100000:0.0:1789997289.931698:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1789997289.931706:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712913664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931755:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712913664:12345-0@lo:400:kworker.0 Request processed in 49us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997289.931763:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1789997289.931792:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712914176 00000100:00100000:0.0:1789997289.931796:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712914176 00000100:00100000:0.0:1789997289.931829:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712914048 00000100:00100000:0.0:1789997289.931832:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712914048 00000100:00100000:0.0:1789997289.931855:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1789997289.931862:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712914176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931893:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712914176:12345-0@lo:400:kworker.0 Request processed in 32us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997289.931899:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1789997289.931912:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1789997289.931918:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712914048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.931944:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712914048:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997289.931949:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1789997289.931969:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712913792 00000100:00100000:0.0:1789997289.931972:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712913792 00000100:00100000:0.0:1789997289.931993:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712914304 00000100:00100000:0.0:1789997289.931996:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712914304 00000100:00100000:0.0:1789997289.932011:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712913920 00000100:00100000:0.0:1789997289.932014:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712913920 00000100:00100000:0.0:1789997289.932055:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1789997289.932062:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712913792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.932096:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712913792:12345-0@lo:400:kworker.0 Request processed in 34us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997289.932102:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1789997289.932114:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1789997289.932119:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712914304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.932144:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712914304:12345-0@lo:400:kworker.0 Request processed in 24us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997289.932149:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1789997289.932159:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1789997289.932165:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712913920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.932190:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712913920:12345-0@lo:400:kworker.0 Request processed in 25us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997289.932195:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:0.0:1789997289.932220:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997289.932224:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997289.932226:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997289.932268:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712914048:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.933385:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712913664:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.933397:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712914176:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.933435:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712913920:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.933446:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712913792:0@lo:400:kworker.0 00000100:00100000:0.0:1789997289.933457:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712914304:0@lo:400:kworker.0 00010000:00010000:3.0:1789997290.252801:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997290.907184:0:71906:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed6eb6d30 20000000:00000080:3.0:1789997290.907203:0:71906:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba1000 uarg=0000000000000000 00010000:00010000:3.0:1789997290.908804:0:71906:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997290.908825:0:71906:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997290.908919:0:71906:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997290.908940:0:71906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997290.908958:0:71906:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bd12 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997290.908965:0:71906:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997290.909007:0:71906:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bd12 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997290.909034:0:71906:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bd12 expref: 18 pid: 5804 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997290.909050:0:71906:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71906:1876946712914432:0@lo:104: 00000100:00100000:3.0:1789997290.909116:0:71906:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997290.909194:0:71906:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee4c1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789997290.909387:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712914432 00000100:00100000:1.0:1789997290.909395:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712914432 00000100:00100000:1.0:1789997290.909449:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789997290.909460:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:71906:x1876946712914432:12345-0@lo:104: 00010000:00010000:1.0:1789997290.909474:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997290.909543:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997290.909550:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:71906:x1876946712914432:12345-0@lo:104: Request processed in 93us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997290.909557:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00010000:00010000:2.0:1789997290.909588:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997290.909596:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.909604:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997290.909608:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.909621:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997290.909627:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997290.909632:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997290.909690:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.909698:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997290.909723:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.909731:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592bd12 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bd19 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997290.909748:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712914560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997290.909749:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997290.909753:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997290.909757:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997290.909804:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997290.910045:0:71906:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71906:1876946712914432:0@lo:104: 00010000:00010000:0.0:1789997290.910071:0:71906:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997290.910112:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712914560 00000100:00100000:2.0:1789997290.910117:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712914560 00010000:00010000:2.0:1789997290.910139:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bd12 expref: 19 pid: 5804 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997290.910201:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789997290.910210:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712914560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997290.910221:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997290.910226:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bd12 expref: 19 pid: 5804 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910237:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bd12 expref: 19 pid: 5804 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910251:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592bd19 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bd12 expref: 19 pid: 5804 timeout: 1629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910287:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910297:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910312:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910320:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910327:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910333:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910339:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997290.910343:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910351:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910377:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997290.910387:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997290.910431:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712914560:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997290.910438:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:0.0:1789997290.910487:0:71906:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997290.910494:0:71906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997290.910500:0:71906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052be00/0x65b43101d592bdc1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997290.910873:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712914560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997291.275397:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997291.564314:0:71954:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe40a55950 20000000:00000080:1.0:1789997291.564332:0:71954:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c7d1ec00 uarg=0000000000000000 00010000:00010000:1.0:1789997291.564546:0:71954:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997291.564561:0:71954:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997291.564573:0:71954:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997291.564593:0:71954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564609:0:71954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564620:0:71954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564626:0:71954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564634:0:71954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564640:0:71954:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564646:0:71954:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997291.564794:0:71954:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564804:0:71954:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564818:0:71954:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564831:0:71954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.564838:0:71954:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592bdc8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71954 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997291.799390:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997291.799486:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997291.799691:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704396800 00000100:00100000:0.0:1789997291.799702:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704396800 00000100:00100000:3.0:1789997291.799709:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704397056 00000100:00100000:3.0:1789997291.799716:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704397056 00000100:00100000:3.0:1789997291.799783:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 627 00000100:00100000:0.0:1789997291.799784:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1069 00000100:00100000:3.0:1789997291.799799:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704397056:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997291.799800:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704396800:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997291.799885:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704396800:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 90us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997291.799892:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1069 00000100:00080000:2.0:1789997291.800031:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997291.800037:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997291.802573:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704397056:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2769us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997291.802588:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 627 00000100:00100000:0.0:1789997291.802835:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997291.802875:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997291.802901:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704396672 00000100:00100000:0.0:1789997291.802910:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704396672 00000100:00100000:0.0:1789997291.802953:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 927 00000100:00100000:0.0:1789997291.802962:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704396672:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997291.803023:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704396672:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 62us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997291.803029:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 927 00000100:00100000:0.0:1789997291.803058:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704396928 00000100:00100000:0.0:1789997291.803062:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704396928 00000100:00100000:0.0:1789997291.803192:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 628 00000100:00100000:0.0:1789997291.803268:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704396928:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997291.803310:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704396928:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 111us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997291.803317:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 628 00000100:00080000:3.0:1789997291.804023:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997291.978917:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997291.978942:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712914688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997291.979029:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997291.979138:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712914688 00000100:00100000:0.0:1789997291.979146:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712914688 00000100:00100000:0.0:1789997291.979226:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1789997291.979245:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712914688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997291.979283:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997291.979331:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712914688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997291.979339:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00080000:1.0:1789997291.979448:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997291.979483:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712914688:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1789997291.979703:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997291.979708:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997291.979712:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997291.979744:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.979756:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.979766:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997291.979783:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8034700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712914816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997291.979814:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997291.979837:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789997291.979924:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997291.979933:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712914944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997291.979962:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997291.980114:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712914816 00000100:00100000:0.0:1789997291.980119:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712914816 00000100:00100000:0.0:1789997291.980163:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1789997291.980171:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712914816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997291.980181:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997291.980195:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bdcf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997291.980217:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bdcf expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997291.980353:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bdcf expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997291.980365:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997291.980434:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712914816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997291.980442:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1789997291.980473:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712914944 00000100:00100000:0.0:1789997291.980476:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712914944 00000100:00100000:0.0:1789997291.980513:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1789997291.980519:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712914944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997291.980541:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997291.980580:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712914944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997291.980587:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:0.0:1789997291.980619:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712914944:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997291.980896:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997291.980942:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8034700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712914816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997291.980958:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.980968:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997291.980984:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997291.980988:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997291.980996:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997292.298738:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997292.546208:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00010000:00010000:1.0:1789997293.323891:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997294.157201:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997294.157305:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704397184 00000100:00100000:3.0:1789997294.157316:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704397184 00000100:00100000:3.0:1789997294.157449:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 592 00000100:00100000:3.0:1789997294.157461:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42142:x1876946704397184:12345-192.168.204.4@tcp:101:rm.0 00000100:00080000:1.0:1789997294.157467:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997294.157491:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997294.157516:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea26 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.157584:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bde4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.157599:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.157613:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997294.157690:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997294.157695:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997294.157716:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.157740:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea26 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.157758:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bde4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea26 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.157766:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997294.157769:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997294.157772:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997294.157840:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42142:x1876946704397184:12345-192.168.204.4@tcp:101:rm.0 Request processed in 382us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997294.157847:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 592 00000100:00100000:2.0:1789997294.160902:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997294.161005:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704397312 00000100:00100000:0.0:1789997294.161014:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704397312 00000100:00100000:0.0:1789997294.161075:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 593 00000100:00100000:0.0:1789997294.161086:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42142:x1876946704397312:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997294.161104:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997294.161134:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bdeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea2d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161198:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161213:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161225:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161239:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161246:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161253:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161534:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592be00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161544:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592be00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161551:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592be00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997294.161585:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00000004:00200000:0.0:1789997294.161589:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997294.161607:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592be00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161619:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161626:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161633:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161639:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997294.161643:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161678:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161696:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:0.0:1789997294.161699:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997294.161704:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161711:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592bdf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161723:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161732:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161738:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161743:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997294.161746:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161752:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161759:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997294.161761:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997294.161764:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161834:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592bdf9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161874:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bdeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea2d expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161893:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592be00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea2d expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.161901:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9600) 00010000:00010000:0.0:1789997294.161903:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997294.161906:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997294.161970:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42142:x1876946704397312:12345-192.168.204.4@tcp:101:rm.0 Request processed in 874us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997294.161981:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 593 00000100:00100000:2.0:1789997294.166914:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997294.167300:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704397568 00000100:00100000:0.0:1789997294.167311:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704397568 00000100:00100000:0.0:1789997294.167369:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 594 00000100:00100000:0.0:1789997294.167389:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42142:x1876946704397568:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997294.167408:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997294.167428:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea34 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997294.167730:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:0.0:1789997294.167977:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea34 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.167992:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:0.0:1789997294.167995:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789997294.168000:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea34 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.168023:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997294.168158:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42142:x1876946704397568:12345-192.168.204.4@tcp:101:rm.0 Request processed in 769us (1253us total) trans 4294967524 rc 301/301 00000100:00100000:0.0:1789997294.168165:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 594 00000100:00100000:1.0:1789997294.175090:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997294.175240:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704397696 00000100:00100000:3.0:1789997294.175251:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704397696 00000100:00100000:3.0:1789997294.175312:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:3.0:1789997294.175323:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42142:x1876946704397696:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:3.0:1789997294.181378:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42142:x1876946704397696:12345-192.168.204.4@tcp:37:rm.0 Request processed in 6044us (6298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997294.181391:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 64 00000100:00100000:2.0:1789997294.187956:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997294.188609:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704397952 00000100:00100000:0.0:1789997294.188620:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704397952 00000100:00100000:0.0:1789997294.188717:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:0.0:1789997294.188728:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42142:x1876946704397952:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:0.0:1789997294.188968:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42142:x1876946704397952:12345-192.168.204.4@tcp:35:rm.0 Request processed in 232us (1197us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789997294.188975:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 65 00000100:00100000:1.0:1789997294.193035:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997294.194180:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704398208 00000100:00100000:0.0:1789997294.194191:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704398208 00000100:00100000:0.0:1789997294.194256:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 595 00000100:00100000:0.0:1789997294.194267:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42142:x1876946704398208:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789997294.194320:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997294.194347:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592be00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea2d expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.194377:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9600) 00010000:00010000:0.0:1789997294.194395:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592bde4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea26 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.194405:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:0.0:1789997294.194418:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997294.194441:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.194453:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.194463:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.194475:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.194482:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.194488:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.195990:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.196004:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.196013:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997294.197053:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 16384 00010000:00010000:0.0:1789997294.197073:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197081:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197088:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197095:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997294.197099:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197107:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197123:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997294.197126:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997294.197130:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197136:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be23 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197159:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197165:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197170:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197174:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997294.197177:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197183:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197189:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997294.197192:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997294.197194:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.197200:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be15 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997294.197223:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ef2a706 reply state 0000000097c1ca46 transno 4294967526 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997294.197232:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997294.197328:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42142:x1876946704398208:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3059us (4308us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789997294.197336:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 595 00010000:00010000:3.0:1789997294.202128:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.202147:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.202208:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.202215:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997294.202220:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.202227:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.202244:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9c00) 00010000:00010000:3.0:1789997294.202247:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997294.202252:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.202259:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592be1c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997294.241893:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997294.242644:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704398336 00000100:00100000:2.0:1789997294.242793:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704398336 00000100:00100000:2.0:1789997294.242897:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 596 00000100:00100000:2.0:1789997294.242908:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42146:x1876946704398336:12345-192.168.204.4@tcp:101:mkdir.0 00010000:00010000:2.0:1789997294.242933:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997294.242955:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592be2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea3b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.243036:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592be31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.243052:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592be31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.243062:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592be31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997294.243093:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789997294.243096:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997294.243113:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592be31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.243287:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592be2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea3b expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.243308:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592be31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea3b expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.243315:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997294.243318:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997294.243322:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997294.243389:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42146:x1876946704398336:12345-192.168.204.4@tcp:101:mkdir.0 Request processed in 484us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997294.243396:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 596 00000100:00100000:2.0:1789997294.246531:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997294.246577:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997294.246647:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704398464 00000100:00100000:3.0:1789997294.246684:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704398464 00000100:00100000:3.0:1789997294.246729:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704398720 00000100:00100000:3.0:1789997294.246732:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704398720 00000100:00100000:3.0:1789997294.246753:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 597 00000100:00100000:3.0:1789997294.246762:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2354:x1876946704398464:12345-192.168.204.4@tcp:41:mkdir.0 00000004:00000024:3.0:1789997294.246809:0:11799:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789997294.246879:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2354:x1876946704398464:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997294.246886:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 597 00000100:00100000:3.0:1789997294.246905:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 598 00000100:00100000:3.0:1789997294.246912:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42146:x1876946704398720:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:3.0:1789997294.246949:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997294.246986:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592be31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea3b expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.247015:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:3.0:1789997294.247027:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997294.247097:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.247110:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.247120:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.247313:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.247323:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.247331:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997294.251889:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00010000:3.0:1789997294.251909:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.251921:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.251929:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.251936:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997294.251941:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.251948:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.251974:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997294.251978:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997294.251983:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.251989:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592be38 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997294.253245:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000853c2986 reply state 0000000062d951c9 transno 4294967527 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997294.253262:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997294.253375:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:42146:x1876946704398720:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 6460us (6793us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789997294.253384:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 598 00010000:00010000:3.0:1789997294.255503:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.255522:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.255531:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.255542:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997294.255547:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.255556:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.255573:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997294.255576:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997294.255581:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.255589:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592be3f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997294.285878:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997294.286018:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704398848 00000100:00100000:0.0:1789997294.286029:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704398848 00000100:00100000:0.0:1789997294.286090:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 599 00000100:00100000:0.0:1789997294.286100:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42150:x1876946704398848:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:0.0:1789997294.286311:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997294.286335:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea42 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.286401:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.286415:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.286428:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997294.286534:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789997294.286539:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997294.286562:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.286589:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea42 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.286617:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea42 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.286625:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997294.286628:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997294.286631:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997294.286791:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:42150:x1876946704398848:12345-192.168.204.4@tcp:101:chown.0 Request processed in 691us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997294.286798:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 599 00000100:00100000:2.0:1789997294.290712:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997294.291004:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704398976 00000100:00100000:0.0:1789997294.291016:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704398976 00000100:00100000:0.0:1789997294.291080:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 600 00000100:00100000:0.0:1789997294.291091:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:42150:x1876946704398976:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:0.0:1789997294.291112:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997294.291145:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592be54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea49 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291224:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291240:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291250:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291264:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291271:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291276:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291418:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592be69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291427:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592be69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291434:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592be69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997294.291463:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:0.0:1789997294.291467:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997294.291493:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592be69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291504:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291511:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291517:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291527:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997294.291531:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291538:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291550:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997294.291553:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997294.291558:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291565:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592be5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291579:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291585:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291591:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291597:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997294.291600:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291605:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291622:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997294.291625:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997294.291628:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291634:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592be62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291717:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592be54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea49 expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291745:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592be69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea49 expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.291757:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9600) 00010000:00010000:0.0:1789997294.291761:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997294.291771:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997294.291831:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:42150:x1876946704398976:12345-192.168.204.4@tcp:101:chown.0 Request processed in 740us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997294.291840:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 600 00000100:00100000:1.0:1789997294.297170:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997294.297385:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704399232 00000100:00100000:3.0:1789997294.297397:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704399232 00000100:00100000:0.0:1789997294.297485:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 601 00000100:00100000:0.0:1789997294.297498:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:42150:x1876946704399232:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:0.0:1789997294.297549:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997294.297636:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592be69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea49 expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.297714:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9600) 00010000:00010000:0.0:1789997294.297727:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997294.297753:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.297767:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997294.297778:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997294.328083:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9f96a1c reply state 00000000ce040784 transno 4294967528 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997294.328164:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000100:00100000:0.0:1789997294.328164:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997294.328290:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00080000:0.0:1789997294.328586:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997294.328610:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42150:x1876946704399232:12345-192.168.204.4@tcp:36:chown.0 Request processed in 31111us (31446us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789997294.328619:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 601 00010000:00010000:3.0:1789997294.328876:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.328888:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.328897:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.329056:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997294.329061:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.329069:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.329088:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:3.0:1789997294.329091:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997294.329096:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.329103:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592be70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997294.346875:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997294.980574:0:72151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee335ab80 20000000:00000080:2.0:1789997294.980594:0:72151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c12aa400 uarg=0000000000000000 00010000:00010000:2.0:1789997294.981234:0:72151:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789997294.981268:0:72151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:2.0:1789997294.981271:0:72151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997294.981282:0:72151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592be4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea42 expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.981308:0:72151:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789997294.981325:0:72151:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997294.981339:0:72151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.981351:0:72151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bdcf expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.981359:0:72151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.981397:0:72151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bdcf expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.981409:0:72151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bdcf expref: 18 pid: 5804 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997294.981433:0:72151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb357800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72151:1876946712915072:0@lo:104: 00000100:00100000:2.0:1789997294.981495:0:72151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997294.981549:0:72151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997294.981626:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712915072 00000100:00100000:1.0:1789997294.981633:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712915072 00000100:00100000:1.0:1789997294.981708:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789997294.981718:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:72151:x1876946712915072:12345-0@lo:104: 00010000:00010000:1.0:1789997294.981731:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997294.981802:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997294.981807:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:72151:x1876946712915072:12345-0@lo:104: Request processed in 92us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997294.981817:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789997294.981831:0:72151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb357800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72151:1876946712915072:0@lo:104: 00010000:00010000:2.0:1789997294.981847:0:72151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982125:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997294.982132:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982140:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997294.982145:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982152:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997294.982157:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997294.982162:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997294.982196:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982203:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997294.982229:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982240:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592bdcf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bdd6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997294.982247:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712915200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997294.982253:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997294.982255:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997294.982256:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997294.982276:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997294.982353:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712915200 00000100:00100000:3.0:1789997294.982357:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712915200 00010000:00010000:3.0:1789997294.982379:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bdcf expref: 19 pid: 5804 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997294.982409:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789997294.982514:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712915200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997294.982527:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997294.982533:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bdcf expref: 19 pid: 5804 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982543:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bdcf expref: 19 pid: 5804 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982555:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bdd6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bdcf expref: 19 pid: 5804 timeout: 1633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982566:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982573:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982595:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.982603:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.983101:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.983494:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.983502:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997294.983506:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.983516:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.983538:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997294.983549:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997294.983777:0:72151:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.983789:0:72151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997294.983796:0:72151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592be77 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997294.987331:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712915200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997294.987332:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712915200:12345-0@lo:103:ldlm_bl.0 Request processed in 4907us (5046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997294.987350:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789997295.051378:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712915328:0@lo:400:kworker.0 00000100:00100000:1.0:1789997295.051454:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997295.051502:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712915840:0@lo:400:kworker.0 00000100:00100000:1.0:1789997295.051524:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997295.051546:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997295.051569:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712915712:0@lo:400:kworker.0 00000100:00100000:1.0:1789997295.051595:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997295.051621:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712915456:0@lo:400:kworker.0 00000100:00100000:1.0:1789997295.051644:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997295.051692:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997295.051698:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712915584:0@lo:400:kworker.0 00000100:00100000:1.0:1789997295.051720:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997295.051758:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712915712 00000100:00100000:1.0:1789997295.051767:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712915712 00000100:00100000:1.0:1789997295.051814:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712915584 00000100:00100000:1.0:1789997295.051817:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712915584 00000100:00100000:1.0:1789997295.051836:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1789997295.051845:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712915712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997295.051897:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712915712:12345-0@lo:400:kworker.0 Request processed in 53us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997295.051904:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1789997295.051922:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1789997295.051928:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712915584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997295.052121:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712915328 00000100:00100000:2.0:1789997295.052126:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712915328 00000100:00100000:2.0:1789997295.052153:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712915840 00000100:00100000:2.0:1789997295.052156:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712915840 00000100:00100000:2.0:1789997295.052175:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712915456 00000100:00100000:2.0:1789997295.052178:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712915456 00000100:00100000:2.0:1789997295.052199:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1789997295.052205:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712915328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997295.052323:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1789997295.052333:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712915840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997295.055123:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712915328:12345-0@lo:400:kworker.0 Request processed in 2908us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997295.055139:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1789997295.055177:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1789997295.055189:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712915456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997295.055259:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712915456:12345-0@lo:400:kworker.0 Request processed in 75us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997295.055265:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1789997295.055334:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712915456:0@lo:400:kworker.0 00000100:00100000:0.0:1789997295.055682:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712915840:12345-0@lo:400:kworker.0 Request processed in 3348us (4154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997295.055691:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1789997295.055915:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712915584:12345-0@lo:400:kworker.0 Request processed in 3985us (4192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997295.055923:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00080000:1.0:1789997295.056018:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997295.056025:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997295.056028:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997295.056069:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712915712:0@lo:400:kworker.0 00000100:00100000:1.0:1789997295.056082:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712915328:0@lo:400:kworker.0 00000100:00100000:1.0:1789997295.056091:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712915840:0@lo:400:kworker.0 00000100:00100000:3.0:1789997295.056185:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712915584:0@lo:400:kworker.0 00010000:00010000:0.0:1789997295.373280:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997295.583730:0:72199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc24b6600 20000000:00000080:0.0:1789997295.583749:0:72199:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c85af800 uarg=0000000000000000 00010000:00010000:0.0:1789997295.583990:0:72199:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997295.584010:0:72199:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997295.584026:0:72199:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997295.584048:0:72199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584063:0:72199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584076:0:72199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584084:0:72199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584092:0:72199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584100:0:72199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584107:0:72199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997295.584112:0:72199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584120:0:72199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584133:0:72199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584142:0:72199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997295.584154:0:72199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592be7e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997296.398688:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997296.714776:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997296.714789:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997296.714794:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997296.714843:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997296.714857:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997296.714869:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997296.714894:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712915968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997296.714983:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997296.715110:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997296.715238:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712915968 00000100:00100000:0.0:1789997296.715246:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712915968 00000100:00100000:0.0:1789997296.715305:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1789997296.715314:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712915968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997296.715327:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997296.715340:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592be85 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997296.715362:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592be85 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997296.715373:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592be85 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997296.715382:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997296.715477:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712915968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997296.715484:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1789997296.715728:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712915968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997296.715745:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997296.715759:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997296.715779:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997296.715784:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997296.715792:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997296.926202:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997296.926236:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997296.926265:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997296.926292:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997296.926323:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704399488 00000100:00100000:1.0:1789997296.926337:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704399488 00000100:00100000:1.0:1789997296.926411:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1073 00000100:00100000:1.0:1789997296.926424:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704399488:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997296.926505:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704399488:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997296.926512:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1073 00000100:00100000:1.0:1789997296.926542:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704399744 00000100:00100000:1.0:1789997296.926546:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704399744 00000100:00100000:1.0:1789997296.926947:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704399616 00000100:00100000:1.0:1789997296.926953:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704399616 00000100:00100000:1.0:1789997296.927038:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 631 00000100:00100000:1.0:1789997296.927045:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704399744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997296.927074:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704399744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997296.927079:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 631 00000100:00100000:1.0:1789997296.927092:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 632 00000100:00100000:1.0:1789997296.927098:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704399616:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997296.927119:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704399616:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 21us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997296.927124:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 632 00000100:00100000:1.0:1789997296.927679:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704399360 00000100:00100000:1.0:1789997296.927685:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704399360 00000100:00100000:1.0:1789997296.927718:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 930 00000100:00100000:1.0:1789997296.927725:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704399360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997296.927757:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704399360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997296.927763:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 930 00000100:00080000:1.0:1789997296.927793:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997296.927798:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997296.927801:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997297.101455:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997297.101477:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712916096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997297.101546:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997297.101885:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712916096 00000100:00100000:0.0:1789997297.101894:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712916096 00000100:00100000:0.0:1789997297.101958:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1789997297.101969:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712916096:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997297.101991:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997297.102000:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712916224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997297.102030:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789997297.102217:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997297.102279:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712916096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 311us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997297.102286:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1789997297.102300:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712916224 00000100:00100000:0.0:1789997297.102304:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712916224 00000100:00100000:0.0:1789997297.102319:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:0.0:1789997297.102324:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712916224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997297.102340:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997297.102564:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712916096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997297.102617:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712916224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 293us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997297.102623:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00080000:0.0:1789997297.102706:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997297.102710:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997297.106117:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712916224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789997297.418980:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997297.957955:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997297.958066:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704399872 00000100:00100000:3.0:1789997297.958078:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704399872 00000100:00100000:3.0:1789997297.958202:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 10 00000100:00100000:3.0:1789997297.958213:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:6036:x1876946704399872:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997297.958228:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997297.958231:0:8409:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592be4d) 00010000:00010000:3.0:1789997297.958233:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997297.958292:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:6036:x1876946704399872:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 81us (346us total) trans 0 rc 116/116 00000100:00100000:3.0:1789997297.958299:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 10 00010000:00010000:0.0:1789997298.443862:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997299.226484:0:72444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe926858c0 20000000:00000080:2.0:1789997299.226499:0:72444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c12ab800 uarg=0000000000000000 00010000:00010000:2.0:1789997299.226938:0:72444:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997299.226953:0:72444:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997299.226968:0:72444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997299.226985:0:72444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997299.227001:0:72444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592be85 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997299.227010:0:72444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997299.227049:0:72444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592be85 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997299.227063:0:72444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592be85 expref: 18 pid: 7594 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997299.227078:0:72444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb356300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72444:1876946712916352:0@lo:104: 00000100:00100000:2.0:1789997299.227142:0:72444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997299.227241:0:72444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c29ef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997299.227263:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712916352 00000100:00100000:1.0:1789997299.227270:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712916352 00000100:00100000:1.0:1789997299.227320:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789997299.227329:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:72444:x1876946712916352:12345-0@lo:104: 00010000:00010000:1.0:1789997299.227341:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997299.227402:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997299.227408:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:72444:x1876946712916352:12345-0@lo:104: Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997299.227414:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789997299.227507:0:72444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb356300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72444:1876946712916352:0@lo:104: 00010000:00010000:0.0:1789997299.227508:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997299.227519:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.227528:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1aa8c20) 00010000:00010000:2.0:1789997299.227530:0:72444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997299.227533:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.227552:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997299.227574:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997299.227581:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997299.227619:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.227626:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997299.227701:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997299.227703:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789997299.227713:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592be85 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592be8c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997299.227718:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712916480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997299.227739:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997299.227743:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997299.227745:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997299.227759:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997299.227828:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712916480 00000100:00100000:0.0:1789997299.227833:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712916480 00010000:00010000:0.0:1789997299.227854:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592be85 expref: 19 pid: 7594 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997299.227895:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789997299.227903:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712916480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997299.227924:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997299.227930:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592be85 expref: 19 pid: 7594 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.227940:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592be85 expref: 19 pid: 7594 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.227953:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592be8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592be85 expref: 19 pid: 7594 timeout: 1637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.227974:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.227982:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.227997:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.228004:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.228011:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.228018:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.228023:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997299.228039:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.228048:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.228069:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997299.228080:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997299.228116:0:72444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997299.228126:0:72444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997299.228127:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712916480:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997299.228144:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:3.0:1789997299.228206:0:72444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592be93 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997299.228217:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712916480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997299.466832:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997300.170925:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712916864:0@lo:400:kworker.0 00000100:00100000:2.0:1789997300.171015:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997300.171141:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712916608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997300.171167:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712916992:0@lo:400:kworker.0 00000100:00100000:2.0:1789997300.171252:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789997300.171260:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712916736:0@lo:400:kworker.0 00000100:00100000:3.0:1789997300.174226:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997300.174305:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712917120:0@lo:400:kworker.0 00000100:00100000:3.0:1789997300.174370:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997300.174540:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712916608 00000100:00100000:3.0:1789997300.174549:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712916608 00000100:00100000:3.0:1789997300.174602:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:3.0:1789997300.174613:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712916608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997300.174722:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997300.174773:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712917120 00000100:00100000:1.0:1789997300.174778:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712917120 00000100:00100000:3.0:1789997300.174787:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712916608:12345-0@lo:400:kworker.0 Request processed in 175us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997300.174796:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1789997300.174820:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712916992 00000100:00100000:1.0:1789997300.174824:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712916992 00000100:00100000:3.0:1789997300.174867:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712916608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997300.174867:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1789997300.174882:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712917120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997300.174920:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712916864 00000100:00100000:3.0:1789997300.174926:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712916864 00000100:00100000:1.0:1789997300.174930:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712917120:12345-0@lo:400:kworker.0 Request processed in 52us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997300.174939:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1789997300.174956:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1789997300.174964:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712916992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997300.174970:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:3.0:1789997300.174980:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712916864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997300.175005:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712916992:12345-0@lo:400:kworker.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997300.175012:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1789997300.175032:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712916864:12345-0@lo:400:kworker.0 Request processed in 54us (4016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997300.175041:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00080000:1.0:1789997300.175042:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997300.175049:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997300.175052:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997300.175592:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997300.175632:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712917248:0@lo:400:kworker.0 00000100:00100000:2.0:1789997300.175675:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997300.175700:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712916736 00000100:00100000:2.0:1789997300.175704:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712916736 00000100:00100000:2.0:1789997300.175733:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712917248 00000100:00100000:2.0:1789997300.175736:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712917248 00000100:00100000:2.0:1789997300.175763:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1789997300.175770:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712916736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997300.175802:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712916736:12345-0@lo:400:kworker.0 Request processed in 33us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997300.175808:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1789997300.175821:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1789997300.175827:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712917248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997300.176317:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712916992:0@lo:400:kworker.0 00000100:00100000:1.0:1789997300.176359:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712917120:0@lo:400:kworker.0 00000100:00080000:1.0:1789997300.177177:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997300.177299:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712916864:0@lo:400:kworker.0 00000100:00100000:3.0:1789997300.177324:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712916736:0@lo:400:kworker.0 00000100:00100000:2.0:1789997300.177440:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712917248:12345-0@lo:400:kworker.0 Request processed in 1611us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997300.177555:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712917248:0@lo:400:kworker.0 00000100:00100000:2.0:1789997300.177588:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 10000000:01000000:1.0:1789997300.492489:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997300.492498:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997300.492504:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997300.492552:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997300.492565:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997300.492588:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997300.492618:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712917376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997300.492713:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997300.492767:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1789997300.492779:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997300.492791:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712917376 00000100:00100000:1.0:1789997300.492811:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712917376 00000100:00100000:1.0:1789997300.492877:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:1.0:1789997300.492888:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712917376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997300.492901:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997300.492915:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592be9a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997300.492939:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592be9a expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997300.492952:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592be9a expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997300.492961:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997300.493021:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712917376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997300.493028:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:3.0:1789997300.493165:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712917376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997300.493200:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997300.493213:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997300.493237:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997300.493243:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997300.493251:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997301.516063:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997301.548258:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997301.548309:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704400000 00000100:00100000:1.0:1789997301.548334:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704400000 00000100:00100000:1.0:1789997301.548399:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 602 00000100:00100000:1.0:1789997301.548410:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42327:x1876946704400000:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997301.548430:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997301.548452:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea50 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.548515:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592beaf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.548531:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592beaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.548545:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592beaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997301.548585:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997301.548590:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997301.548611:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592beaf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.548636:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592bea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea50 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.548673:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592beaf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea50 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.548681:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997301.548684:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997301.548688:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997301.548746:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42327:x1876946704400000:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 338us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997301.548753:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 602 00000100:00080000:1.0:1789997301.548777:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997301.552131:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997301.552198:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704400128 00000100:00100000:1.0:1789997301.552207:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704400128 00000100:00100000:1.0:1789997301.552264:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 603 00000100:00100000:1.0:1789997301.552274:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42327:x1876946704400128:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997301.552295:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997301.552313:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592beb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea57 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552380:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552393:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552404:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552418:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552425:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552432:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552742:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592becb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552752:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592becb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552761:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592becb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997301.552794:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789997301.552798:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997301.552835:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592becb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552847:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552853:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552860:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.552866:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997301.552871:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553021:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553036:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997301.553039:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997301.553045:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553051:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592bebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553064:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553071:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553080:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553086:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997301.553088:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553094:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553101:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38e062d900) 00010000:00010000:1.0:1789997301.553104:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997301.553107:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553113:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bec4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553145:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592beb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea57 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553160:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592becb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea57 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997301.553167:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789997301.553169:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997301.553172:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997301.553238:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42327:x1876946704400128:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 965us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997301.553249:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 603 00000100:00100000:2.0:1789997301.560017:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997301.560162:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704400384 00000100:00100000:3.0:1789997301.560173:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704400384 00000100:00100000:3.0:1789997301.560265:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 604 00000100:00100000:3.0:1789997301.560276:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42327:x1876946704400384:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997301.560409:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997301.560435:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592becb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea57 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997301.560454:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:3.0:1789997301.560463:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997301.560486:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997301.560498:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997301.560508:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997301.589721:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000004:00010000:3.0:1789997301.589811:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001557c3e6 reply state 00000000b801e26e transno 4294967529 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997301.589840:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997301.589860:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00080000:3.0:1789997301.590277:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997301.590301:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42327:x1876946704400384:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 30022us (30289us total) trans 4294967529 rc 0/0 00000100:00100000:3.0:1789997301.590310:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 604 00010000:00010000:0.0:1789997301.590396:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997301.590410:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997301.590418:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997301.590424:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997301.590428:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997301.590435:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997301.590449:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:0.0:1789997301.590452:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997301.590457:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997301.590463:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592bed2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997302.040411:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997302.040452:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997302.040483:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997302.040506:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997302.040670:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704400512 00000100:00100000:3.0:1789997302.040681:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704400512 00000100:00100000:3.0:1789997302.040754:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 933 00000100:00100000:3.0:1789997302.040764:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704400512:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997302.040849:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704400512:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997302.040857:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 933 00000100:00100000:1.0:1789997302.041062:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704400768 00000100:00100000:1.0:1789997302.041067:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704400768 00000100:00100000:1.0:1789997302.041114:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704400896 00000100:00100000:1.0:1789997302.041117:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704400896 00000100:00100000:1.0:1789997302.041140:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 635 00000100:00100000:1.0:1789997302.041147:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704400768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997302.041194:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704400768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997302.041201:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 635 00000100:00100000:1.0:1789997302.041214:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 636 00000100:00100000:1.0:1789997302.041220:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704400896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997302.041244:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704400896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997302.041250:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 636 00000100:00100000:1.0:1789997302.041268:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704400640 00000100:00100000:1.0:1789997302.041272:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704400640 00000100:00100000:1.0:1789997302.041297:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1077 00000100:00100000:1.0:1789997302.041304:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704400640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997302.041335:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704400640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997302.041342:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1077 00000100:00080000:2.0:1789997302.041708:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997302.041713:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997302.218915:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997302.218941:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712917504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997302.219015:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997302.219122:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712917504 00000100:00100000:0.0:1789997302.219133:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712917504 00000100:00100000:0.0:1789997302.219201:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1789997302.219210:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712917504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997302.219249:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997302.219301:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712917504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997302.219308:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1789997302.219369:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712917504:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997302.219431:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997302.221457:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997302.221477:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712917632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997302.221534:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997302.221591:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712917632 00000100:00100000:3.0:1789997302.221597:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712917632 00000100:00100000:3.0:1789997302.221783:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1789997302.221793:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712917632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997302.221838:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997302.221886:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712917632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997302.221898:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00080000:3.0:1789997302.221918:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997302.221963:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712917632:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789997302.289491:0:72640:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0b58f300 20000000:00000080:3.0:1789997302.289518:0:72640:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faaf1000 uarg=0000000000000000 00010000:00010000:3.0:1789997302.291093:0:72640:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997302.291152:0:72640:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:3.0:1789997302.291158:0:72640:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997302.291172:0:72640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592beaf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea50 expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997302.291200:0:72640:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997302.291221:0:72640:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997302.291242:0:72640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997302.291259:0:72640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592be9a expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997302.291268:0:72640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997302.291395:0:72640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592be9a expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997302.291647:0:72640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592be9a expref: 18 pid: 5805 timeout: 1640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997302.291692:0:72640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72640:1876946712917760:0@lo:104: 00000100:00100000:3.0:1789997302.291787:0:72640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997302.291925:0:72640:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789997302.292038:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712917760 00000100:00100000:2.0:1789997302.292049:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712917760 00000100:00100000:2.0:1789997302.292198:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789997302.292211:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:72640:x1876946712917760:12345-0@lo:104: 00010000:00010000:2.0:1789997302.292228:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997302.292326:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997302.292333:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:72640:x1876946712917760:12345-0@lo:104: Request processed in 125us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997302.292341:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00010000:0.0:1789997302.292418:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997302.292435:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292444:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997302.292449:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292460:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997302.292469:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997302.292475:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997302.292527:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292535:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997302.292569:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292578:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592be9a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bea1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292597:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997302.292600:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997302.292602:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997302.292627:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712917888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997302.292699:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997302.292747:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712917888 00000100:00100000:0.0:1789997302.292751:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712917888 00010000:00010000:0.0:1789997302.292775:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592be9a expref: 19 pid: 5805 timeout: 1640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997302.292821:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789997302.292829:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712917888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997302.292843:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997302.292850:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592be9a expref: 19 pid: 5805 timeout: 1640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292875:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592be9a expref: 19 pid: 5805 timeout: 1640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292894:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292904:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292922:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292931:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292938:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292946:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292952:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997302.292956:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292969:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292981:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997302.292994:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997302.293038:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712917888:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997302.293045:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:3.0:1789997302.293170:0:72640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592bea1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592be9a expref: 18 pid: 5805 timeout: 1640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997302.293186:0:72640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72640:1876946712917760:0@lo:104: 00010000:00010000:3.0:1789997302.293208:0:72640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997302.293216:0:72640:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997302.293223:0:72640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997302.293230:0:72640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b200/0x65b43101d592bed9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997302.293231:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712917888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997302.538836:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997303.562904:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997303.631817:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997303.631829:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997303.631834:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997303.632036:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997303.632049:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997303.632061:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997303.632091:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712918016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997303.632179:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997303.632248:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b510c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997303.632357:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712918016 00000100:00100000:1.0:1789997303.632365:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712918016 00000100:00100000:1.0:1789997303.632487:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:1.0:1789997303.632499:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712918016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997303.632514:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997303.632530:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bee0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997303.632555:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bee0 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997303.632567:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bee0 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997303.632576:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997303.632627:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712918016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997303.632635:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:0.0:1789997303.632806:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712918016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997303.632825:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997303.632835:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997303.633138:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997303.633145:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997303.633153:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997304.586872:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997304.705083:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997304.705179:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704401024 00000100:00100000:3.0:1789997304.705190:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704401024 00000100:00100000:3.0:1789997304.705282:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 605 00000100:00100000:3.0:1789997304.705292:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42404:x1876946704401024:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997304.705325:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997304.705349:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592beee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea5e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705414:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705433:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705445:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705459:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705465:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705471:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705804:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592bf03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705813:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592bf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705833:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592bf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997304.705857:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789997304.705861:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997304.705880:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592bf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705891:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705901:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705908:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705915:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.705919:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705927:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705939:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e700) 00010000:00010000:3.0:1789997304.705942:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997304.705947:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705964:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.705975:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789997304.706189:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997304.709340:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.709363:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.709370:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.709375:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.709385:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.709402:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997304.709406:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997304.709411:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.709417:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592befc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.709476:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592beee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea5e expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.709495:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592bf03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea5e expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.709502:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997304.709505:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997304.709507:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ba00, rc 0) 00000100:00100000:3.0:1789997304.709596:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42404:x1876946704401024:12345-192.168.204.4@tcp:101:touch.0 Request processed in 4304us (4522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997304.709606:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 605 00000100:00100000:0.0:1789997304.716224:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997304.716418:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704401280 00000100:00100000:3.0:1789997304.716432:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704401280 00000100:00100000:3.0:1789997304.716502:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 606 00000100:00100000:3.0:1789997304.716513:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42404:x1876946704401280:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997304.716535:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997304.716556:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea65 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.716895:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.716912:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.716925:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.716939:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.716945:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.716963:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997304.718638:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:3.0:1789997304.720642:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720679:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720693:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720742:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720750:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720770:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720776:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.720781:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720789:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720803:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997304.720806:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997304.720811:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720829:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997304.720843:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073208abe reply state 00000000ac77a28e transno 4294967530 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997304.720852:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997304.720890:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea65 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720912:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea65 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.720919:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997304.720922:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997304.720924:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:3.0:1789997304.722925:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42404:x1876946704401280:12345-192.168.204.4@tcp:101:touch.0 Request processed in 6405us (6702us total) trans 4294967530 rc 0/0 00000100:00100000:3.0:1789997304.722938:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 606 00000100:00100000:1.0:1789997304.730206:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:0.0:1789997304.730363:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.730376:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.730384:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.730389:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997304.730394:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.730402:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.730418:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38ee49ec00) 00010000:00010000:0.0:1789997304.730421:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997304.730426:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.730433:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997304.731168:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704401536 00000100:00100000:3.0:1789997304.731180:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704401536 00000100:00100000:3.0:1789997304.731241:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 607 00000100:00100000:3.0:1789997304.731253:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42404:x1876946704401536:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:3.0:1789997304.731312:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997304.731344:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea65 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.731358:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997304.731366:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997304.731407:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.731419:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.731428:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997304.731564:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000124f486a reply state 000000000b65c26e transno 4294967531 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997304.731573:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997304.731698:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42404:x1876946704401536:12345-192.168.204.4@tcp:36:touch.0 Request processed in 447us (1499us total) trans 4294967531 rc 0/0 00000100:00100000:3.0:1789997304.731705:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 607 00010000:00010000:3.0:1789997304.735895:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.735913:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.735922:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.735929:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.735934:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.735942:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.735957:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8a38ee49e700) 00010000:00010000:3.0:1789997304.735960:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997304.735966:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.735973:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997304.739498:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997304.741115:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704401664 00000100:00100000:2.0:1789997304.741130:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704401664 00000100:00100000:2.0:1789997304.741198:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 608 00000100:00100000:2.0:1789997304.741209:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42404:x1876946704401664:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997304.741374:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997304.741398:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bf34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea6c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997304.741460:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bf34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea6c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997304.741475:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bf34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea6c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997304.741493:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:2.0:1789997304.741496:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997304.741500:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997304.741576:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42404:x1876946704401664:12345-192.168.204.4@tcp:101:touch.0 Request processed in 368us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997304.741583:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 608 00000100:00100000:2.0:1789997304.745443:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997304.748851:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704401792 00000100:00100000:3.0:1789997304.748866:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704401792 00000100:00100000:3.0:1789997304.751159:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 313 00000100:00100000:3.0:1789997304.751176:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704401792:12345-192.168.204.4@tcp:2:touch.0 00000100:00100000:3.0:1789997304.751883:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704401792:12345-192.168.204.4@tcp:2:touch.0 Request processed in 709us (6448us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789997304.751893:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 313 00000100:00080000:0.0:1789997304.755391:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997304.757752:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997304.757871:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704402048 00000100:00100000:3.0:1789997304.757881:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704402048 00000100:00100000:3.0:1789997304.757939:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:3.0:1789997304.758050:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42404:x1876946704402048:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:3.0:1789997304.759046:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:42404:x1876946704402048:12345-192.168.204.4@tcp:35:touch.0 Request processed in 1094us (1299us total) trans 4294967532 rc 0/0 00000100:00100000:3.0:1789997304.759056:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 66 00000100:00100000:1.0:1789997304.838082:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997304.838172:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704402176 00000100:00100000:3.0:1789997304.838183:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704402176 00000100:00100000:3.0:1789997304.838240:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 609 00000100:00100000:3.0:1789997304.838250:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:42408:x1876946704402176:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997304.838278:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997304.838299:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea73 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838363:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838378:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838390:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838406:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838412:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838419:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838503:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bf50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838511:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838517:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997304.838547:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x32:0x0]: returning size 0 00000004:00200000:3.0:1789997304.838551:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997304.838570:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838581:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838588:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838597:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838603:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838608:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.838612:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838619:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838631:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997304.838634:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997304.838639:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838645:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592bf42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838701:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838707:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838712:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838717:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.838721:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838726:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838733:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38ee49e700) 00010000:00010000:3.0:1789997304.838736:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997304.838738:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838744:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bf49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838783:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bf3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea73 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838796:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bf50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea73 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.838804:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:3.0:1789997304.838806:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997304.838808:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997304.838862:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:42408:x1876946704402176:12345-192.168.204.4@tcp:101:rm.0 Request processed in 614us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997304.838869:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 609 00000100:00100000:3.0:1789997304.842523:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997304.842619:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704402304 00000100:00100000:1.0:1789997304.842631:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704402304 00000100:00100000:1.0:1789997304.842720:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 314 00000100:00100000:1.0:1789997304.842730:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704402304:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997304.842749:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997304.842784:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea7a expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997304.842817:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x6ab130f8, atime: 0x6ab130f8, ctime: 0x6ab130f8, blocks: 0x1 00010000:00010000:1.0:1789997304.842837:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=1493s v=(0 0) 00010000:00010000:1.0:1789997304.842841:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997304.842851:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997304.842869:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997304.842881:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997304.842947:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704402304:12345-192.168.204.4@tcp:101:rm.0 Request processed in 218us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997304.842962:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 314 00000100:00100000:0.0:1789997304.847149:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997304.847235:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704402560 00000100:00100000:3.0:1789997304.847246:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704402560 00000100:00100000:3.0:1789997304.847304:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 610 00000100:00100000:3.0:1789997304.847315:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:42408:x1876946704402560:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997304.847376:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997304.847404:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bf50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea73 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847427:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592bf34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea6c expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847438:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:3.0:1789997304.847448:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997304.847469:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847483:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847493:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847507:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847514:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847521:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847617:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847629:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.847636:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997304.848415:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 64 off9408 00000004:00080000:3.0:1789997304.848429:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1493540774229ns, next at 1494540771240ns, rc = 0 00010000:00010000:3.0:1789997304.848494:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848506:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848514:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848522:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848528:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848535:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848552:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997304.848576:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848582:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848589:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848596:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.848601:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848608:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848620:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997304.848623:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997304.848627:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.848633:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bf6c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x32:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.849141:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997304.849149:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.849156:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997304.849159:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.849167:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.849177:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x32:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:0.0:1789997304.849180:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997304.849183:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.849193:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592bf73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x32:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997304.849212:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997304.849214:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997304.849216:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997304.849784:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.849794:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.849800:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.849805:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.849809:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.849821:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.849833:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997304.849835:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997304.849839:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.849846:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592bf5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997304.849860:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008245f545 reply state 0000000039e4d562 transno 4294967533 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997304.849868:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997304.849977:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:42408:x1876946704402560:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2661us (2836us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1789997304.849987:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 610 00010000:00010000:3.0:1789997304.855554:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.855574:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.855583:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.855589:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997304.855593:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.855604:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.855620:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997304.855623:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997304.855628:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997304.855634:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592bf65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997305.292805:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712918144:0@lo:400:kworker.0 00000100:00100000:2.0:1789997305.292886:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997305.292904:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712918400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997305.292937:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712918656:0@lo:400:kworker.0 00000100:00100000:3.0:1789997305.292951:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997305.293048:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997305.293074:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789997305.293080:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712918272:0@lo:400:kworker.0 00000100:00100000:2.0:1789997305.293100:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997305.293115:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712918784:0@lo:400:kworker.0 00000100:00100000:2.0:1789997305.293145:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997305.293179:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712918144 00000100:00100000:2.0:1789997305.293187:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712918144 00000100:00100000:2.0:1789997305.293236:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1789997305.293244:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712918144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997305.293276:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997305.293285:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712918528:0@lo:400:kworker.0 00000100:00100000:2.0:1789997305.293296:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712918144:12345-0@lo:400:kworker.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997305.293304:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:3.0:1789997305.293320:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997305.293337:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712918400 00000100:00100000:2.0:1789997305.293342:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712918400 00000100:00100000:3.0:1789997305.293434:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712918272 00000100:00100000:3.0:1789997305.293439:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712918272 00000100:00100000:3.0:1789997305.293475:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712918784 00000100:00100000:3.0:1789997305.293478:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712918784 00000100:00100000:2.0:1789997305.293604:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1789997305.293611:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712918272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997305.293645:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712918272:12345-0@lo:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997305.293651:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1789997305.293684:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1789997305.293690:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712918400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997305.293724:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712918400:12345-0@lo:400:kworker.0 Request processed in 35us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997305.293740:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1789997305.293795:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712918272:0@lo:400:kworker.0 00000100:00100000:2.0:1789997305.293804:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712918144:0@lo:400:kworker.0 00000100:00100000:1.0:1789997305.295647:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712918656 00000100:00100000:1.0:1789997305.295679:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712918656 00000100:00080000:0.0:1789997305.296846:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997305.296855:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997305.297501:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:3.0:1789997305.297641:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712918784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997305.297677:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712918528 00000100:00100000:1.0:1789997305.297685:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712918528 00000100:00100000:1.0:1789997305.297716:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1789997305.297778:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712918784:12345-0@lo:400:kworker.0 Request processed in 144us (4631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997305.297786:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1789997305.298167:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712918656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997305.298213:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712918656:12345-0@lo:400:kworker.0 Request processed in 491us (5165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997305.298220:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:1.0:1789997305.298235:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:1.0:1789997305.298242:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712918528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997305.298279:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712918528:12345-0@lo:400:kworker.0 Request processed in 39us (4960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997305.298287:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1789997305.298317:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712918528:0@lo:400:kworker.0 00000100:00100000:3.0:1789997305.298334:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712918400:0@lo:400:kworker.0 00000100:00100000:3.0:1789997305.298459:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712918784:0@lo:400:kworker.0 00000100:00100000:3.0:1789997305.298471:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712918656:0@lo:400:kworker.0 00000100:00080000:0.0:1789997305.298719:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997305.612214:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997305.842563:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000020:00000080:2.0:1789997306.261938:0:72885:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfa13aa10 20000000:00000080:2.0:1789997306.262029:0:72885:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fad5d800 uarg=0000000000000000 00010000:00010000:2.0:1789997306.262268:0:72885:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789997306.262303:0:72885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:2.0:1789997306.262307:0:72885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997306.262318:0:72885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592bf03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea5e expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997306.262340:0:72885:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789997306.262356:0:72885:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997306.262369:0:72885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997306.262383:0:72885:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bee0 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997306.262390:0:72885:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997306.262428:0:72885:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bee0 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997306.262442:0:72885:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bee0 expref: 18 pid: 5804 timeout: 1644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997306.262456:0:72885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72885:1876946712918912:0@lo:104: 00000100:00100000:2.0:1789997306.262520:0:72885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997306.262641:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789997306.262675:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712918912 00000100:00100000:2.0:1789997306.262677:0:72885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789997306.262682:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712918912 00000100:00100000:1.0:1789997306.262737:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789997306.262747:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:72885:x1876946712918912:12345-0@lo:104: 00010000:00010000:1.0:1789997306.262759:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.262823:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997306.262829:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b17450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:72885:x1876946712918912:12345-0@lo:104: Request processed in 85us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997306.262836:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789997306.262899:0:72885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72885:1876946712918912:0@lo:104: 00010000:00010000:0.0:1789997306.262905:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997306.262914:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997306.262919:0:72885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.262923:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997306.262930:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.262947:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997306.263235:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997306.263241:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997306.263279:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.263287:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997306.263311:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997306.263321:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712919040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997306.263330:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592bee0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bee7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.263347:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997306.263349:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997306.263352:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997306.263363:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997306.263787:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712919040 00000100:00100000:1.0:1789997306.263792:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712919040 00010000:00010000:1.0:1789997306.263816:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bee0 expref: 19 pid: 5804 timeout: 1644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997306.263846:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789997306.263950:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712919040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997306.264080:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997306.264085:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bee0 expref: 19 pid: 5804 timeout: 1644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264096:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bee0 expref: 19 pid: 5804 timeout: 1644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264113:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592bee7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bee0 expref: 19 pid: 5804 timeout: 1644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264127:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264135:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264154:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264162:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264168:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264175:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264180:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997306.264184:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264190:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264212:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.264226:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997306.264277:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712919040:12345-0@lo:103:ldlm_bl.0 Request processed in 424us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997306.264284:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00010000:2.0:1789997306.264388:0:72885:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997306.264398:0:72885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997306.264405:0:72885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592bf7a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997306.264596:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712919040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997306.635058:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997306.868401:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967533 is committed 00000004:00080000:0.0:1789997306.868412:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 54 committed 00000100:00100000:1.0:1789997306.868602:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712919168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997306.868702:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997306.868742:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712919168 00000100:00100000:3.0:1789997306.868751:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712919168 00000100:00100000:3.0:1789997306.868817:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789997306.869513:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712919168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789997306.869546:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:19 count 1 00010000:00010000:3.0:1789997306.869574:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997306.869598:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997306.869607:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789997306.869612:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997306.869617:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997306.869649:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997306.870622:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 5 pid: 8169 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997306.870641:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712919296:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997306.871578:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae10840 going to sleep for 11 seconds 00000100:00100000:3.0:1789997306.880176:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712919296:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997306.880207:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997306.881513:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997306.881596:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704402688 00000100:00100000:1.0:1789997306.881604:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704402688 00010000:00010000:1.0:1789997306.881687:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 6 pid: 8169 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997306.881736:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 327 00000100:00100000:1.0:1789997306.881748:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704402688:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997306.881768:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997306.881774:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 6 pid: 8169 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.881790:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 6 pid: 8169 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.881815:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592bf57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea7a expref: 6 pid: 8169 timeout: 1595 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.881923:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997306.881929:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997306.881936:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.881946:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997306.881973:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997306.882025:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704402688:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 279us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997306.882033:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 327 00000100:00080000:0.0:1789997306.882174:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789997306.882360:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997306.882371:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997306.882381:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997306.882390:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997306.882414:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997306.882931:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997306.882940:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.882949:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997306.882953:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.882963:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.882977:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.882984:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592bf81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997306.883016:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997306.883018:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997306.883020:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997306.883420:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712919168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14591us (14716us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789997306.883431:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000004:00080000:1.0:1789997306.883817:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c6adfb80/2, rc 0, transno 4294967335 00000100:00100000:1.0:1789997306.883825:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712919168:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997307.162856:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997307.162909:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997307.162952:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997307.162995:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997307.163036:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704402944 00000100:00100000:3.0:1789997307.163046:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704402944 00000100:00100000:3.0:1789997307.163123:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1081 00000100:00100000:3.0:1789997307.163135:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704402944:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997307.163215:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704402944:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997307.163222:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1081 00000100:00100000:3.0:1789997307.163248:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704403072 00000100:00100000:3.0:1789997307.163252:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704403072 00000100:00100000:3.0:1789997307.163277:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704403200 00000100:00100000:3.0:1789997307.163279:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704403200 00000100:00100000:3.0:1789997307.163297:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 639 00000100:00100000:3.0:1789997307.163303:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704403072:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997307.163327:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704403072:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997307.163333:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 639 00000100:00100000:3.0:1789997307.163345:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 640 00000100:00100000:3.0:1789997307.163350:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704403200:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997307.163370:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704403200:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 20us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997307.163375:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 640 00000100:00080000:1.0:1789997307.163689:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997307.163694:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997307.164393:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704402816 00000100:00100000:2.0:1789997307.164402:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704402816 00000100:00100000:2.0:1789997307.164454:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 936 00000100:00100000:2.0:1789997307.164466:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704402816:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997307.164530:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704402816:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 68us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997307.164537:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 936 00000100:00100000:0.0:1789997307.338858:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712919552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997307.338897:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712919424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997307.338935:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997307.342012:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997307.342165:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712919552 00000100:00100000:1.0:1789997307.342175:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712919552 00000100:00100000:1.0:1789997307.342308:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712919424 00000100:00100000:1.0:1789997307.342312:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712919424 00000100:00100000:1.0:1789997307.342332:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1789997307.342342:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712919552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997307.342382:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997307.342430:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712919552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (3496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997307.342437:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1789997307.342455:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1789997307.342462:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712919424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997307.342481:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997307.342517:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712919424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997307.342524:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1789997307.342565:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712919424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997307.342729:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997307.342734:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997307.345538:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712919552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997307.659844:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997307.725467:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997307.725474:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997307.725479:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997307.725523:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997307.725536:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997307.725551:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997307.725579:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712919680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997307.725674:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997307.725737:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa7b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789997307.725810:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712919680 00000100:00100000:2.0:1789997307.725819:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712919680 00000100:00100000:2.0:1789997307.725869:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1789997307.725880:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712919680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997307.725893:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997307.725907:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bf88 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997307.725949:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bf88 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997307.725960:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bf88 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997307.725969:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3200, rc 0) 00000100:00100000:2.0:1789997307.726023:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712919680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997307.726029:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:0.0:1789997307.726172:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712919680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997307.726186:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997307.726194:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997307.726211:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997307.726215:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997307.726222:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997308.560292:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997308.560393:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704403328 00000100:00100000:2.0:1789997308.560403:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704403328 00000100:00100000:2.0:1789997308.560501:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 611 00000100:00100000:2.0:1789997308.560513:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42496:x1876946704403328:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997308.560532:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997308.560555:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bf96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea81 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.560619:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bf9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.560633:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.560647:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997308.560726:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:2.0:1789997308.560731:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997308.560750:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bf9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.560785:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592bf96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea81 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.560806:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bf9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea81 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.560815:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997308.560817:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997308.560821:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997308.560878:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42496:x1876946704403328:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 367us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997308.560885:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 611 00000100:00100000:1.0:1789997308.566377:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997308.566474:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704403584 00000100:00100000:2.0:1789997308.566485:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704403584 00000100:00100000:2.0:1789997308.566578:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 612 00000100:00100000:2.0:1789997308.566590:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42496:x1876946704403584:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997308.566645:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997308.566706:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592bf9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea81 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.566722:0:11799:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592bf03) 00010000:00010000:2.0:1789997308.566727:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997308.566737:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997308.566761:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.566790:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997308.566801:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997308.623987:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042728664 reply state 00000000f81792f4 transno 4294967534 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997308.624007:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997308.624025:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000100:00100000:3.0:1789997308.624203:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42496:x1876946704403584:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 57610us (57829us total) trans 4294967534 rc 0/0 00000100:00100000:3.0:1789997308.624214:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 612 00000001:00080000:0.0:1789997308.624447:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967534 is committed 00010000:00010000:3.0:1789997308.624727:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997308.624738:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997308.624748:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997308.624754:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997308.624759:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997308.624880:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997308.624897:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:3.0:1789997308.624900:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997308.625014:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997308.625022:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592bfa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997308.683273:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997309.159448:0:73083:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf4a52450 20000000:00000080:0.0:1789997309.159466:0:73083:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa5c00 uarg=0000000000000000 00010000:00010000:0.0:1789997309.160258:0:73083:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997309.160274:0:73083:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997309.160288:0:73083:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997309.160305:0:73083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997309.160321:0:73083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bf88 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997309.160328:0:73083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997309.160363:0:73083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bf88 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997309.160376:0:73083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bf88 expref: 18 pid: 5803 timeout: 1647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997309.160394:0:73083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73083:1876946712919808:0@lo:104: 00000100:00100000:0.0:1789997309.160452:0:73083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997309.160551:0:73083:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60840 going to sleep for 11 seconds 00000100:00100000:1.0:1789997309.160815:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712919808 00000100:00100000:1.0:1789997309.160822:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712919808 00000100:00100000:1.0:1789997309.160871:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789997309.160880:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:73083:x1876946712919808:12345-0@lo:104: 00010000:00010000:1.0:1789997309.160892:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997309.160947:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997309.160953:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:73083:x1876946712919808:12345-0@lo:104: Request processed in 74us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997309.160959:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789997309.161110:0:73083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73083:1876946712919808:0@lo:104: 00010000:00010000:0.0:1789997309.161127:0:73083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161187:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997309.161195:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161201:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997309.161204:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161212:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997309.161219:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997309.161224:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997309.161288:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161295:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997309.161326:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161333:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592bf88 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bf8f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161349:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997309.161350:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997309.161352:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997309.161391:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997309.161404:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712919936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997309.161439:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997309.161515:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712919936 00000100:00100000:3.0:1789997309.161519:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712919936 00010000:00010000:3.0:1789997309.161541:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bf88 expref: 19 pid: 5803 timeout: 1647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997309.161581:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789997309.161588:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712919936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997309.161597:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997309.161602:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bf88 expref: 19 pid: 5803 timeout: 1647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161611:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bf88 expref: 19 pid: 5803 timeout: 1647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161624:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592bf8f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bf88 expref: 19 pid: 5803 timeout: 1647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161636:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161643:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161685:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161693:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161700:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161707:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161713:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997309.161717:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161724:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161742:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997309.161752:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997309.161787:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712919936:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997309.161793:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789997309.161953:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712919936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997309.162097:0:73083:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997309.162108:0:73083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997309.162114:0:73083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592bfab lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997309.710042:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997310.412408:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712920064:0@lo:400:kworker.0 00000100:00100000:2.0:1789997310.412496:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997310.412712:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712920064 00000100:00100000:1.0:1789997310.412720:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712920064 00000100:00100000:1.0:1789997310.412770:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1789997310.412781:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712920064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997310.413822:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712920320:0@lo:400:kworker.0 00000100:00100000:0.0:1789997310.413869:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997310.413908:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997310.413915:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712920192:0@lo:400:kworker.0 00000100:00100000:0.0:1789997310.413936:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997310.414548:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712920320 00000100:00100000:3.0:1789997310.414555:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712920320 00000100:00100000:3.0:1789997310.414608:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712920192 00000100:00100000:3.0:1789997310.414611:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712920192 00000100:00100000:3.0:1789997310.414675:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1789997310.414686:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712920320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997310.414745:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712920320:12345-0@lo:400:kworker.0 Request processed in 62us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997310.414752:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1789997310.414771:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1789997310.414777:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712920192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997310.414827:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712920192:12345-0@lo:400:kworker.0 Request processed in 50us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997310.414833:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1789997310.414891:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712920192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997310.414904:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712920320:0@lo:400:kworker.0 00000100:00100000:3.0:1789997310.414921:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997310.414937:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712920704:0@lo:400:kworker.0 00000100:00100000:3.0:1789997310.414968:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789997310.415006:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997310.415016:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712920704 00000100:00100000:3.0:1789997310.415020:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712920704 00000100:00100000:3.0:1789997310.415056:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1789997310.415062:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712920704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997310.415098:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712920704:12345-0@lo:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997310.415103:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00080000:3.0:1789997310.415136:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997310.415156:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712920704:0@lo:400:kworker.0 00000100:00100000:2.0:1789997310.415804:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712920064:0@lo:400:kworker.0 00000100:00100000:2.0:1789997310.415838:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712920576:0@lo:400:kworker.0 00000100:00100000:1.0:1789997310.417746:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712920064:12345-0@lo:400:kworker.0 Request processed in 4959us (5242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997310.417763:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1789997310.417830:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712920448:0@lo:400:kworker.0 00000100:00100000:1.0:1789997310.417890:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997310.418561:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712920448 00000100:00100000:3.0:1789997310.418570:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712920448 00000100:00100000:3.0:1789997310.418671:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1789997310.418684:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712920448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997310.418703:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997310.418754:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712920448:12345-0@lo:400:kworker.0 Request processed in 73us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997310.418761:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:2.0:1789997310.418765:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712920576 00000100:00100000:2.0:1789997310.418771:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712920576 00000100:00100000:2.0:1789997310.418813:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1789997310.418822:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712920576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997310.418860:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7417050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712920576:12345-0@lo:400:kworker.0 Request processed in 40us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997310.418867:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1789997310.419037:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712920576:0@lo:400:kworker.0 00000100:00080000:1.0:1789997310.419095:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997310.419100:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997310.419134:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712920448:0@lo:400:kworker.0 00010000:00010000:0.0:1789997310.731548:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997310.794793:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997310.794801:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997310.794805:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997310.794850:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997310.795250:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997310.795262:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997310.795287:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712920832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997310.795367:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997310.795426:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c12ed600 going to sleep for 11 seconds 00000100:00100000:3.0:1789997310.795565:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712920832 00000100:00100000:3.0:1789997310.795573:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712920832 00000100:00100000:3.0:1789997310.795624:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:3.0:1789997310.795634:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712920832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997310.795671:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997310.795696:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592bfb2 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997310.795720:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997310.795732:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997310.795741:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ac00, rc 0) 00000100:00100000:3.0:1789997310.795784:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712920832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997310.795791:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1789997310.795811:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712920832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997310.795828:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997310.795837:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997310.795855:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997310.795860:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997310.795867:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997310.977234:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00000100:00100000:1.0:1789997311.596447:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997311.596747:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704403712 00000100:00100000:3.0:1789997311.596757:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704403712 00000100:00100000:3.0:1789997311.596913:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 613 00000100:00100000:3.0:1789997311.596926:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42572:x1876946704403712:12345-192.168.204.4@tcp:101:touch.0 00000100:00080000:1.0:1789997311.596972:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997311.597008:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997311.597030:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bfc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea88 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597095:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597108:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597122:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597134:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597141:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597148:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597432:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bfd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597442:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597449:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997311.597470:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789997311.597473:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997311.597493:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bfd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597505:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597512:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597518:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597523:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997311.597526:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597533:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597545:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:3.0:1789997311.597548:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997311.597552:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597558:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592bfc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597568:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597573:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597578:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597582:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997311.597585:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597590:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597596:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997311.597599:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997311.597601:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597606:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592bfce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597650:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592bfc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea88 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597688:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bfd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea88 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.597695:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997311.597697:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997311.597700:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997311.597759:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42572:x1876946704403712:12345-192.168.204.4@tcp:101:touch.0 Request processed in 837us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997311.597767:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 613 00000100:00100000:3.0:1789997311.602139:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997311.602195:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704403968 00000100:00100000:1.0:1789997311.602206:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704403968 00000100:00100000:1.0:1789997311.602265:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 614 00000100:00100000:1.0:1789997311.602276:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42572:x1876946704403968:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997311.602297:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997311.602319:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bfdc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea8f expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602408:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602429:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602440:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602453:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602460:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602466:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997311.602478:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00010000:1.0:1789997311.602497:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602504:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602511:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602518:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997311.602522:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602529:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602547:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997311.602550:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997311.602555:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602561:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592bfe3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602572:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602578:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602584:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602589:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997311.602592:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602597:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602604:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38e062d900) 00010000:00010000:1.0:1789997311.602607:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997311.602610:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602616:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592bfea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602688:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bfdc lrc: 1/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea8f expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602699:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997311.602702:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997311.602705:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592bfdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea8f expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997311.602715:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:1.0:1789997311.602785:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42572:x1876946704403968:12345-192.168.204.4@tcp:101:touch.0 Request processed in 510us (654us total) trans 0 rc 301/301 00000100:00100000:1.0:1789997311.602793:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 614 00000100:00100000:3.0:1789997311.606639:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997311.606783:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704404096 00000100:00100000:0.0:1789997311.606805:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704404096 00000100:00100000:0.0:1789997311.606863:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 615 00000100:00100000:0.0:1789997311.606875:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42572:x1876946704404096:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997311.606893:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997311.606912:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea96 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.606977:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.606992:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607004:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607019:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607026:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607033:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607054:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607072:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607084:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607091:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997311.607095:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607102:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607113:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:0.0:1789997311.607115:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997311.607119:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607126:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592bff8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607144:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607150:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607156:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607161:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997311.607164:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607174:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607182:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38c28e9800) 00010000:00010000:0.0:1789997311.607185:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997311.607187:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607194:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592bfff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607230:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bff1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea96 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607239:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:0.0:1789997311.607242:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997311.607245:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592bff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea96 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997311.607255:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997311.607327:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42572:x1876946704404096:12345-192.168.204.4@tcp:101:touch.0 Request processed in 455us (706us total) trans 0 rc 301/301 00000100:00100000:0.0:1789997311.607334:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 615 00000100:00100000:2.0:1789997311.615349:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997311.615446:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704404224 00000100:00100000:3.0:1789997311.615456:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704404224 00000100:00100000:3.0:1789997311.615522:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 616 00000100:00100000:3.0:1789997311.615533:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42572:x1876946704404224:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997311.615554:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997311.615574:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaea9d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615687:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615704:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615720:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615734:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615741:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615748:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615771:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615778:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615784:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615790:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997311.615795:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.615802:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617488:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997311.617492:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997311.617500:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617509:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c00d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617530:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617537:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617544:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617549:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997311.617553:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617560:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617568:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38ee49e200) 00010000:00010000:3.0:1789997311.617570:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997311.617573:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617578:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617635:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c006 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea9d expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617667:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997311.617669:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997311.617674:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea9d expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997311.617683:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997311.617753:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42572:x1876946704404224:12345-192.168.204.4@tcp:101:touch.0 Request processed in 2221us (2416us total) trans 0 rc 301/301 00000100:00100000:3.0:1789997311.617760:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 616 00010000:00010000:3.0:1789997311.754775:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997312.286500:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997312.286549:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997312.286630:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704404480 00000100:00100000:0.0:1789997312.286642:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704404480 00000100:00100000:1.0:1789997312.286684:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704404352 00000100:00100000:1.0:1789997312.286691:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704404352 00000100:00100000:0.0:1789997312.286726:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1085 00000100:00100000:1.0:1789997312.286732:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 940 00000100:00100000:0.0:1789997312.286741:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704404480:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997312.286743:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704404352:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997312.286829:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704404480:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 93us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997312.286837:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1085 00000100:00100000:1.0:1789997312.286883:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704404352:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 142us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997312.286891:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 940 00000100:00100000:1.0:1789997312.301445:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997312.301485:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997312.301518:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704404608 00000100:00100000:1.0:1789997312.301530:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704404608 00000100:00100000:1.0:1789997312.301621:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704404736 00000100:00100000:1.0:1789997312.301626:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704404736 00000100:00100000:1.0:1789997312.301691:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 643 00000100:00100000:1.0:1789997312.301703:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704404736:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997312.301784:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704404736:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997312.301792:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 643 00000100:00100000:1.0:1789997312.301812:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 316 00000100:00100000:1.0:1789997312.301819:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704404608:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:1.0:1789997312.301838:0:8169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592bd20 00000100:00080000:1.0:1789997312.301848:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38fd73e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789997312.301888:0:8169:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967333 00000100:00100000:1.0:1789997312.302131:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704404608:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 312us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997312.302139:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 316 00010000:00010000:1.0:1789997312.302166:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789997312.303035:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997312.303042:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997312.461013:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997312.461040:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997312.461115:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997312.461185:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712920960 00000100:00100000:1.0:1789997312.461192:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712920960 00000100:00100000:1.0:1789997312.461248:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1789997312.461256:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712920960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997312.461300:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997312.461342:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712920960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997312.461349:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00080000:1.0:1789997312.461369:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997312.461394:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:1.0:1789997312.461399:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c6adfb80, transno 4294967335 00000100:00100000:1.0:1789997312.461415:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997312.464793:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712921088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997312.464871:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997312.464972:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712921088 00000100:00100000:3.0:1789997312.464982:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712921088 00000100:00100000:3.0:1789997312.465043:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1789997312.465053:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712921088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997312.465088:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997312.465145:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712921088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997312.465152:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:3.0:1789997312.465197:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712921088:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997312.465253:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997312.780467:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997312.889558:0:73329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6b388560 20000000:00000080:3.0:1789997312.889576:0:73329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba2000 uarg=0000000000000000 00010000:00010000:3.0:1789997312.889880:0:73329:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997312.889913:0:73329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997312.889917:0:73329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997312.889929:0:73329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592bfd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaea88 expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.889966:0:73329:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997312.889984:0:73329:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997312.889999:0:73329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.890012:0:73329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.890021:0:73329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.890058:0:73329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.890071:0:73329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 18 pid: 7594 timeout: 1651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997312.890083:0:73329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73329:1876946712921216:0@lo:104: 00000100:00100000:3.0:1789997312.890462:0:73329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997312.890537:0:73329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa7b1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789997312.890621:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712921216 00000100:00100000:1.0:1789997312.890629:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712921216 00000100:00100000:1.0:1789997312.890708:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789997312.890718:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:73329:x1876946712921216:12345-0@lo:104: 00010000:00010000:1.0:1789997312.890731:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997312.890796:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997312.890802:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:73329:x1876946712921216:12345-0@lo:104: Request processed in 87us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997312.890808:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00010000:00010000:2.0:1789997312.891240:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997312.891248:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997312.891257:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997312.891261:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997312.891271:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997312.891279:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997312.891285:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997312.891325:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997312.891333:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997312.891367:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997312.891374:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592bfb2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592bfb9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997312.891386:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789997312.891398:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997312.891401:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712921344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997312.891402:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997312.891407:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997312.891440:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997312.891569:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712921344 00000100:00100000:2.0:1789997312.891574:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712921344 00010000:00010000:2.0:1789997312.891606:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 19 pid: 7594 timeout: 1651 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997312.891637:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789997312.891645:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712921344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997312.891689:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789997312.891694:0:73329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73329:1876946712921216:0@lo:104: 00010000:00010000:2.0:1789997312.891699:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 19 pid: 7594 timeout: 1651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997312.891712:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 19 pid: 7594 timeout: 1651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997312.894380:0:73329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997312.896559:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592bfb9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592bfb2 expref: 19 pid: 7594 timeout: 1651 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997312.896583:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997312.896608:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.897104:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.897114:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.897132:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.897138:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.897144:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997312.897148:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.897155:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.897181:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997312.897195:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997312.897344:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712921344:12345-0@lo:103:ldlm_bl.0 Request processed in 5698us (5901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997312.897354:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00010000:0.0:1789997312.897536:0:73329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997312.897546:0:73329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997312.897553:0:73329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a400/0x65b43101d592c01b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997312.901252:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712921344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997313.803293:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997314.124454:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997314.124461:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997314.124466:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997314.124510:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997314.124522:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997314.124533:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997314.124560:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712921472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997314.124895:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997314.124980:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e42ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1789997314.125019:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712921472 00000100:00100000:0.0:1789997314.125027:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712921472 00000100:00100000:0.0:1789997314.125107:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:0.0:1789997314.125116:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712921472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997314.125129:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997314.125141:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c022 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997314.125163:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c022 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997314.125302:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c022 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997314.125312:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997314.125362:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712921472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997314.125369:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:3.0:1789997314.125437:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712921472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997314.125452:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997314.125461:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997314.125479:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997314.125483:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997314.125489:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997314.827816:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997315.162633:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997315.162686:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704404864 00000100:00100000:1.0:1789997315.162696:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704404864 00000100:00100000:1.0:1789997315.162758:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 617 00000100:00100000:1.0:1789997315.162770:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42659:x1876946704404864:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997315.162790:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997315.162811:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeaa4 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997315.162883:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997315.162897:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997315.162911:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997315.162958:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789997315.162961:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997315.162978:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997315.163002:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaa4 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997315.163023:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaa4 expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997315.163032:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:1.0:1789997315.163035:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997315.163039:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997315.163096:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42659:x1876946704404864:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 329us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997315.163103:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 617 00000100:00080000:1.0:1789997315.163123:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997315.171059:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997315.171147:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704405120 00000100:00100000:2.0:1789997315.171239:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704405120 00000100:00100000:2.0:1789997315.171336:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 618 00000100:00100000:2.0:1789997315.171347:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42659:x1876946704405120:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997315.171398:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997315.171425:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaa4 expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997315.171441:0:5812:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592bfd5) 00010000:00010000:2.0:1789997315.171445:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:2.0:1789997315.171456:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997315.171480:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997315.171493:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997315.171503:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997315.171901:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000021e42fc reply state 0000000084ae5266 transno 4294967535 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997315.171912:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997315.171921:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000100:00100000:2.0:1789997315.172004:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42659:x1876946704405120:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 658us (955us total) trans 4294967535 rc 0/0 00000100:00100000:2.0:1789997315.172012:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 618 00010000:00010000:0.0:1789997315.180027:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.180045:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.180054:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.180061:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997315.180067:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.180075:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.180092:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:0.0:1789997315.180096:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997315.180101:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.180107:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c03e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997315.531583:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712921728:0@lo:400:kworker.0 00000100:00100000:3.0:1789997315.531630:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712921600:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.531684:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997315.531701:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997315.531738:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712922240:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.531764:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997315.531816:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712921856:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.531844:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997315.531866:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997315.531871:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712921984:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.531899:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997315.531949:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712921728 00000100:00100000:2.0:1789997315.531957:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712921728 00000100:00100000:2.0:1789997315.532001:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712922240 00000100:00100000:2.0:1789997315.532004:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712922240 00000100:00100000:2.0:1789997315.532039:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712921856 00000100:00100000:2.0:1789997315.532042:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712921856 00000100:00100000:2.0:1789997315.532067:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1789997315.532084:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712921728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997315.532137:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712922112:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.532147:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712921728:12345-0@lo:400:kworker.0 Request processed in 70us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997315.532155:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1789997315.532177:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1789997315.532183:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712922240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.532213:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712922240:12345-0@lo:400:kworker.0 Request processed in 31us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997315.532219:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1789997315.532230:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1789997315.532237:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997315.532241:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712921856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.532283:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712921856:12345-0@lo:400:kworker.0 Request processed in 44us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997315.532289:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1789997315.532316:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712921984 00000100:00100000:2.0:1789997315.532320:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712921984 00000100:00100000:1.0:1789997315.532389:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712922112 00000100:00100000:1.0:1789997315.532395:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712922112 00000100:00100000:1.0:1789997315.532425:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1789997315.532508:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712921984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997315.532573:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1789997315.532583:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712922112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997315.532620:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712921984:12345-0@lo:400:kworker.0 Request processed in 115us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997315.532628:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712922112:12345-0@lo:400:kworker.0 Request processed in 45us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997315.532633:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1789997315.532645:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1789997315.532707:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712922112:0@lo:400:kworker.0 00000100:00080000:3.0:1789997315.532860:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997315.532865:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997315.532868:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997315.533564:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712921984:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.533580:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712921856:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.533615:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712921728:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.533626:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712922240:0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.533695:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712921600 00000100:00100000:2.0:1789997315.533700:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712921600 00000100:00100000:2.0:1789997315.533799:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:2.0:1789997315.533807:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712921600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997315.533862:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712921600:12345-0@lo:400:kworker.0 Request processed in 56us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997315.533869:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:2.0:1789997315.536586:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712921600:0@lo:400:kworker.0 00000020:00000080:2.0:1789997315.785999:0:73527:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc8eb12a20 20000000:00000080:2.0:1789997315.786020:0:73527:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c2dbd000 uarg=0000000000000000 00010000:00010000:2.0:1789997315.786505:0:73527:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997315.786523:0:73527:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997315.786550:0:73527:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997315.786571:0:73527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997315.786588:0:73527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c022 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997315.786596:0:73527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997315.786635:0:73527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c022 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997315.786723:0:73527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c022 expref: 18 pid: 7594 timeout: 1654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997315.786739:0:73527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73527:1876946712922368:0@lo:104: 00000100:00100000:2.0:1789997315.786873:0:73527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997315.786990:0:73527:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3f84c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997315.787036:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712922368 00000100:00100000:1.0:1789997315.787043:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712922368 00000100:00100000:1.0:1789997315.787123:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789997315.787133:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:73527:x1876946712922368:12345-0@lo:104: 00010000:00010000:1.0:1789997315.787148:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997315.787270:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997315.787277:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:73527:x1876946712922368:12345-0@lo:104: Request processed in 146us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997315.787284:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00010000:00010000:3.0:1789997315.787324:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997315.787331:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787338:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997315.787342:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787350:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997315.787356:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997315.787362:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997315.787389:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787395:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997315.787416:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787422:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592c022 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c029 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787443:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997315.787444:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997315.787446:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997315.787464:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712922496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997315.787493:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997315.787530:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712922496 00000100:00100000:3.0:1789997315.787534:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712922496 00010000:00010000:3.0:1789997315.787562:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c022 expref: 19 pid: 7594 timeout: 1654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997315.787582:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789997315.787588:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712922496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997315.787598:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997315.787602:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c022 expref: 19 pid: 7594 timeout: 1654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787612:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c022 expref: 19 pid: 7594 timeout: 1654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787626:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787634:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787646:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787678:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787686:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787693:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787699:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997315.787703:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787710:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787718:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997315.787726:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997315.787751:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712922496:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997315.787757:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789997315.787801:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712922496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997315.788031:0:73527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592c029 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c022 expref: 18 pid: 7594 timeout: 1654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997315.788043:0:73527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73527:1876946712922368:0@lo:104: 00010000:00010000:0.0:1789997315.788057:0:73527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.788064:0:73527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.788070:0:73527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997315.788075:0:73527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592c045 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997315.853690:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789997316.101952:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997316.101963:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a38fd738000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997316.102009:0:40741:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38fd738000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:1.0:1789997316.102059:0:40741:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38fd73e000 for lustre-OST0000 00010000:00010000:1.0:1789997316.879291:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997317.398869:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997317.398914:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997317.398951:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997317.398954:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704405248 00000100:00100000:1.0:1789997317.398966:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704405248 00000100:00100000:0.0:1789997317.398981:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704405376 00000100:00100000:0.0:1789997317.398987:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704405376 00000100:00100000:1.0:1789997317.399024:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 943 00000100:00100000:1.0:1789997317.399039:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704405248:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997317.399042:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1089 00000100:00100000:0.0:1789997317.399057:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704405376:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997317.399117:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704405248:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997317.399126:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 943 00000100:00100000:3.0:1789997317.399175:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704405504 00000100:00100000:3.0:1789997317.399180:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704405504 00000100:00100000:3.0:1789997317.399216:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 646 00000100:00100000:3.0:1789997317.399225:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704405504:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997317.399389:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704405376:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 335us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997317.399398:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1089 00000100:00080000:0.0:1789997317.399427:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997317.399432:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997317.403002:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704405504:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3613us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997317.404497:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 646 00000100:00100000:0.0:1789997317.580024:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997317.580050:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712922624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997317.580130:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997317.580193:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712922752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997317.580207:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712922624 00000100:00100000:0.0:1789997317.580214:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712922624 00000100:00100000:2.0:1789997317.580229:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997317.580297:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712922752 00000100:00100000:0.0:1789997317.580301:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712922752 00000100:00100000:2.0:1789997317.580715:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1789997317.580727:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb2aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712922624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997317.580770:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997317.580823:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb2aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712922624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997317.580830:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1789997317.581044:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1789997317.581052:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712922752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997317.581070:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997317.581116:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712922752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997317.581122:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00080000:0.0:1789997317.581130:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997317.581135:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997317.581171:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712922752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997317.582115:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712922624:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1789997317.707005:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997317.707013:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997317.707017:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997317.707067:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997317.707080:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997317.707093:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997317.707121:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712922880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997317.707192:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997317.707293:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c1359780 going to sleep for 11 seconds 00000100:00100000:3.0:1789997317.707335:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712922880 00000100:00100000:3.0:1789997317.707345:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712922880 00000100:00100000:3.0:1789997317.707385:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:3.0:1789997317.707394:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712922880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997317.707412:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997317.707425:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c04c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997317.707451:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c04c expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997317.707462:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c04c expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997317.707471:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997317.707531:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712922880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997317.707538:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00100000:1.0:1789997317.707619:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712922880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997317.707636:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997317.707644:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997317.707824:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997317.707830:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997317.707844:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997317.900261:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997318.131826:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997318.131935:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704405632 00000100:00100000:1.0:1789997318.131946:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704405632 00000100:00100000:1.0:1789997318.132003:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 619 00000100:00100000:1.0:1789997318.132014:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704405632:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997318.132122:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704405632:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 110us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997318.132131:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 619 00000100:00100000:0.0:1789997318.134536:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997318.134735:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704405760 00000100:00100000:2.0:1789997318.134746:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704405760 00000100:00100000:2.0:1789997318.134799:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 317 00000100:00100000:2.0:1789997318.134807:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876946704405760:12345-192.168.204.4@tcp:8:lfs.0 00010000:00080000:2.0:1789997318.134838:0:8169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1506 last 0 00000020:00000080:2.0:1789997318.134871:0:8169:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592c05a 00002000:00100000:2.0:1789997318.134884:0:8169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38c53df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789997318.134895:0:8169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789997318.135132:0:8169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789997318.135163:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38c53dd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789997318.135238:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704405760:12345-192.168.204.4@tcp:8:lfs.0 Request processed in 429us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997318.135245:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 317 00000100:00100000:0.0:1789997318.139999:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997318.142331:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704405888 00000100:00100000:3.0:1789997318.142347:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704405888 00000100:00100000:2.0:1789997318.142601:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 318 00000100:00100000:2.0:1789997318.142612:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704405888:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997318.143228:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704405888:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 435us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997318.143240:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 318 00000100:00080000:0.0:1789997318.145349:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997318.145957:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997318.146154:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704406016 00000100:00100000:0.0:1789997318.146164:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704406016 00000100:00100000:0.0:1789997318.146291:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 319 00000100:00100000:0.0:1789997318.146304:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42743:x1876946704406016:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997318.146728:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42743:x1876946704406016:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 424us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997318.146736:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 319 00000100:00100000:1.0:1789997318.148946:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997318.150881:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704406144 00000100:00100000:3.0:1789997318.150897:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704406144 00000100:00100000:3.0:1789997318.150961:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 620 00000100:00100000:3.0:1789997318.150972:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704406144:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997318.153930:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704406144:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 1955us (3990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997318.154068:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 620 00000100:00100000:1.0:1789997318.158282:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997318.158990:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704406272 00000100:00100000:0.0:1789997318.159002:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704406272 00000100:00100000:0.0:1789997318.159075:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 621 00000100:00100000:0.0:1789997318.159086:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704406272:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997318.159203:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704406272:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 119us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997318.159211:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 621 00000100:00100000:1.0:1789997318.164575:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997318.165841:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704406400 00000100:00100000:3.0:1789997318.165853:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704406400 00000100:00100000:3.0:1789997318.165921:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 320 00000100:00100000:3.0:1789997318.165931:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704406400:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997318.166347:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704406400:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 416us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997318.166355:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 320 00000100:00100000:1.0:1789997318.170061:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997318.170161:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704406528 00000100:00100000:2.0:1789997318.170171:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704406528 00000100:00100000:2.0:1789997318.170226:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 321 00000100:00100000:2.0:1789997318.170237:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42743:x1876946704406528:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997318.170640:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42743:x1876946704406528:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 403us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997318.170648:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 321 00000100:00100000:1.0:1789997318.174969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997318.176554:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704406656 00000100:00100000:3.0:1789997318.176568:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704406656 00000100:00100000:3.0:1789997318.176639:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 622 00000100:00100000:3.0:1789997318.176650:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704406656:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997318.177675:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42743:x1876946704406656:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 1002us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997318.177685:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 622 00000100:00100000:1.0:1789997318.223128:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997318.223230:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704406784 00000100:00100000:0.0:1789997318.223250:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704406784 00000100:00100000:0.0:1789997318.223352:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 623 00000100:00100000:0.0:1789997318.223363:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42747:x1876946704406784:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997318.223382:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997318.223404:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeaab expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223466:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223479:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223506:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223519:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223526:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223532:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223879:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223888:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223896:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997318.223919:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:0.0:1789997318.223923:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997318.223940:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223953:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223960:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223967:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223973:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997318.223977:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223985:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.223996:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997318.223999:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997318.224004:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224010:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224030:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224040:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224046:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224051:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997318.224054:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224060:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224066:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997318.224069:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997318.224071:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224077:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c06f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224105:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaab expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224120:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaab expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997318.224128:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997318.224130:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997318.224133:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997318.224186:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42747:x1876946704406784:12345-192.168.204.4@tcp:101:dd.0 Request processed in 826us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997318.224193:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 623 00000100:00100000:1.0:1789997318.227164:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997318.227260:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704407040 00000100:00100000:2.0:1789997318.227270:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704407040 00000100:00100000:2.0:1789997318.227423:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 624 00000100:00100000:2.0:1789997318.227436:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42747:x1876946704407040:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:2.0:1789997318.227457:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997318.227477:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c07d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeab2 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.227817:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.227833:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.227845:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.227865:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.227872:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.227879:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997318.228608:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:2.0:1789997318.228914:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.228926:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.228935:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.228967:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.228974:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.228980:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.228986:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997318.228990:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.229002:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.229014:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:2.0:1789997318.229016:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997318.229021:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.229027:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592c084 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997318.229038:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a62afaa reply state 00000000817fe871 transno 4294967536 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997318.229046:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997318.229074:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c07d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab2 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.229087:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab2 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.229093:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997318.229095:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997318.229098:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789997318.229174:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:42747:x1876946704407040:12345-192.168.204.4@tcp:101:dd.0 Request processed in 1741us (2017us total) trans 4294967536 rc 0/0 00000100:00100000:2.0:1789997318.229182:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 624 00010000:00010000:2.0:1789997318.232508:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.232526:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.232534:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.232540:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997318.232545:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.232554:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.232571:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997318.232574:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997318.232580:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997318.232587:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c08b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997318.235226:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997318.235531:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704407168 00000100:00100000:3.0:1789997318.235541:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704407168 00000100:00100000:3.0:1789997318.235600:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 322 00000100:00100000:3.0:1789997318.235612:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42747:x1876946704407168:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:3.0:1789997318.235631:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997318.235680:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeab9 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997318.235708:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789997318.235730:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=1506s v=(0 0) 00010000:00010000:3.0:1789997318.235734:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997318.235743:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997318.235768:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997318.235781:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997318.235841:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42747:x1876946704407168:12345-192.168.204.4@tcp:101:dd.0 Request processed in 230us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997318.235848:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 322 00000100:00100000:1.0:1789997318.255930:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997318.256042:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704407296 00000100:00100000:0.0:1789997318.256053:0:6664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704407296 00002000:00100000:0.0:1789997318.256113:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x13:0x0] (0->1048575) req@ffff8a37c774e300 x1876946704407296/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:294/0 lens 488/0 e 0 to 0 dl 1789997329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789997318.256125:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c774e300 with x1876946704407296 ext(0->1048575) 00002000:00010000:0.0:1789997318.256131:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c774e300 00000100:00100000:0.0:1789997318.256167:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:0.0:1789997318.256177:0:6664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704407296:12345-192.168.204.4@tcp:4:dd.0 00000001:00100000:1.0:1789997318.300855:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:3.0:1789997318.327643:0:6664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704407296:12345-192.168.204.4@tcp:4:dd.0 Request processed in 71455us (71710us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789997318.327679:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00002000:00100000:3.0:1789997318.327693:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x13:0x0] (0->1048575) req@ffff8a37c774e300 x1876946704407296/t4294967334(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:294/0 lens 488/448 e 0 to 0 dl 1789997329 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789997318.327704:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c774e300 with x1876946704407296 ext(0->1048575) 00002000:00010000:3.0:1789997318.327712:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c774e300 00000001:00080000:0.0:1789997318.328189:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00000100:00100000:1.0:1789997318.332005:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997318.332163:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704407424 00000100:00100000:2.0:1789997318.332173:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704407424 00000100:00100000:2.0:1789997318.332283:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 625 00000100:00100000:2.0:1789997318.332294:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42747:x1876946704407424:12345-192.168.204.4@tcp:44:dd.0 00000100:00100000:1.0:1789997318.378281:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:42747:x1876946704407424:12345-192.168.204.4@tcp:44:dd.0 Request processed in 45978us (46274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997318.378295:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 625 00000001:00080000:2.0:1789997318.378762:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967536 is committed 00000100:00100000:1.0:1789997318.381046:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997318.381146:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704407552 00000100:00100000:2.0:1789997318.381156:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704407552 00000100:00100000:2.0:1789997318.381262:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 323 00000100:00100000:2.0:1789997318.381273:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704407552:12345-192.168.204.4@tcp:16:dd.0 00000100:00100000:2.0:1789997318.381382:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704407552:12345-192.168.204.4@tcp:16:dd.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997318.381389:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 323 00000100:00100000:2.0:1789997318.384318:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997318.384399:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704407808 00000100:00100000:0.0:1789997318.384408:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704407808 00000100:00100000:0.0:1789997318.384460:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 67 00000100:00100000:0.0:1789997318.384471:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42747:x1876946704407808:12345-192.168.204.4@tcp:35:dd.0 00000100:00100000:0.0:1789997318.385002:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42747:x1876946704407808:12345-192.168.204.4@tcp:35:dd.0 Request processed in 531us (691us total) trans 4294967537 rc 0/0 00000100:00100000:0.0:1789997318.385010:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 67 00010000:00010000:2.0:1789997318.925649:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997319.474208:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967537 is committed 00010000:00010000:1.0:1789997319.947226:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997320.650936:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712923136:0@lo:400:kworker.0 00000100:00100000:2.0:1789997320.651010:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997320.651042:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712923008:0@lo:400:kworker.0 00000100:00100000:2.0:1789997320.651066:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712923648:0@lo:400:kworker.0 00000100:00100000:3.0:1789997320.651092:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997320.651154:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712923392:0@lo:400:kworker.0 00000100:00100000:0.0:1789997320.655008:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712923008 00000100:00100000:0.0:1789997320.655025:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712923008 00000100:00100000:0.0:1789997320.655086:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:0.0:1789997320.655096:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712923008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997320.655470:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997320.655513:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712923136 00000100:00100000:2.0:1789997320.655517:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712923136 00000100:00100000:0.0:1789997320.655583:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712923008:12345-0@lo:400:kworker.0 Request processed in 488us (4491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997320.655594:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:3.0:1789997320.655679:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712923008:0@lo:400:kworker.0 00000100:00100000:3.0:1789997320.655694:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712923520:0@lo:400:kworker.0 00000100:00100000:3.0:1789997320.655730:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997320.655784:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712923520 00000100:00100000:3.0:1789997320.655789:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712923520 00000100:00100000:3.0:1789997320.655824:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1789997320.655831:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712923520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997320.655870:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712923520:12345-0@lo:400:kworker.0 Request processed in 39us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997320.655877:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1789997320.655887:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712923648 00000100:00100000:2.0:1789997320.655893:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712923648 00000100:00080000:3.0:1789997320.655897:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997320.655905:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997320.655933:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1789997320.655943:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712923136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997320.655946:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712923520:0@lo:400:kworker.0 00000100:00100000:2.0:1789997320.655987:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712923136:12345-0@lo:400:kworker.0 Request processed in 46us (4976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997320.655994:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1789997320.656007:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1789997320.656013:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712923648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997320.656038:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712923648:12345-0@lo:400:kworker.0 Request processed in 26us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997320.656043:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1789997320.656063:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712923264:0@lo:400:kworker.0 00000100:00100000:2.0:1789997320.656091:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997320.656123:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712923264 00000100:00100000:1.0:1789997320.656128:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997320.656129:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712923264 00000100:00100000:2.0:1789997320.656166:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1789997320.656174:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712923264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997320.656181:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712923392 00000100:00100000:1.0:1789997320.656186:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712923392 00000100:00100000:2.0:1789997320.656216:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712923264:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997320.656218:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1789997320.656230:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1789997320.656232:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712923392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997320.656271:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712923264:0@lo:400:kworker.0 00000100:00100000:1.0:1789997320.656512:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712923392:12345-0@lo:400:kworker.0 Request processed in 284us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997320.656520:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1789997320.656553:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712923392:0@lo:400:kworker.0 00000100:00080000:3.0:1789997320.657062:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997320.657068:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997320.660167:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712923648:0@lo:400:kworker.0 00000100:00100000:2.0:1789997320.660218:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712923136:0@lo:400:kworker.0 00000004:00080000:1.0:1789997320.713856:0:73773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1509406199023ns, next at 1461202087944ns, rc = 0 00000004:00080000:1.0:1789997320.713953:0:73773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1509406299033ns, next at 1494540771240ns, rc = 0 00000004:00080000:3.0:1789997320.716231:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 55 committed 00000004:00080000:3.0:1789997320.716255:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 53 committed 00010000:00010000:3.0:1789997320.970832:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997321.960835:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997321.967464:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704407936 00000100:00100000:2.0:1789997321.967479:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704407936 00000100:00080000:0.0:1789997321.968720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997321.968780:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 626 00000100:00100000:0.0:1789997321.968793:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42940:x1876946704407936:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997321.968912:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42940:x1876946704407936:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 120us (8082us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997321.968919:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 626 00000100:00100000:1.0:1789997321.976034:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997321.976358:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704408064 00000100:00100000:2.0:1789997321.976369:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704408064 00000100:00100000:2.0:1789997321.976447:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 324 00000100:00100000:2.0:1789997321.976459:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42940:x1876946704408064:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997321.976840:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42940:x1876946704408064:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 382us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997321.976848:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 324 00000100:00080000:0.0:1789997321.977585:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997321.981606:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997321.985763:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704408192 00000100:00100000:3.0:1789997321.985775:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704408192 00000100:00100000:3.0:1789997321.985857:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 325 00000100:00100000:3.0:1789997321.985868:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42940:x1876946704408192:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997321.988622:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42940:x1876946704408192:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 2747us (7014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997321.988634:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 325 00000100:00080000:0.0:1789997321.989235:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997321.990696:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997321.990824:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704408320 00000100:00100000:2.0:1789997321.990833:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704408320 00000100:00100000:2.0:1789997321.990887:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 627 00000100:00100000:2.0:1789997321.990897:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42940:x1876946704408320:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997321.991284:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42940:x1876946704408320:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 386us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997321.991292:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 627 00010000:00010000:2.0:1789997321.994888:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997322.003391:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997322.003491:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704408448 00000100:00100000:2.0:1789997322.003502:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704408448 00000100:00100000:2.0:1789997322.003565:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 628 00000100:00100000:2.0:1789997322.003576:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42940:x1876946704408448:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997322.003713:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42940:x1876946704408448:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 139us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997322.003721:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 628 00000100:00100000:1.0:1789997322.006133:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997322.006439:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704408576 00000100:00100000:2.0:1789997322.006449:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704408576 00000100:00100000:2.0:1789997322.006510:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 326 00000100:00100000:2.0:1789997322.006521:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42940:x1876946704408576:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997322.007533:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:42940:x1876946704408576:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 431us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997322.007544:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 326 00000100:00100000:1.0:1789997322.009745:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997322.009939:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704408704 00000100:00100000:2.0:1789997322.009949:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704408704 00000100:00100000:2.0:1789997322.010007:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 327 00000100:00100000:2.0:1789997322.010017:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42940:x1876946704408704:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997322.010408:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:42940:x1876946704408704:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 391us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997322.010416:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 327 00000100:00100000:1.0:1789997322.012379:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997322.012485:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704408832 00000100:00100000:0.0:1789997322.012493:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704408832 00000100:00100000:0.0:1789997322.012545:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 629 00000100:00100000:0.0:1789997322.012555:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42940:x1876946704408832:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997322.013051:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42940:x1876946704408832:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 496us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997322.013059:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 629 00000100:00100000:1.0:1789997322.112519:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997322.112631:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704409088 00000100:00100000:2.0:1789997322.112642:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704409088 00000100:00100000:2.0:1789997322.112784:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 630 00000100:00100000:2.0:1789997322.112796:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:42945:x1876946704409088:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997322.112855:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997322.112884:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab2 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.112904:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997322.112914:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997322.112946:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.112961:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.112970:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.112982:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.112988:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.112994:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.113302:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.113316:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.113323:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997322.114387:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9408 00000004:00080000:2.0:1789997322.114398:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1510806744208ns, next at 1511806741855ns, rc = 0 00010000:00010000:2.0:1789997322.114503:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114517:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114526:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114534:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114540:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114546:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114566:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997322.114589:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114595:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114602:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114607:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997322.114612:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114619:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114628:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997322.114631:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997322.114635:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114642:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592c0b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114691:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114699:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114704:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114710:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997322.114713:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114722:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114730:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:2.0:1789997322.114733:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997322.114736:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997322.114742:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c0a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997322.114751:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003127d29e reply state 00000000384635a8 transno 4294967538 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997322.114760:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997322.114843:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:42945:x1876946704409088:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2047us (2333us total) trans 4294967538 rc 0/0 00000100:00100000:2.0:1789997322.114852:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 630 00010000:00010000:1.0:1789997322.114946:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997322.114953:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.114959:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997322.114962:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.114970:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.114980:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:1.0:1789997322.114982:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997322.114986:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.114991:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c0bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.115006:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997322.115008:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997322.115010:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997322.117599:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.117616:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.117624:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.117630:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997322.117635:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.117675:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.117692:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38d0bdf200) 00010000:00010000:1.0:1789997322.117696:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997322.117701:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997322.117708:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c0ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997322.520368:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997322.521026:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704409216 00000100:00100000:3.0:1789997322.521038:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704409216 00000100:00100000:3.0:1789997322.521138:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 946 00000100:00100000:3.0:1789997322.521149:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704409216:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997322.521228:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704409216:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 80us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997322.521236:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 946 00000100:00100000:2.0:1789997322.699018:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712923776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997322.699098:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997322.699304:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997322.699315:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712923904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997322.699346:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997322.699397:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712923776 00000100:00100000:3.0:1789997322.699415:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712923776 00000100:00100000:3.0:1789997322.699464:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712923904 00000100:00100000:3.0:1789997322.699468:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712923904 00000100:00100000:3.0:1789997322.699486:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1789997322.699493:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712923776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997322.699529:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997322.699577:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712923776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997322.699585:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:3.0:1789997322.699603:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1789997322.699609:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712923904:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997322.699627:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712923776:0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997322.699628:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997322.699690:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712923904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997322.699696:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00080000:3.0:1789997322.699714:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997322.699718:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997322.699839:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712923904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789997323.022379:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997323.750423:0:73918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1512442766814ns, next at 1511806741855ns, rc = 0 00000004:00080000:3.0:1789997323.786212:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 55 committed 00000001:00080000:3.0:1789997323.786250:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967538 is committed 00000004:00080000:3.0:1789997323.786255:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 54 committed 00000100:00100000:3.0:1789997323.786446:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712924032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789997323.786516:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997323.786594:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712924032 00000100:00100000:2.0:1789997323.786604:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712924032 00000100:00100000:2.0:1789997323.786701:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789997323.786716:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712924032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789997323.786750:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:19 count 1 00010000:00010000:2.0:1789997323.786778:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.786810:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.786827:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x13:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1789997323.786832:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997323.786838:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.786870:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.786886:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 5 pid: 6659 timeout: 1612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997323.786899:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1876946712924160:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997323.786979:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3eb9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997323.789321:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997323.789379:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1876946712924160:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997323.789407:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704409344 00000100:00100000:3.0:1789997323.789414:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704409344 00010000:00010000:2.0:1789997323.789428:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997323.789469:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 6 pid: 6659 timeout: 1612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789997323.789471:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997323.789528:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 331 00000100:00100000:1.0:1789997323.789537:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704409344:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997323.789548:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997323.789553:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 6 pid: 6659 timeout: 1612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997323.789562:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 6 pid: 6659 timeout: 1612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997323.789582:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592c0a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeab9 expref: 6 pid: 6659 timeout: 1612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997323.789596:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997323.789600:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997323.789603:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997323.789610:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997323.789631:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997323.789681:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.789690:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.789700:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.789708:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997323.789715:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704409344:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 180us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997323.789722:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 331 00010000:00010000:2.0:1789997323.789724:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789997323.790516:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712924032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3804us (3998us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789997323.790524:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:2.0:1789997323.790543:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997323.790548:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.790554:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997323.790557:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.790565:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.790576:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.790580:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592c0c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997323.790601:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997323.790602:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997323.790605:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997323.791002:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c6a01f80/2, rc 0, transno 4294967335 00000100:00100000:3.0:1789997323.791018:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712924032:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789997323.791245:0:73918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1512483590416ns, next at 1494540771240ns, rc = 0 00000004:00080000:1.0:1789997323.793987:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 56 committed 00010000:00010000:1.0:1789997324.043798:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997325.066916:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997325.771308:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712924544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997325.771534:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997325.771591:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997325.771599:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712924672:0@lo:400:kworker.0 00000100:00100000:2.0:1789997325.771630:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997325.771684:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712924672 00000100:00100000:2.0:1789997325.771692:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712924672 00000100:00100000:2.0:1789997325.771760:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1789997325.771770:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712924672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997325.771823:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712924672:12345-0@lo:400:kworker.0 Request processed in 55us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997325.771830:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1789997325.772163:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712924672:0@lo:400:kworker.0 00000100:00100000:0.0:1789997325.772489:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712924416:0@lo:400:kworker.0 00000100:00100000:0.0:1789997325.772529:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997325.772558:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712924928:0@lo:400:kworker.0 00000100:00100000:3.0:1789997325.772559:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712924288:0@lo:400:kworker.0 00000100:00100000:0.0:1789997325.772586:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997325.773764:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712924544 00000100:00100000:2.0:1789997325.773772:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712924544 00000100:00100000:2.0:1789997325.773813:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712924416 00000100:00100000:2.0:1789997325.773815:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712924416 00000100:00100000:2.0:1789997325.773829:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712924928 00000100:00100000:2.0:1789997325.773831:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712924928 00000100:00100000:2.0:1789997325.773847:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1789997325.773855:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712924544:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997325.774355:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997325.774361:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997325.774377:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1789997325.774385:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712924416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997325.774437:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712924416:12345-0@lo:400:kworker.0 Request processed in 53us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997325.774443:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1789997325.774460:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1789997325.774466:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712924928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997325.774495:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712924928:12345-0@lo:400:kworker.0 Request processed in 29us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997325.774501:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1789997325.777001:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997325.777077:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712924800:0@lo:400:kworker.0 00000100:00100000:2.0:1789997325.777080:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712924544:12345-0@lo:400:kworker.0 Request processed in 3221us (5542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997325.777096:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712924416:0@lo:400:kworker.0 00000100:00100000:2.0:1789997325.777098:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1789997325.777122:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8037b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712924928:0@lo:400:kworker.0 00000100:00100000:3.0:1789997325.777131:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997325.777333:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712924544:0@lo:400:kworker.0 00000100:00100000:0.0:1789997325.777753:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712924800 00000100:00100000:0.0:1789997325.777760:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712924800 00000100:00100000:0.0:1789997325.777820:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1789997325.777829:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712924800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789997325.777832:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997325.777906:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712924800:12345-0@lo:400:kworker.0 Request processed in 68us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997325.777912:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1789997325.778532:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712924288 00000100:00100000:3.0:1789997325.778539:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712924288 00000100:00100000:3.0:1789997325.778584:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:3.0:1789997325.778594:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712924288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997325.778645:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712924288:12345-0@lo:400:kworker.0 Request processed in 53us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997325.778670:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:3.0:1789997325.778728:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712924288:0@lo:400:kworker.0 00000100:00100000:3.0:1789997325.778746:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712924800:0@lo:400:kworker.0 00010000:00010000:0.0:1789997326.091138:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997327.115079:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997327.336201:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00000100:00100000:0.0:1789997327.639002:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997327.641636:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997327.641688:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997327.641725:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997327.641772:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704409472 00000100:00100000:0.0:1789997327.641781:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704409472 00000100:00100000:0.0:1789997327.641825:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 948 00000100:00100000:0.0:1789997327.641834:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704409472:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997327.641898:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704409472:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997327.641905:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 948 00000100:00100000:0.0:1789997327.641937:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704409856 00000100:00100000:0.0:1789997327.641941:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704409856 00000100:00100000:0.0:1789997327.641973:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704409728 00000100:00100000:0.0:1789997327.641976:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704409728 00000100:00100000:0.0:1789997327.641994:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 651 00000100:00100000:0.0:1789997327.642002:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704409856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997327.642031:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704409856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997327.642037:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 651 00000100:00100000:0.0:1789997327.642049:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 652 00000100:00100000:0.0:1789997327.642055:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704409728:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997327.642079:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704409728:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997327.642085:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 652 00000100:00080000:0.0:1789997327.642099:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997327.642102:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997327.642393:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704409600 00000100:00100000:1.0:1789997327.642398:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704409600 00000100:00100000:1.0:1789997327.642449:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1096 00000100:00100000:1.0:1789997327.642458:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704409600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997327.642500:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704409600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (3506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997327.642506:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1096 00000100:00080000:0.0:1789997327.642738:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997327.823124:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712925056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997327.823196:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997327.823297:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712925056 00000100:00100000:2.0:1789997327.823305:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712925056 00000100:00100000:2.0:1789997327.823378:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:2.0:1789997327.823388:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712925056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997327.823426:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997327.823474:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8037b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712925056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997327.823481:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00080000:2.0:1789997327.823501:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997327.823543:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712925056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997327.826525:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712925184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997327.826592:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997327.826667:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712925184 00000100:00100000:3.0:1789997327.826674:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712925184 00000100:00100000:3.0:1789997327.826732:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:3.0:1789997327.826741:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712925184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997327.826774:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997327.827028:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712925184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 287us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997327.827036:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00080000:3.0:1789997327.827060:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997327.827149:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:1.0:1789997327.827156:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c6a01f80, transno 4294967335 00000100:00100000:1.0:1789997327.827183:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712925184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789997328.138885:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997329.164363:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997330.187155:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997330.891603:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997330.893391:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712925440:0@lo:400:kworker.0 00000100:00100000:0.0:1789997330.893640:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997330.893727:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712925312:0@lo:400:kworker.0 00000100:00100000:0.0:1789997330.893756:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997330.893817:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712925568:0@lo:400:kworker.0 00000100:00100000:0.0:1789997330.893850:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997330.893861:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712925952:0@lo:400:kworker.0 00000100:00100000:0.0:1789997330.893875:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997330.893884:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712925696:0@lo:400:kworker.0 00000100:00100000:1.0:1789997330.893950:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712925312 00000100:00100000:1.0:1789997330.893958:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712925312 00000100:00100000:1.0:1789997330.894016:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1789997330.894026:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712925312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997330.894157:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712925440 00000100:00100000:3.0:1789997330.894161:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712925440 00000100:00100000:3.0:1789997330.894197:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712925568 00000100:00100000:3.0:1789997330.894201:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712925568 00000100:00100000:3.0:1789997330.894230:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1789997330.894237:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712925440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997330.896117:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997330.896155:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997330.896341:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997330.896353:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712925824:0@lo:400:kworker.0 00000100:00100000:2.0:1789997330.896384:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997330.896463:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712925696 00000100:00100000:0.0:1789997330.896471:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712925696 00000100:00100000:0.0:1789997330.896720:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712925824 00000100:00100000:0.0:1789997330.896726:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712925824 00000100:00100000:0.0:1789997330.896756:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1789997330.896766:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712925696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997330.896903:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712925696:12345-0@lo:400:kworker.0 Request processed in 138us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997330.896910:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1789997330.896928:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1789997330.896934:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712925824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997330.896972:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712925824:12345-0@lo:400:kworker.0 Request processed in 37us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997330.896978:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1789997330.897025:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712925696:0@lo:400:kworker.0 00000100:00100000:0.0:1789997330.897083:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712925952 00000100:00100000:0.0:1789997330.897087:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712925952 00000100:00100000:0.0:1789997330.897118:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1789997330.897126:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712925568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997330.897153:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712925312:12345-0@lo:400:kworker.0 Request processed in 3127us (3394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997330.897164:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:1.0:1789997330.897209:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1789997330.897439:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712925568:12345-0@lo:400:kworker.0 Request processed in 313us (3588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997330.897446:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1789997330.897476:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712925568:0@lo:400:kworker.0 00000100:00100000:3.0:1789997330.897679:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712925440:12345-0@lo:400:kworker.0 Request processed in 3441us (4037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997330.897687:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00080000:3.0:1789997330.897712:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997330.897716:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997330.897718:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997330.897758:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712925824:0@lo:400:kworker.0 00000100:00100000:2.0:1789997330.897772:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712925440:0@lo:400:kworker.0 00000100:00100000:2.0:1789997330.897781:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712925312:0@lo:400:kworker.0 00000100:00100000:1.0:1789997330.897802:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712925952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997330.899537:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712925952:12345-0@lo:400:kworker.0 Request processed in 2315us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997330.899548:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1789997330.901172:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712925952:0@lo:400:kworker.0 00010000:00010000:3.0:1789997331.211292:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997332.234971:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997332.762626:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997332.762729:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997332.762768:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997332.762839:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704409984 00000100:00100000:2.0:1789997332.762850:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704409984 00000100:00100000:0.0:1789997332.762864:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997332.762898:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704410368 00000100:00100000:0.0:1789997332.762903:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704410368 00000100:00100000:2.0:1789997332.762920:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 950 00000100:00100000:2.0:1789997332.762935:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704409984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997332.762948:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704410240 00000100:00100000:0.0:1789997332.762952:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704410240 00000100:00100000:0.0:1789997332.762974:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 655 00000100:00100000:0.0:1789997332.762983:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704410368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997332.763014:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704409984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997332.763022:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704410368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997332.763025:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 950 00000100:00100000:0.0:1789997332.763034:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 655 00000100:00100000:0.0:1789997332.763051:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 656 00000100:00100000:0.0:1789997332.763060:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704410240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997332.763089:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704410240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997332.763097:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 656 00000100:00080000:3.0:1789997332.763692:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997332.763698:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997332.763828:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704410112 00000100:00100000:1.0:1789997332.763834:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704410112 00000100:00100000:1.0:1789997332.763887:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1100 00000100:00100000:1.0:1789997332.763894:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704410112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997332.763939:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704410112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997332.763945:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1100 00000100:00080000:3.0:1789997332.764636:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997332.939001:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997332.939025:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712926080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997332.939091:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997332.939390:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712926080 00000100:00100000:2.0:1789997332.939399:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712926080 00000100:00100000:2.0:1789997332.939485:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00080000:3.0:1789997332.939486:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997332.939497:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712926080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997332.939532:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997332.939595:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712926080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997332.939602:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1789997332.939697:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712926080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997332.940779:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712926208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997332.940828:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997332.940938:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712926208 00000100:00100000:3.0:1789997332.940944:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712926208 00000100:00080000:0.0:1789997332.941000:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997332.941046:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:3.0:1789997332.941056:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712926208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997332.941084:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997332.941142:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712926208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997332.941149:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1789997332.941237:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712926208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997333.260377:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997334.282808:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997335.307006:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997336.010902:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712926336:0@lo:400:kworker.0 00000100:00100000:2.0:1789997336.010935:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712926592:0@lo:400:kworker.0 00000100:00100000:0.0:1789997336.011020:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712926464:0@lo:400:kworker.0 00000100:00100000:1.0:1789997336.011048:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712926720:0@lo:400:kworker.0 00000100:00100000:3.0:1789997336.014324:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997336.014333:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997336.015143:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712926848:0@lo:400:kworker.0 00000100:00100000:3.0:1789997336.015326:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997336.015387:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712926592 00000100:00100000:3.0:1789997336.015396:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712926592 00000100:00100000:3.0:1789997336.015452:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1789997336.015461:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712926592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997336.015528:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997336.015559:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712926976:0@lo:400:kworker.0 00000100:00100000:0.0:1789997336.015585:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997336.015620:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712926336 00000100:00100000:0.0:1789997336.015625:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712926336 00000100:00100000:0.0:1789997336.015667:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1789997336.015675:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712926336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997336.015718:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712926336:12345-0@lo:400:kworker.0 Request processed in 45us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997336.015724:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1789997336.015755:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712926848 00000100:00100000:0.0:1789997336.015758:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712926848 00000100:00100000:0.0:1789997336.015784:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1789997336.015791:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712926848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997336.015823:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712926848:12345-0@lo:400:kworker.0 Request processed in 33us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997336.015829:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00080000:0.0:1789997336.015845:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997336.015849:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997336.016452:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712926592:0@lo:400:kworker.0 00000100:00100000:2.0:1789997336.016486:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712926464 00000100:00100000:2.0:1789997336.016490:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712926464 00000100:00100000:2.0:1789997336.016518:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712926976 00000100:00100000:2.0:1789997336.016521:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712926976 00000100:00100000:2.0:1789997336.016548:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1789997336.016555:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712926464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997336.016606:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712926464:12345-0@lo:400:kworker.0 Request processed in 51us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997336.016612:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1789997336.016624:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:2.0:1789997336.016630:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712926976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997336.016675:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712926976:12345-0@lo:400:kworker.0 Request processed in 45us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997336.016681:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:2.0:1789997336.016695:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997336.016740:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712926848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997336.016751:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712926336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997336.016877:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997336.016947:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712926720 00000100:00100000:2.0:1789997336.016951:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712926720 00000100:00100000:0.0:1789997336.016978:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712926464:0@lo:400:kworker.0 00000100:00100000:2.0:1789997336.016987:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1789997336.016995:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712926976:0@lo:400:kworker.0 00000100:00100000:2.0:1789997336.016997:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712926720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997336.017041:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712926720:12345-0@lo:400:kworker.0 Request processed in 47us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997336.017046:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00080000:2.0:1789997336.017060:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997336.017133:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712926720:0@lo:400:kworker.0 00000100:00100000:3.0:1789997336.018166:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712926592:12345-0@lo:400:kworker.0 Request processed in 2701us (3831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997336.018184:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00010000:00010000:1.0:1789997336.331586:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997337.355550:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997337.878759:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997337.878799:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997337.878850:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997337.878911:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997337.878959:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704410752 00000100:00100000:0.0:1789997337.878970:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704410752 00000100:00100000:0.0:1789997337.879050:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704410880 00000100:00100000:0.0:1789997337.879054:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704410880 00000100:00100000:0.0:1789997337.879088:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 659 00000100:00100000:0.0:1789997337.879101:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704410752:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997337.879196:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704410752:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 98us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997337.879206:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 659 00000100:00100000:0.0:1789997337.879233:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 660 00000100:00100000:0.0:1789997337.879242:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704410880:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997337.879279:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704410880:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997337.879287:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 660 00000100:00100000:1.0:1789997337.879411:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704410624 00000100:00100000:1.0:1789997337.879416:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704410624 00000100:00100000:1.0:1789997337.879460:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1104 00000100:00100000:1.0:1789997337.879468:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704410624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997337.879499:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704410624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997337.879505:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1104 00000100:00100000:2.0:1789997337.880459:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704410496 00000100:00100000:2.0:1789997337.880468:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704410496 00000100:00100000:2.0:1789997337.880517:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 952 00000100:00100000:2.0:1789997337.880526:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704410496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997337.880569:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704410496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (1819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997337.880580:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 952 00000100:00080000:2.0:1789997337.880608:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997337.880613:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997337.880615:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997338.059015:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712927104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997338.059086:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997338.059121:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712927104 00000100:00100000:0.0:1789997338.059130:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712927104 00000100:00100000:0.0:1789997338.059184:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1789997338.059193:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712927104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997338.059241:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997338.059298:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712927104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997338.059305:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1789997338.059380:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712927104:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997338.059411:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997338.059670:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712927232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997338.059704:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997338.059876:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712927232 00000100:00100000:3.0:1789997338.059881:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712927232 00000100:00100000:3.0:1789997338.059976:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1789997338.059985:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712927232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997338.060006:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997338.060056:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712927232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997338.060062:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1789997338.060212:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6add880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712927232:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997338.060442:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997338.062575:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997338.062680:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704411008 00000100:00100000:2.0:1789997338.062690:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704411008 00000100:00100000:2.0:1789997338.062840:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 631 00000100:00100000:2.0:1789997338.062851:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43162:x1876946704411008:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997338.062945:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43162:x1876946704411008:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 96us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997338.062952:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 631 00000100:00100000:2.0:1789997338.068596:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997338.069314:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704411136 00000100:00100000:0.0:1789997338.069326:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704411136 00000100:00100000:0.0:1789997338.069455:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 329 00000100:00100000:0.0:1789997338.069466:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43162:x1876946704411136:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997338.069847:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43162:x1876946704411136:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 383us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997338.069857:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 329 00000100:00100000:0.0:1789997338.074422:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997338.074550:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704411264 00000100:00100000:2.0:1789997338.074560:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704411264 00000100:00100000:2.0:1789997338.074617:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 330 00000100:00100000:2.0:1789997338.074628:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43162:x1876946704411264:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997338.075567:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43162:x1876946704411264:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 937us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997338.075575:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 330 00000100:00100000:1.0:1789997338.078832:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997338.078956:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704411392 00000100:00100000:0.0:1789997338.078966:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704411392 00000100:00100000:0.0:1789997338.079016:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 632 00000100:00100000:0.0:1789997338.079025:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43162:x1876946704411392:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997338.079904:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43162:x1876946704411392:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 878us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997338.079912:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 632 00000100:00100000:0.0:1789997338.082414:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997338.082496:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704411520 00000100:00100000:1.0:1789997338.082505:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704411520 00000100:00100000:1.0:1789997338.082682:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 633 00000100:00100000:1.0:1789997338.082693:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43162:x1876946704411520:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997338.083167:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43162:x1876946704411520:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 474us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997338.083175:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 633 00000100:00100000:2.0:1789997338.086820:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997338.086988:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704411648 00000100:00100000:0.0:1789997338.086998:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704411648 00000100:00100000:0.0:1789997338.087056:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 331 00000100:00100000:0.0:1789997338.087065:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43162:x1876946704411648:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997338.087552:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43162:x1876946704411648:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 486us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997338.087559:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 331 00000100:00100000:2.0:1789997338.091020:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997338.091153:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704411776 00000100:00100000:0.0:1789997338.091163:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704411776 00000100:00100000:0.0:1789997338.091218:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 332 00000100:00100000:0.0:1789997338.091228:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43162:x1876946704411776:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997338.092241:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43162:x1876946704411776:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1011us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997338.092250:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 332 00000100:00100000:1.0:1789997338.095318:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997338.095950:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704411904 00000100:00100000:3.0:1789997338.095961:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704411904 00000100:00100000:3.0:1789997338.096059:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 634 00000100:00100000:3.0:1789997338.096070:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43162:x1876946704411904:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997338.097517:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43162:x1876946704411904:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 1443us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997338.097531:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 634 00010000:00010000:0.0:1789997338.385148:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997339.405756:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997339.989724:0:74184:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc91c13480 20000000:00000080:2.0:1789997339.989741:0:74184:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c770c000 uarg=0000000000000000 00010000:00010000:2.0:1789997339.990206:0:74184:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789997339.990242:0:74184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:2.0:1789997339.990245:0:74184:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997339.990256:0:74184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaab expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997339.990285:0:74184:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789997339.990304:0:74184:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997339.990318:0:74184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997339.990331:0:74184:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c04c expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997339.990339:0:74184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997339.990375:0:74184:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c04c expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997339.990389:0:74184:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c04c expref: 18 pid: 5804 timeout: 1678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997339.991150:0:74184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74184:1876946712927360:0@lo:104: 00000100:00100000:2.0:1789997339.991281:0:74184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997339.991413:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712927360 00000100:00100000:1.0:1789997339.991422:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712927360 00000100:00100000:2.0:1789997339.991448:0:74184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61480 going to sleep for 11 seconds 00000100:00100000:1.0:1789997339.991489:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789997339.991500:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:74184:x1876946712927360:12345-0@lo:104: 00010000:00010000:1.0:1789997339.991516:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.991593:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997339.991600:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:74184:x1876946712927360:12345-0@lo:104: Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997339.991606:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00010000:00010000:3.0:1789997339.991731:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997339.991739:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997339.991747:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997339.991750:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997339.991759:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997339.991766:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997339.991771:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997339.991805:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997339.991812:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789997339.991878:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712927488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997339.991921:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789997339.991998:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997339.992008:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2e00/0x65b43101d592c04c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c053 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997339.992008:0:74184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74184:1876946712927360:0@lo:104: 00010000:00010000:3.0:1789997339.992034:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997339.992036:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997339.992036:0:74184:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997339.992039:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997339.992102:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712927488 00000100:00100000:1.0:1789997339.992107:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712927488 00010000:00010000:1.0:1789997339.992128:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c04c expref: 19 pid: 5804 timeout: 1678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997339.992160:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789997339.992168:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712927488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997339.992181:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997339.992186:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c04c expref: 19 pid: 5804 timeout: 1678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992196:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c04c expref: 19 pid: 5804 timeout: 1678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992209:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b200/0x65b43101d592c053 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c04c expref: 19 pid: 5804 timeout: 1678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992223:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992230:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992244:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992250:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992260:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992267:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992272:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997339.992276:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992283:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992307:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997339.992317:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997339.992360:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712927488:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997339.992367:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789997339.992422:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712927488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997339.992824:0:74184:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997339.992833:0:74184:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997339.992838:0:74184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c0ca lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997340.427845:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997341.131744:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712927744:0@lo:400:kworker.0 00000100:00100000:0.0:1789997341.131817:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997341.131871:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712928256:0@lo:400:kworker.0 00000100:00100000:0.0:1789997341.131894:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997341.131920:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997341.131926:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712927872:0@lo:400:kworker.0 00000100:00100000:0.0:1789997341.131950:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997341.131982:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712927744 00000100:00100000:0.0:1789997341.131990:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712927744 00000100:00100000:0.0:1789997341.132035:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712928256 00000100:00100000:0.0:1789997341.132039:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712928256 00000100:00100000:0.0:1789997341.132084:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712927872 00000100:00100000:0.0:1789997341.132089:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712927872 00000100:00100000:2.0:1789997341.132091:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712928000:0@lo:400:kworker.0 00000100:00100000:0.0:1789997341.132115:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1789997341.132127:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712927744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997341.132144:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997341.132176:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789997341.132183:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712927616:0@lo:400:kworker.0 00000100:00100000:2.0:1789997341.132211:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997341.132234:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712928128:0@lo:400:kworker.0 00000100:00100000:2.0:1789997341.132257:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997341.132283:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712928000 00000100:00100000:2.0:1789997341.132287:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712928000 00000100:00100000:2.0:1789997341.132318:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712928128 00000100:00100000:2.0:1789997341.132322:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712928128 00000100:00100000:3.0:1789997341.132347:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1789997341.132351:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1789997341.132364:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712928256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997341.132365:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712928000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997341.132437:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712928256:12345-0@lo:400:kworker.0 Request processed in 79us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997341.132442:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712928000:12345-0@lo:400:kworker.0 Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997341.132449:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1789997341.132455:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1789997341.132477:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1789997341.132481:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1789997341.132489:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712927872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997341.132496:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712928128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997341.132527:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712927872:12345-0@lo:400:kworker.0 Request processed in 40us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997341.132534:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1789997341.132542:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712928128:12345-0@lo:400:kworker.0 Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997341.132549:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:3.0:1789997341.132576:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712927872:0@lo:400:kworker.0 00000100:00100000:0.0:1789997341.132583:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712927744:12345-0@lo:400:kworker.0 Request processed in 459us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997341.132594:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1789997341.132602:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712928128:0@lo:400:kworker.0 00000100:00100000:3.0:1789997341.132606:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712927744:0@lo:400:kworker.0 00000100:00100000:2.0:1789997341.132625:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712928000:0@lo:400:kworker.0 00000100:00080000:0.0:1789997341.132625:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997341.132626:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712928256:0@lo:400:kworker.0 00000100:00080000:0.0:1789997341.132630:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997341.132633:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997341.132677:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712927616 00000100:00100000:0.0:1789997341.132682:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712927616 00000100:00100000:0.0:1789997341.132722:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1789997341.132729:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712927616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997341.132766:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712927616:12345-0@lo:400:kworker.0 Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997341.132772:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1789997341.132813:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712927616:0@lo:400:kworker.0 10000000:01000000:3.0:1789997341.197913:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997341.197920:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997341.197936:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997341.198279:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997341.198292:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997341.198304:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997341.198346:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712928384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997341.198421:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997341.198475:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32cb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997341.198508:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712928384 00000100:00100000:2.0:1789997341.198518:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712928384 00000100:00100000:2.0:1789997341.198569:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1789997341.198579:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712928384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997341.198592:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997341.198605:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c0d1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997341.198628:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997341.198639:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997341.198648:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789997341.198710:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712928384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997341.198717:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:3.0:1789997341.199078:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712928384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997341.199095:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997341.199106:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997341.199126:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997341.199239:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997341.199249:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997341.452372:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997342.307374:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997342.307986:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704412032 00000100:00100000:1.0:1789997342.308003:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704412032 00000100:00100000:1.0:1789997342.308076:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 635 00000100:00100000:1.0:1789997342.308087:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43248:x1876946704412032:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997342.308106:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997342.308145:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c0df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeac0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997342.308212:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c0e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997342.308226:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997342.308239:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997342.308287:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789997342.308291:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997342.308310:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997342.308336:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c0df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeac0 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997342.308356:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeac0 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997342.308365:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997342.308368:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997342.308371:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997342.308426:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43248:x1876946704412032:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 341us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997342.308434:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 635 00000100:00080000:1.0:1789997342.308455:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997342.313765:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997342.313795:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704412288 00000100:00100000:0.0:1789997342.313803:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704412288 00000100:00100000:0.0:1789997342.313848:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 636 00000100:00100000:0.0:1789997342.313859:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43248:x1876946704412288:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997342.313906:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997342.313935:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c0e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeac0 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.313951:0:5811:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592c076) 00010000:00010000:0.0:1789997342.313956:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:0.0:1789997342.313967:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997342.313990:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.314003:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.314013:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997342.343159:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000889d57ca reply state 00000000d93bff52 transno 4294967539 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997342.343177:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997342.343192:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000100:00100000:0.0:1789997342.343340:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43248:x1876946704412288:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 29477us (29575us total) trans 4294967539 rc 0/0 00000100:00100000:0.0:1789997342.343349:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 636 00000001:00080000:1.0:1789997342.343525:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967539 is committed 00010000:00010000:0.0:1789997342.344916:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.344929:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.344937:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.344943:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997342.344948:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.344960:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.344975:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997342.344978:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997342.344982:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.344988:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c0ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997342.481736:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997342.986256:0:74380:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd219c3fb0 20000000:00000080:2.0:1789997342.986330:0:74380:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c770fc00 uarg=0000000000000000 00010000:00010000:2.0:1789997342.989571:0:74380:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997342.989590:0:74380:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997342.989604:0:74380:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997342.989621:0:74380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997342.989642:0:74380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997342.989651:0:74380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997342.989743:0:74380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997342.989905:0:74380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 18 pid: 5805 timeout: 1681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997342.989920:0:74380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74380:1876946712928512:0@lo:104: 00000100:00100000:2.0:1789997342.989977:0:74380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997342.990075:0:74380:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3581b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789997342.990256:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712928512 00000100:00100000:1.0:1789997342.990263:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712928512 00000100:00100000:1.0:1789997342.990398:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789997342.990409:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:74380:x1876946712928512:12345-0@lo:104: 00010000:00010000:1.0:1789997342.990421:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997342.990532:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997342.990539:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:74380:x1876946712928512:12345-0@lo:104: Request processed in 132us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997342.990546:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00010000:00010000:0.0:1789997342.990623:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997342.990630:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.990638:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997342.990642:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.990679:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997342.990688:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997342.990694:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997342.990724:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.990730:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997342.990767:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.990774:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592c0d1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c0d8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.990791:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997342.990792:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997342.990794:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997342.990825:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712928640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997342.990858:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997342.990899:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712928640 00000100:00100000:0.0:1789997342.990904:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712928640 00010000:00010000:0.0:1789997342.990925:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 19 pid: 5805 timeout: 1681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997342.990947:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789997342.990953:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712928640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997342.990964:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997342.990969:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 19 pid: 5805 timeout: 1681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.990978:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 19 pid: 5805 timeout: 1681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.990995:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991003:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991034:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991041:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991048:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991054:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991059:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997342.991063:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991071:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991080:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997342.991090:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997342.991120:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712928640:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997342.991127:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789997342.991162:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712928640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997342.991785:0:74380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592c0d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c0d1 expref: 18 pid: 5805 timeout: 1681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997342.991798:0:74380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74380:1876946712928512:0@lo:104: 00010000:00010000:2.0:1789997342.991955:0:74380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997342.991965:0:74380:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997342.991972:0:74380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997342.991978:0:74380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c0f4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997342.999828:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997343.001166:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704412416 00000100:00100000:1.0:1789997343.001179:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704412416 00000100:00100000:1.0:1789997343.001248:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 955 00000100:00100000:1.0:1789997343.001260:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704412416:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997343.001346:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704412416:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 88us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997343.001354:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 955 00000100:00100000:1.0:1789997343.003195:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997343.003237:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997343.003308:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704412800 00000100:00100000:3.0:1789997343.003316:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704412800 00000100:00100000:3.0:1789997343.003379:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 663 00000100:00100000:3.0:1789997343.003389:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704412800:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997343.003447:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704412800:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 60us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997343.003454:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 663 00000100:00100000:0.0:1789997343.003515:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704412544 00000100:00100000:0.0:1789997343.003520:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704412544 00000100:00100000:0.0:1789997343.003565:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1108 00000100:00100000:0.0:1789997343.003573:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704412544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997343.003609:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704412544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997343.003616:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1108 00000100:00080000:1.0:1789997343.004021:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997343.004290:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997343.004357:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704412672 00000100:00100000:1.0:1789997343.004361:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704412672 00000100:00100000:1.0:1789997343.004416:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 664 00000100:00100000:1.0:1789997343.004425:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704412672:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997343.004464:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704412672:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997343.004473:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 664 00000100:00080000:0.0:1789997343.004962:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997343.180454:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712928768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997343.180529:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997343.180603:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712928768 00000100:00100000:0.0:1789997343.180612:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712928768 00000100:00100000:0.0:1789997343.180684:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1789997343.180694:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712928768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997343.180728:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997343.180777:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712928768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997343.180784:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00080000:0.0:1789997343.180806:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997343.180856:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712928768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997343.182879:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997343.182897:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712928896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997343.182956:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997343.183007:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712928896 00000100:00100000:1.0:1789997343.183025:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712928896 00000100:00100000:1.0:1789997343.183084:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1789997343.183093:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712928896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997343.183123:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997343.183174:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712928896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997343.183181:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00080000:1.0:1789997343.183199:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997343.183207:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712928896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997343.500522:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997344.525772:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997344.587752:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997344.587760:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997344.587767:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997344.587812:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997344.587825:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997344.587969:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997344.588010:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712929024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997344.588091:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997344.588150:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0a77600 going to sleep for 11 seconds 00000100:00100000:0.0:1789997344.588261:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712929024 00000100:00100000:0.0:1789997344.588271:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712929024 00000100:00100000:0.0:1789997344.588324:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1789997344.588334:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712929024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997344.588347:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997344.588361:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c0fb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997344.588384:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c0fb expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997344.588395:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c0fb expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997344.588403:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997344.588450:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712929024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997344.588457:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1789997344.588781:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712929024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997344.588799:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997344.588815:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997344.588837:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997344.588843:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997344.588850:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997345.240354:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997345.240398:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704412928 00000100:00100000:2.0:1789997345.240406:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704412928 00000100:00100000:2.0:1789997345.240463:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 637 00000100:00100000:2.0:1789997345.240472:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43325:x1876946704412928:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997345.240490:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997345.240511:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeac7 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240576:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240590:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240604:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240617:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240623:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240629:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240936:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c11e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240949:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.240957:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997345.240989:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:2.0:1789997345.240994:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997345.241013:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c11e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241025:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241031:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241038:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241044:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997345.241047:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241055:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241065:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997345.241068:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997345.241072:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241082:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c110 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241092:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241097:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241102:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241106:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997345.241109:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241114:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241120:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997345.241123:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997345.241126:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241131:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c117 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241159:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeac7 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241180:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c11e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeac7 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997345.241187:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997345.241189:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997345.241192:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997345.241251:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43325:x1876946704412928:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 780us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997345.241259:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 637 00000100:00080000:2.0:1789997345.241288:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997345.547295:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997346.250874:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712929152:0@lo:400:kworker.0 00000100:00100000:2.0:1789997346.250960:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997346.251648:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712929280:0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.251715:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997346.251765:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712929280 00000100:00100000:3.0:1789997346.251772:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712929280 00000100:00100000:3.0:1789997346.251818:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1789997346.251827:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712929280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.251875:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712929280:12345-0@lo:400:kworker.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997346.251881:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1789997346.251921:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712929280:0@lo:400:kworker.0 00000100:00100000:2.0:1789997346.252401:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712929152 00000100:00100000:2.0:1789997346.252407:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712929152 00000100:00100000:2.0:1789997346.252448:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1789997346.252456:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712929152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997346.252501:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712929152:12345-0@lo:400:kworker.0 Request processed in 46us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997346.252507:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1789997346.252563:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712929152:0@lo:400:kworker.0 00000100:00100000:1.0:1789997346.252843:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712929408:0@lo:400:kworker.0 00000100:00100000:1.0:1789997346.252875:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997346.252939:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712929408 00000100:00100000:3.0:1789997346.252944:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712929408 00000100:00100000:3.0:1789997346.252992:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1789997346.252999:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712929408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.253107:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712929408:12345-0@lo:400:kworker.0 Request processed in 108us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997346.253115:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00080000:3.0:1789997346.253133:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997346.253223:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712929536:0@lo:400:kworker.0 00000100:00100000:0.0:1789997346.253256:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997346.253337:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712929536 00000100:00100000:3.0:1789997346.253342:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712929536 00000100:00100000:3.0:1789997346.253382:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1789997346.253389:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712929536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.253421:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712929536:12345-0@lo:400:kworker.0 Request processed in 34us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997346.253425:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1789997346.253449:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712929536:0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.253462:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712929792:0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.253485:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997346.253518:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997346.253524:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712929664:0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.253554:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997346.253555:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712929408:0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.253578:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712929792 00000100:00100000:3.0:1789997346.253582:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712929792 00000100:00100000:3.0:1789997346.253615:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1789997346.253622:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712929792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997346.253682:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712929792:12345-0@lo:400:kworker.0 Request processed in 61us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997346.253688:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1789997346.253698:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712929792:0@lo:400:kworker.0 00000100:00100000:0.0:1789997346.253804:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712929664 00000100:00100000:0.0:1789997346.253809:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712929664 00000100:00100000:0.0:1789997346.253848:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1789997346.253856:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712929664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997346.253902:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712929664:12345-0@lo:400:kworker.0 Request processed in 47us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997346.253908:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00080000:0.0:1789997346.253933:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997346.253936:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997346.253938:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997346.254063:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712929664:0@lo:400:kworker.0 00010000:00010000:2.0:1789997346.573703:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997346.593249:0:74624:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd038cbe0 20000000:00000080:0.0:1789997346.593267:0:74624:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c24c00 uarg=0000000000000000 00010000:00010000:0.0:1789997346.593543:0:74624:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997346.593579:0:74624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:0.0:1789997346.593583:0:74624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997346.593595:0:74624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c11e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeac7 expref: 5 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997346.593619:0:74624:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997346.593635:0:74624:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997346.593649:0:74624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997346.593857:0:74624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c0fb expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997346.593866:0:74624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997346.593902:0:74624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c0fb expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997346.593915:0:74624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c0fb expref: 18 pid: 5804 timeout: 1685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997346.593930:0:74624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74624:1876946712929920:0@lo:104: 00000100:00100000:0.0:1789997346.594001:0:74624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997346.594110:0:74624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a390207b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789997346.594151:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712929920 00000100:00100000:1.0:1789997346.594158:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712929920 00000100:00100000:1.0:1789997346.594278:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1789997346.594289:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:74624:x1876946712929920:12345-0@lo:104: 00010000:00010000:1.0:1789997346.594302:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997346.594371:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997346.594377:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:74624:x1876946712929920:12345-0@lo:104: Request processed in 92us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997346.594384:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00010000:2.0:1789997346.594431:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997346.594440:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594454:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997346.594457:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594466:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997346.594472:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997346.594477:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997346.594506:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594512:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997346.594533:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594540:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592c0fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c102 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594553:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997346.594555:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997346.594557:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997346.594571:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997346.594581:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712930048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997346.594615:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997346.594646:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712930048 00000100:00100000:2.0:1789997346.594649:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712930048 00010000:00010000:2.0:1789997346.594695:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c0fb expref: 19 pid: 5804 timeout: 1685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997346.594720:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789997346.594727:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712930048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997346.594738:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997346.594743:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c0fb expref: 19 pid: 5804 timeout: 1685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594752:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c0fb expref: 19 pid: 5804 timeout: 1685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594765:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594773:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594786:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594792:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594799:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594805:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594809:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997346.594814:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594821:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594829:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997346.594837:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997346.594864:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712930048:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997346.594871:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789997346.594909:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712930048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997346.594999:0:74624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592c102 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c0fb expref: 18 pid: 5804 timeout: 1685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997346.595018:0:74624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74624:1876946712929920:0@lo:104: 00010000:00010000:3.0:1789997346.595031:0:74624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997346.595039:0:74624:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997346.595045:0:74624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997346.595052:0:74624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592c125 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997347.597004:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997348.121618:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997348.121681:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997348.121712:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997348.121777:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997348.121805:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704413312 00000100:00100000:2.0:1789997348.121815:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704413312 00000100:00100000:2.0:1789997348.121868:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704413440 00000100:00100000:2.0:1789997348.121871:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704413440 00000100:00100000:2.0:1789997348.121893:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 667 00000100:00100000:2.0:1789997348.121902:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704413312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997348.122065:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704413184 00000100:00100000:0.0:1789997348.122070:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704413184 00000100:00100000:0.0:1789997348.122108:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1112 00000100:00100000:0.0:1789997348.122117:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704413184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997348.122225:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704413056 00000100:00100000:1.0:1789997348.122230:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704413056 00000100:00100000:1.0:1789997348.122542:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 958 00000100:00100000:1.0:1789997348.122550:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704413056:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997348.122620:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704413312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 717us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997348.122632:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 667 00000100:00100000:2.0:1789997348.122650:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 668 00000100:00100000:2.0:1789997348.122682:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704413440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997348.123576:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704413056:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1022us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997348.123586:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 958 00000100:00100000:1.0:1789997348.123799:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704413184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1683us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997348.123809:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1112 00000100:00100000:2.0:1789997348.123945:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704413440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1263us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997348.123953:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 668 00000100:00080000:2.0:1789997348.123978:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997348.123983:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997348.123986:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1789997348.235877:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997348.235885:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997348.235890:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997348.235950:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.235963:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.235974:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997348.236005:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712930176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997348.236075:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997348.236374:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712930176 00000100:00100000:1.0:1789997348.236384:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712930176 00000100:00100000:1.0:1789997348.236444:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1789997348.236455:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712930176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997348.236469:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997348.236482:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c12c expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997348.236507:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c12c expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997348.236518:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c12c expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997348.236527:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:3.0:1789997348.236528:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61540 going to sleep for 11 seconds 00000100:00100000:1.0:1789997348.236584:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712930176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997348.236592:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:3.0:1789997348.236691:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6add180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712930176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997348.236707:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.236723:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997348.236741:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997348.236746:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.236754:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997348.299486:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712930304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997348.299802:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997348.299868:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712930432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997348.299893:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997348.300600:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712930304 00000100:00100000:0.0:1789997348.300609:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712930304 00000100:00100000:0.0:1789997348.300778:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712930432 00000100:00100000:0.0:1789997348.300782:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712930432 00000100:00080000:2.0:1789997348.300788:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997348.300796:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997348.300809:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1789997348.300817:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712930304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997348.300852:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997348.300903:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712930304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997348.300926:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1789997348.300944:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1789997348.300951:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712930432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997348.301425:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997348.301463:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712930432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 512us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997348.301470:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1789997348.301519:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712930304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997348.301534:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712930432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997348.618832:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997348.669876:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997348.669930:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704413568 00000100:00100000:3.0:1789997348.669941:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704413568 00000100:00100000:3.0:1789997348.669993:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 638 00000100:00100000:3.0:1789997348.670003:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43416:x1876946704413568:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997348.670024:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997348.670046:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c13a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeace expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.670116:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.670131:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.670145:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997348.670180:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:3.0:1789997348.670184:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997348.670203:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.670229:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c13a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeace expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.670253:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeace expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997348.670263:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997348.670265:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997348.670269:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997348.670327:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43416:x1876946704413568:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 325us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997348.670335:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 638 00000100:00100000:3.0:1789997348.673175:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997348.680193:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704413824 00000100:00100000:1.0:1789997348.680207:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704413824 00000100:00100000:1.0:1789997348.680268:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 639 00000100:00100000:1.0:1789997348.680279:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43416:x1876946704413824:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997348.680334:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997348.680363:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeace expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997348.680385:0:5810:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592c11e) 00010000:00010000:1.0:1789997348.680389:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:1.0:1789997348.680401:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997348.680426:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997348.680439:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997348.680448:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789997348.707590:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967540 is committed 00000004:00010000:2.0:1789997348.707735:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf8863e5 reply state 0000000024d8d66f transno 4294967540 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997348.707749:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997348.707775:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00080000:2.0:1789997348.707880:0:5810:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789997348.707914:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43416:x1876946704413824:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 27625us (34736us total) trans 4294967540 rc 0/0 00000100:00100000:2.0:1789997348.707924:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 639 00010000:00010000:0.0:1789997348.708056:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997348.708070:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997348.708078:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997348.708084:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997348.708088:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997348.708095:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997348.708110:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:0.0:1789997348.708112:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997348.708117:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997348.708123:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c148 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789997349.344226:0:74821:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe249dcd40 20000000:00000080:1.0:1789997349.344244:0:74821:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c57c5400 uarg=0000000000000000 00010000:00010000:1.0:1789997349.345093:0:74821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997349.345116:0:74821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997349.345133:0:74821:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997349.345151:0:74821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997349.345169:0:74821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c12c expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997349.345177:0:74821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997349.345216:0:74821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c12c expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997349.345236:0:74821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c12c expref: 18 pid: 7594 timeout: 1688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997349.345250:0:74821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74821:1876946712930560:0@lo:104: 00000100:00100000:1.0:1789997349.345320:0:74821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997349.345377:0:74821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71b40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997349.345500:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789997349.345513:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712930560 00000100:00100000:3.0:1789997349.345520:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712930560 00000100:00100000:3.0:1789997349.345572:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789997349.345582:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa5acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:74821:x1876946712930560:12345-0@lo:104: 00010000:00010000:3.0:1789997349.345595:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997349.345887:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997349.345905:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa5acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:74821:x1876946712930560:12345-0@lo:104: Request processed in 324us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997349.345916:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00010000:2.0:1789997349.346004:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997349.346013:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346029:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997349.346034:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346042:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997349.346051:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997349.346058:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997349.346128:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346135:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997349.346167:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346175:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c12c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c133 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346192:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997349.346193:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997349.346195:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997349.346203:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997349.346216:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712930688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997349.346251:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997349.346288:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712930688 00000100:00100000:2.0:1789997349.346292:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712930688 00010000:00010000:2.0:1789997349.346314:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c12c expref: 19 pid: 7594 timeout: 1688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997349.346338:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789997349.346346:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712930688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997349.346356:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997349.346361:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c12c expref: 19 pid: 7594 timeout: 1688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346376:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c12c expref: 19 pid: 7594 timeout: 1688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346404:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346414:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346429:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346436:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346443:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346449:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346454:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997349.346458:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346464:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346473:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997349.346487:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997349.346517:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712930688:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997349.346523:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789997349.346567:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712930688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997349.347092:0:74821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c133 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c12c expref: 18 pid: 7594 timeout: 1688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997349.347106:0:74821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74821:1876946712930560:0@lo:104: 00010000:00010000:1.0:1789997349.347122:0:74821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997349.347131:0:74821:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997349.347138:0:74821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997349.347144:0:74821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c14f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997349.650671:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997350.666821:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997350.731705:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997350.731712:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997350.731717:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997350.731762:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997350.731773:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997350.731784:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997350.731809:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712930816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997350.731889:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997350.731935:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997350.731959:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712930816 00000100:00100000:2.0:1789997350.731967:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712930816 00000100:00100000:2.0:1789997350.732018:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1789997350.732027:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712930816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997350.732044:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997350.732060:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c156 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997350.732085:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c156 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997350.732096:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c156 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997350.732104:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997350.732155:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712930816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997350.732163:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:1.0:1789997350.732196:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712930816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997350.732212:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997350.732221:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997350.732245:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997350.732250:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997350.732257:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997351.370895:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712931328:0@lo:400:kworker.0 00000100:00100000:2.0:1789997351.370950:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712930944:0@lo:400:kworker.0 00000100:00100000:1.0:1789997351.370971:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997351.370994:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997351.371051:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712931456:0@lo:400:kworker.0 00000100:00100000:1.0:1789997351.371064:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712931072:0@lo:400:kworker.0 00000100:00100000:2.0:1789997351.371098:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997351.371104:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997351.371137:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712930944 00000100:00100000:2.0:1789997351.371146:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712930944 00000100:00100000:1.0:1789997351.371150:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712931584:0@lo:400:kworker.0 00000100:00100000:3.0:1789997351.371160:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712931328 00000100:00100000:3.0:1789997351.371168:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712931328 00000100:00100000:1.0:1789997351.371180:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997351.371206:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997351.371207:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1789997351.371217:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712931200:0@lo:400:kworker.0 00000100:00100000:3.0:1789997351.371221:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712931456 00000100:00100000:2.0:1789997351.371224:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712930944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997351.371226:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712931456 00000100:00100000:1.0:1789997351.371246:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997351.371260:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1789997351.371272:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712931328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997351.371286:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712931072 00000100:00100000:2.0:1789997351.371291:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712930944:12345-0@lo:400:kworker.0 Request processed in 72us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997351.371293:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712931072 00000100:00100000:2.0:1789997351.371303:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:1.0:1789997351.371329:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712931584 00000100:00100000:1.0:1789997351.371333:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712931584 00000100:00100000:1.0:1789997351.371358:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1789997351.371361:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1789997351.371368:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712931072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997351.371376:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712931456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997351.371413:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712931072:12345-0@lo:400:kworker.0 Request processed in 47us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997351.371423:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712931456:12345-0@lo:400:kworker.0 Request processed in 49us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997351.371423:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1789997351.371440:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1789997351.371442:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712931200 00000100:00100000:1.0:1789997351.371447:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712931200 00000100:00080000:2.0:1789997351.371465:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997351.371472:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997351.371475:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997351.371475:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1789997351.371486:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712931584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997351.371502:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1789997351.371513:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712931200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997351.371521:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712931584:12345-0@lo:400:kworker.0 Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997351.371529:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1789997351.371553:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712931200:12345-0@lo:400:kworker.0 Request processed in 42us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997351.371561:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1789997351.371584:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712931328:0@lo:400:kworker.0 00000100:00100000:3.0:1789997351.371611:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712931328:12345-0@lo:400:kworker.0 Request processed in 341us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997351.371619:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1789997351.371623:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712930944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997351.373136:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712931456:0@lo:400:kworker.0 00000100:00100000:1.0:1789997351.373170:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712931200:0@lo:400:kworker.0 00000100:00100000:1.0:1789997351.373256:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712931072:0@lo:400:kworker.0 00000100:00100000:1.0:1789997351.373264:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712931584:0@lo:400:kworker.0 00000100:00100000:3.0:1789997351.559614:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997351.559961:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704413952 00000100:00100000:1.0:1789997351.559971:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704413952 00000100:00080000:2.0:1789997351.560006:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997351.560049:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 640 00000100:00100000:1.0:1789997351.560061:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43493:x1876946704413952:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997351.560141:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997351.560162:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaead5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560222:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560237:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560249:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560261:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560267:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560275:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560641:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560676:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560686:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997351.560709:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789997351.560713:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997351.560734:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560745:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560753:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560759:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560769:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997351.560774:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560782:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560795:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789997351.560799:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997351.560950:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560959:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c16b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560973:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560979:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560985:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.560991:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997351.560994:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.561001:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.561014:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38e062d400) 00010000:00010000:1.0:1789997351.561017:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997351.561021:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.561027:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c172 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.561060:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaead5 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.561143:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaead5 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.561153:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997351.561156:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997351.561159:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997351.561222:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43493:x1876946704413952:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1164us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997351.561231:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 640 00000100:00100000:0.0:1789997351.565803:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997351.566085:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704414208 00000100:00100000:0.0:1789997351.566094:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704414208 00000100:00100000:0.0:1789997351.566143:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 641 00000100:00100000:0.0:1789997351.566154:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43493:x1876946704414208:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:0.0:1789997351.566173:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997351.566190:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c180 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeadc expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.566437:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.566452:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.566463:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.566478:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.566485:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.566492:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997351.567209:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:0.0:1789997351.567485:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567498:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567507:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567540:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567551:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567559:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567565:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997351.567570:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567578:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567590:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:0.0:1789997351.567593:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997351.567598:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567605:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c187 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997351.567624:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2fc39b4 reply state 00000000834b1f24 transno 4294967541 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997351.567632:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997351.567682:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c180 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeadc expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567699:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeadc expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.567712:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997351.567715:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997351.567717:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997351.567785:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:43493:x1876946704414208:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1632us (1989us total) trans 4294967541 rc 0/0 00000100:00100000:0.0:1789997351.567794:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 641 00010000:00010000:0.0:1789997351.569954:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.569967:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.569975:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.569980:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997351.569985:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.569992:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.570005:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38c28e9600) 00010000:00010000:0.0:1789997351.570008:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997351.570012:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.570018:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c18e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997351.572347:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997351.572771:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704414464 00000100:00100000:1.0:1789997351.572780:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704414464 00000100:00100000:1.0:1789997351.572835:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 642 00000100:00100000:1.0:1789997351.572861:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:43493:x1876946704414464:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:1.0:1789997351.573144:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997351.573169:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeadc expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.573199:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8a38c28e9700) 00010000:00010000:1.0:1789997351.573209:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997351.573249:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.573262:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.573272:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997351.573393:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000003d8f84 reply state 00000000381b094d transno 4294967542 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997351.573402:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997351.573528:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:43493:x1876946704414464:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 683us (1187us total) trans 4294967542 rc 0/0 00000100:00100000:1.0:1789997351.573535:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 642 00010000:00010000:1.0:1789997351.574787:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.574797:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.574805:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.574810:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997351.574814:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.574823:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.574835:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789997351.574837:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997351.574842:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.574859:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c1a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997351.578686:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997351.578800:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704414592 00000100:00100000:1.0:1789997351.578809:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704414592 00000100:00100000:1.0:1789997351.578878:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 643 00000100:00100000:1.0:1789997351.578889:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:43493:x1876946704414592:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997351.578911:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997351.578944:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c1aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeae3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.579008:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeae3 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.579024:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c1aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeae3 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997351.579041:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997351.579043:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789997351.579048:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997351.579106:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:43493:x1876946704414592:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 219us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997351.579113:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 643 00000100:00100000:0.0:1789997351.585267:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997351.585361:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704414720 00000100:00100000:2.0:1789997351.585372:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704414720 00000100:00100000:2.0:1789997351.585475:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 333 00000100:00100000:2.0:1789997351.585486:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704414720:12345-192.168.204.4@tcp:2:touch.60003 00000100:00100000:2.0:1789997351.585826:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704414720:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 341us (566us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789997351.585834:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 333 00000100:00080000:0.0:1789997351.586092:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997351.591172:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997351.591597:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704414976 00000100:00100000:3.0:1789997351.591606:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704414976 00000100:00100000:0.0:1789997351.591738:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:0.0:1789997351.591752:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:43493:x1876946704414976:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:0.0:1789997351.592278:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:43493:x1876946704414976:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 528us (1112us total) trans 4294967543 rc 0/0 00000100:00100000:0.0:1789997351.592287:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 68 00000100:00100000:1.0:1789997351.622585:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997351.622701:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704415104 00000100:00100000:0.0:1789997351.622710:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704415104 00000100:00100000:0.0:1789997351.622769:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 644 00000100:00100000:0.0:1789997351.622778:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:43497:x1876946704415104:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:0.0:1789997351.622802:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997351.622822:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c1b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeaea expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.622897:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.622920:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.622937:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.622952:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.622959:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.622965:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623058:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592c1c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623067:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592c1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623073:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592c1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997351.623112:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x35:0x0]: returning size 0 00000004:00200000:0.0:1789997351.623117:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997351.623134:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592c1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623145:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592c1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623152:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623158:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623164:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623174:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997351.623178:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623194:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623206:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:0.0:1789997351.623209:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997351.623213:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623219:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592c1b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623240:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623246:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623251:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623256:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997351.623259:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623265:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623275:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38c28e9600) 00010000:00010000:0.0:1789997351.623277:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997351.623280:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623285:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592c1bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623312:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592c1b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaea expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623324:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592c1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaea expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.623331:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:0.0:1789997351.623333:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997351.623336:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997351.623390:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:43497:x1876946704415104:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 613us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997351.623397:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 644 00000100:00100000:2.0:1789997351.626636:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997351.626861:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704415232 00000100:00100000:0.0:1789997351.626870:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704415232 00000100:00100000:0.0:1789997351.627027:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 334 00000100:00100000:0.0:1789997351.627038:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704415232:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:0.0:1789997351.627055:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997351.627085:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeaf1 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997351.627116:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x6ab13127, atime: 0x6ab13127, ctime: 0x6ab13127, blocks: 0x1 00010000:00010000:0.0:1789997351.627133:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=1540s v=(0 0) 00010000:00010000:0.0:1789997351.627138:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997351.627148:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.627166:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.627178:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789997351.627231:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704415232:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 195us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997351.627238:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 334 00000100:00100000:2.0:1789997351.631370:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997351.631513:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704415488 00000100:00100000:0.0:1789997351.631524:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704415488 00000100:00100000:0.0:1789997351.631579:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 645 00000100:00100000:0.0:1789997351.631588:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:43497:x1876946704415488:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:0.0:1789997351.631639:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997351.631775:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592c1c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaea expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.631799:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c1aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x35:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeae3 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.631816:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:0.0:1789997351.631826:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997351.631862:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.631876:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.631885:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.631899:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.631906:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.631913:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.632185:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.632194:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.632202:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789997351.633218:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9472 00000004:00080000:0.0:1789997351.633230:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1540325575420ns, next at 1541325573087ns, rc = 0 00010000:00010000:0.0:1789997351.633299:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633311:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633321:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633328:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633334:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633341:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633421:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997351.633450:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633466:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633472:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633478:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997351.633482:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633490:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633501:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997351.633504:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997351.633509:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633515:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592c1e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633534:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633540:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633545:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633550:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997351.633553:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633559:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633565:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:0.0:1789997351.633567:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997351.633570:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.633575:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592c1d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997351.633596:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a50267a9 reply state 00000000bb4dca38 transno 4294967544 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997351.633604:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997351.633937:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:43497:x1876946704415488:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 2336us (2562us total) trans 4294967544 rc 0/0 00000100:00100000:0.0:1789997351.633946:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 645 00010000:00010000:2.0:1789997351.634190:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997351.634197:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997351.634204:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997351.634208:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997351.634215:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997351.634225:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:2.0:1789997351.634227:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997351.634230:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997351.634236:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c1e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997351.634252:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997351.634254:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997351.634255:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997351.636511:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.636525:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.636533:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.636539:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997351.636543:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.636550:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.636563:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38c28e9300) 00010000:00010000:0.0:1789997351.636566:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997351.636570:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.636577:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592c1db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997351.690995:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997352.714971:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997352.785614:0:75064:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2c85b260 20000000:00000080:1.0:1789997352.785630:0:75064:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd791c00 uarg=0000000000000000 00010000:00010000:1.0:1789997352.786140:0:75064:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997352.786175:0:75064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997352.786179:0:75064:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997352.786190:0:75064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaead5 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997352.786219:0:75064:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997352.786235:0:75064:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997352.786250:0:75064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997352.786263:0:75064:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c156 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997352.786270:0:75064:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997352.786305:0:75064:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c156 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997352.786316:0:75064:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c156 expref: 18 pid: 5804 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997352.786333:0:75064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75064:1876946712931712:0@lo:104: 00000100:00100000:1.0:1789997352.786394:0:75064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997352.786490:0:75064:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789997352.786530:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712931712 00000100:00100000:0.0:1789997352.786538:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712931712 00000100:00100000:0.0:1789997352.786618:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789997352.786628:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:75064:x1876946712931712:12345-0@lo:104: 00010000:00010000:0.0:1789997352.786640:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.786736:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997352.786742:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:75064:x1876946712931712:12345-0@lo:104: Request processed in 117us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997352.786749:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789997352.786851:0:75064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75064:1876946712931712:0@lo:104: 00010000:00010000:2.0:1789997352.786869:0:75064:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997352.786951:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997352.786959:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997352.786966:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997352.786970:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997352.786979:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997352.786986:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997352.786992:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997352.787022:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997352.787030:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789997352.787058:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712931840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997352.787065:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997352.787072:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592c156 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c15d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997352.787085:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997352.787086:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997352.787088:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997352.787156:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997352.787423:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712931840 00000100:00100000:3.0:1789997352.787429:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712931840 00010000:00010000:0.0:1789997352.787516:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c156 expref: 19 pid: 5804 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997352.787583:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789997352.787590:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712931840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997352.787601:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997352.787607:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c156 expref: 19 pid: 5804 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787618:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c156 expref: 19 pid: 5804 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787630:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c15d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c156 expref: 19 pid: 5804 timeout: 1691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787643:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787690:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787706:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787713:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787720:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787726:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787731:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997352.787736:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787743:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787759:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997352.787768:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997352.787806:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712931840:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997352.787813:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789997352.787895:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712931840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997352.787924:0:75064:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997352.787933:0:75064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997352.787940:0:75064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c1f0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997352.938885:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967336 is committed 00000100:00100000:2.0:1789997353.239698:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997353.239731:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997353.239761:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997353.239790:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704416000 00000100:00100000:2.0:1789997353.239800:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704416000 00000100:00100000:2.0:1789997353.239868:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 671 00000100:00100000:2.0:1789997353.239879:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704416000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997353.239949:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704416000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997353.239957:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 671 00000100:00100000:0.0:1789997353.241334:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704415744 00000100:00100000:0.0:1789997353.241342:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704415744 00000100:00100000:0.0:1789997353.241388:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1116 00000100:00100000:0.0:1789997353.241395:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:2352:x1876946704415744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997353.241456:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:2352:x1876946704415744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 62us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997353.241462:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1116 00000100:00080000:0.0:1789997353.241479:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997353.241484:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997353.244767:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704415616 00000100:00100000:3.0:1789997353.244781:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704415616 00000100:00100000:0.0:1789997353.244838:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997353.244876:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 962 00000100:00100000:3.0:1789997353.244889:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704415616:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997353.244976:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704415872 00000100:00100000:0.0:1789997353.244980:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704415872 00000100:00100000:0.0:1789997353.245120:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 672 00000100:00100000:0.0:1789997353.245131:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704415872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997353.245177:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704415872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997353.245185:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 672 00000100:00100000:3.0:1789997353.245191:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704415616:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 302us (5497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997353.245201:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 962 00000100:00080000:0.0:1789997353.245289:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789997353.418937:0:7604:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1542111276909ns, next at 1543111274544ns, rc = 0 00000100:00100000:0.0:1789997353.418960:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997353.418980:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712931968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997353.419244:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997353.419310:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712932096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997353.419337:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997353.419530:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712931968 00000100:00100000:3.0:1789997353.419539:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712931968 00000100:00100000:3.0:1789997353.419587:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712932096 00000100:00100000:3.0:1789997353.419589:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712932096 00000100:00100000:3.0:1789997353.419607:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1789997353.419616:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712931968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997353.419649:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997353.419721:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712931968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997353.419728:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:3.0:1789997353.419747:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1789997353.419753:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712932096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997353.419771:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997353.419800:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712932096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997353.419806:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00080000:0.0:1789997353.420564:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997353.420570:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997353.421258:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712932096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997353.421277:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712931968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997353.738814:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997353.984597:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 58 committed 00000001:00080000:3.0:1789997353.984625:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967544 is committed 00000004:00080000:3.0:1789997353.984631:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 57 committed 00000100:00100000:3.0:1789997353.984825:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712932224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789997353.984890:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997353.984957:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712932224 00000100:00100000:3.0:1789997353.984964:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712932224 00000100:00100000:3.0:1789997353.985365:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789997353.985377:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712932224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789997353.985406:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:20 count 1 00010000:00010000:3.0:1789997353.985430:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.985451:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 5 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.985461:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789997353.985465:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997353.985471:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.985499:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 5 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.985512:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 5 pid: 6656 timeout: 1642 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997353.985524:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8169:1876946712932352:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997353.985602:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789997353.989633:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8169:1876946712932352:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997353.989739:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997353.991239:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997353.991846:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704416128 00000100:00100000:3.0:1789997353.991856:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704416128 00010000:00010000:3.0:1789997353.991898:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 6 pid: 6656 timeout: 1642 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997353.991948:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 337 00000100:00100000:3.0:1789997353.991959:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704416128:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997353.991975:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997353.991980:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 6 pid: 6656 timeout: 1642 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.991999:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 6 pid: 6656 timeout: 1642 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.992023:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592c1cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf1 expref: 6 pid: 6656 timeout: 1642 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.992039:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997353.992044:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997353.992050:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.992060:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.992086:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997353.992138:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704416128:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 180us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997353.992146:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 337 00010000:00010000:3.0:1789997353.992173:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.992182:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.992192:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.992201:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997353.992224:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997353.993526:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997353.993546:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997353.993558:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997353.993562:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997353.993572:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997353.993590:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997353.993598:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f6c633d/0x65b43101d592c1f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997353.993619:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997353.993620:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997353.993622:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997353.994498:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712932224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9119us (9603us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789997353.994509:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000004:00080000:1.0:1789997353.994604:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38f9b47100/2, rc 0, transno 4294967337 00000100:00100000:1.0:1789997353.994613:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712932224:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789997354.764195:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997354.764897:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997354.764902:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997354.764906:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997354.764949:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997354.764966:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997354.764977:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997354.765003:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712932480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997354.765598:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997354.765815:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c35fb000 going to sleep for 11 seconds 00000100:00100000:3.0:1789997354.769802:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712932480 00000100:00100000:3.0:1789997354.769816:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712932480 00000100:00100000:3.0:1789997354.769978:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1789997354.769989:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712932480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997354.770008:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997354.771581:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c1fe expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997354.771617:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c1fe expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997354.771630:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c1fe expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997354.771639:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997354.771730:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712932480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1743us (6133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997354.771738:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1789997354.771813:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712932480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997354.771833:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997354.771844:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997354.771867:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997354.771938:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997354.771947:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997354.868860:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997354.868936:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704416256 00000100:00100000:1.0:1789997354.868946:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704416256 00000100:00100000:1.0:1789997354.869004:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 646 00000100:00100000:1.0:1789997354.869015:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43587:x1876946704416256:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997354.869033:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997354.869056:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c20c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeaf8 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.869125:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.869144:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.869158:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997354.869195:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789997354.869199:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997354.869218:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.869245:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c20c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf8 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.869265:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf8 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.869274:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d800) 00010000:00010000:1.0:1789997354.869277:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997354.869281:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997354.869367:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43587:x1876946704416256:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 353us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997354.869375:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 646 00000100:00100000:3.0:1789997354.873261:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997354.873384:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704416512 00000100:00100000:1.0:1789997354.873394:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704416512 00000100:00100000:1.0:1789997354.873466:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 647 00000100:00100000:1.0:1789997354.873474:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43587:x1876946704416512:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997354.873518:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997354.873541:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c213 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaf8 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.873554:0:12471:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592c179) 00010000:00010000:1.0:1789997354.873557:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d800) 00010000:00010000:1.0:1789997354.873565:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997354.873583:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.873593:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997354.873600:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997354.874140:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc113a4b reply state 00000000b802e1b5 transno 4294967545 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997354.874150:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997354.874158:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000100:00100000:1.0:1789997354.874252:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43587:x1876946704416512:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 776us (1000us total) trans 4294967545 rc 0/0 00000100:00100000:1.0:1789997354.874259:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 647 00010000:00010000:2.0:1789997354.877827:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997354.877843:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997354.877851:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997354.877858:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997354.877862:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997354.877869:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997354.877885:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:2.0:1789997354.877887:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997354.877893:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997354.877904:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c21a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789997355.449394:0:75263:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff9d8971c0 20000000:00000080:0.0:1789997355.449413:0:75263:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c7d1e800 uarg=0000000000000000 00010000:00010000:0.0:1789997355.449937:0:75263:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997355.449953:0:75263:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997355.449967:0:75263:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997355.449986:0:75263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997355.450003:0:75263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c1fe expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997355.450015:0:75263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997355.450055:0:75263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c1fe expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997355.450070:0:75263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c1fe expref: 18 pid: 5803 timeout: 1694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997355.450084:0:75263:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75263:1876946712932608:0@lo:104: 00000100:00100000:0.0:1789997355.450145:0:75263:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997355.450207:0:75263:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789997355.450367:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712932608 00000100:00100000:1.0:1789997355.450375:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712932608 00000100:00100000:1.0:1789997355.450427:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789997355.450436:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:75263:x1876946712932608:12345-0@lo:104: 00010000:00010000:1.0:1789997355.450448:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997355.450518:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997355.450524:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:75263:x1876946712932608:12345-0@lo:104: Request processed in 90us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997355.450531:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00010000:2.0:1789997355.450546:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997355.450555:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.450563:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997355.450566:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.450575:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997355.450582:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997355.450588:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997355.450627:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.450634:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997355.450706:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.450715:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592c1fe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c205 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.450741:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997355.450743:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997355.450745:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997355.451051:0:75263:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75263:1876946712932608:0@lo:104: 00000100:00100000:1.0:1789997355.451058:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712932736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997355.451071:0:75263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997355.451098:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997355.451144:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712932736 00000100:00100000:2.0:1789997355.451149:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712932736 00010000:00010000:2.0:1789997355.451172:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c1fe expref: 19 pid: 5803 timeout: 1694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997355.451200:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789997355.451207:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712932736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997355.451216:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997355.451221:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c1fe expref: 19 pid: 5803 timeout: 1694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451231:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c1fe expref: 19 pid: 5803 timeout: 1694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451244:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052be00/0x65b43101d592c205 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c1fe expref: 19 pid: 5803 timeout: 1694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451257:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451265:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451279:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451287:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451294:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451301:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451307:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997355.451311:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451320:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451335:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997355.451344:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997355.451381:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712932736:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997355.451388:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:0.0:1789997355.451848:0:75263:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997355.451858:0:75263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997355.451864:0:75263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c221 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997355.451873:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712932736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997355.787621:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997356.492055:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712933120:0@lo:400:kworker.0 00000100:00100000:0.0:1789997356.492127:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997356.492184:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997356.492191:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712933248:0@lo:400:kworker.0 00000100:00100000:0.0:1789997356.492216:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997356.492252:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712933120 00000100:00100000:0.0:1789997356.492397:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712933120 00000100:00100000:0.0:1789997356.492455:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1789997356.492464:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712933120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997356.492515:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712933120:12345-0@lo:400:kworker.0 Request processed in 53us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997356.492523:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1789997356.492544:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712933248 00000100:00100000:0.0:1789997356.492548:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712933248 00000100:00100000:0.0:1789997356.492572:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:0.0:1789997356.492579:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712933248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997356.492609:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712933248:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997356.492616:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00080000:0.0:1789997356.492631:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997356.492635:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997356.492765:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712932864:0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.492800:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997356.492827:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712933376:0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.492850:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997356.492878:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789997356.492884:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712932992:0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.492909:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997356.492930:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712933504:0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.492953:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997356.493052:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712932992 00000100:00100000:1.0:1789997356.493058:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712932992 00000100:00100000:1.0:1789997356.493085:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712933504 00000100:00100000:1.0:1789997356.493088:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712933504 00000100:00100000:1.0:1789997356.493112:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1789997356.493119:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.493156:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712932992:12345-0@lo:400:kworker.0 Request processed in 38us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997356.493165:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1789997356.493178:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1789997356.493184:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712933504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.493209:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712933504:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997356.493215:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1789997356.493235:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712932864 00000100:00100000:1.0:1789997356.493239:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712932864 00000100:00100000:1.0:1789997356.493337:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1789997356.493344:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712932864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.493377:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712932864:12345-0@lo:400:kworker.0 Request processed in 34us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997356.493384:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1789997356.493410:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712933376 00000100:00100000:1.0:1789997356.493414:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712933376 00000100:00100000:1.0:1789997356.493439:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1789997356.493446:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712933376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.493476:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712933376:12345-0@lo:400:kworker.0 Request processed in 30us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997356.493481:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00080000:1.0:1789997356.493510:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997356.493513:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997356.493535:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712932992:0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.493544:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712933504:0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.493552:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712932864:0@lo:400:kworker.0 00000100:00100000:1.0:1789997356.493566:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712933376:0@lo:400:kworker.0 00000100:00100000:0.0:1789997356.493639:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712933248:0@lo:400:kworker.0 00000100:00100000:0.0:1789997356.493801:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712933120:0@lo:400:kworker.0 00010000:00010000:0.0:1789997356.815781:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997356.938787:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997356.938795:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997356.938800:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997356.938851:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997356.938863:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997356.938874:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997356.938900:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712933632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997356.938979:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997356.939039:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d399d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789997356.939430:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712933632 00000100:00100000:2.0:1789997356.939440:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712933632 00000100:00100000:2.0:1789997356.939504:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1789997356.939525:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712933632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997356.939893:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997356.940159:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c228 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997356.940189:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c228 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997356.940201:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c228 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997356.940211:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ec00, rc 0) 00000100:00100000:0.0:1789997356.940277:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712933632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 764us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997356.940285:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1789997356.940485:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712933632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997356.940504:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997356.940514:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997356.940534:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997356.940540:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997356.940548:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997357.405845:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997357.406488:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704416640 00000100:00100000:0.0:1789997357.406500:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704416640 00000100:00100000:0.0:1789997357.406627:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 648 00000100:00100000:0.0:1789997357.406638:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43672:x1876946704416640:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997357.406786:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43672:x1876946704416640:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 151us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997357.406794:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 648 00000100:00080000:1.0:1789997357.407087:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997357.409607:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997357.409681:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704416768 00000100:00100000:2.0:1789997357.409691:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704416768 00000100:00100000:2.0:1789997357.409775:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 336 00000100:00100000:2.0:1789997357.409787:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43672:x1876946704416768:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997357.410142:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43672:x1876946704416768:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 357us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997357.410152:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 336 00000100:00080000:1.0:1789997357.410289:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997357.413243:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997357.413329:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704416896 00000100:00100000:0.0:1789997357.413338:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704416896 00000100:00100000:0.0:1789997357.413408:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 337 00000100:00100000:0.0:1789997357.413419:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43672:x1876946704416896:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:1.0:1789997357.413628:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997357.413838:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43672:x1876946704416896:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 419us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997357.413846:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 337 00000100:00100000:3.0:1789997357.419540:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997357.419637:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704417024 00000100:00100000:1.0:1789997357.419647:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704417024 00000100:00100000:1.0:1789997357.419829:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 649 00000100:00100000:1.0:1789997357.419841:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43672:x1876946704417024:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997357.420399:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43672:x1876946704417024:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 558us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997357.420408:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 649 00000100:00100000:1.0:1789997357.427331:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997357.427413:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704417152 00000100:00100000:3.0:1789997357.427425:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704417152 00000100:00100000:3.0:1789997357.427478:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 650 00000100:00100000:3.0:1789997357.427488:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43672:x1876946704417152:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997357.427608:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43672:x1876946704417152:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 120us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997357.427615:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 650 00000100:00100000:3.0:1789997357.429690:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997357.429862:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704417280 00000100:00100000:1.0:1789997357.429870:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704417280 00000100:00100000:1.0:1789997357.429936:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 338 00000100:00100000:1.0:1789997357.429946:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43672:x1876946704417280:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997357.430287:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43672:x1876946704417280:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 341us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997357.430295:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 338 00000100:00100000:0.0:1789997357.434929:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997357.437744:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704417408 00000100:00100000:3.0:1789997357.437757:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704417408 00000100:00100000:3.0:1789997357.438871:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 339 00000100:00100000:3.0:1789997357.438886:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43672:x1876946704417408:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997357.439297:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43672:x1876946704417408:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 415us (4376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997357.439306:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 339 00000100:00100000:0.0:1789997357.442900:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997357.442955:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704417536 00000100:00100000:2.0:1789997357.442966:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704417536 00000100:00100000:2.0:1789997357.443095:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 651 00000100:00100000:2.0:1789997357.443105:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43672:x1876946704417536:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997357.443901:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43672:x1876946704417536:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 795us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997357.443910:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 651 00000100:00100000:2.0:1789997357.492017:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997357.492181:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704417664 00000100:00100000:1.0:1789997357.492192:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704417664 00000100:00100000:1.0:1789997357.492338:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 652 00000100:00100000:1.0:1789997357.492348:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43676:x1876946704417664:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789997357.492370:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997357.492392:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c236 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeaff expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.492462:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.492476:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.492489:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.492501:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.492508:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.492514:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.493461:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c24b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.493985:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c24b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.493998:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c24b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997357.494028:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:1.0:1789997357.494033:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997357.494196:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c24b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494214:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494221:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494228:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494234:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997357.494238:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494246:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494257:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d800) 00010000:00010000:1.0:1789997357.494260:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997357.494264:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494270:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c23d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494282:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494289:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494295:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494300:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997357.494303:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494309:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494315:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38e062da00) 00010000:00010000:1.0:1789997357.494317:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997357.494319:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494325:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c244 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494356:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c236 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaff expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494370:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c24b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaff expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.494377:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:1.0:1789997357.494379:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997357.494381:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997357.494451:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43676:x1876946704417664:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 2104us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997357.494459:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 652 00000100:00100000:1.0:1789997357.498383:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997357.498496:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704417920 00000100:00100000:3.0:1789997357.498506:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704417920 00000100:00100000:1.0:1789997357.498605:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 653 00000100:00100000:1.0:1789997357.498617:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43676:x1876946704417920:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789997357.498637:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997357.498673:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c252 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb06 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.500406:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.500426:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.500437:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.500451:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.500458:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.500465:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997357.501495:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:1.0:1789997357.501756:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501769:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501779:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501817:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501824:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501831:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501836:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997357.501909:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501919:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501931:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:1.0:1789997357.501934:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997357.501940:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.501946:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c259 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997357.502031:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6c3e446 reply state 00000000560a8948 transno 4294967546 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997357.502041:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997357.502078:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592c252 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb06 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.502100:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb06 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997357.502107:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997357.502110:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997357.502113:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997357.502189:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:43676:x1876946704417920:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 3575us (3813us total) trans 4294967546 rc 0/0 00000100:00100000:1.0:1789997357.502195:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 653 00010000:00010000:0.0:1789997357.503947:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997357.503969:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997357.503977:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997357.503982:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997357.503986:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997357.503994:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997357.504007:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38e062d800) 00010000:00010000:0.0:1789997357.504010:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997357.504015:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997357.504020:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c260 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997357.507596:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997357.509195:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704418048 00000100:00100000:2.0:1789997357.509207:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704418048 00000100:00100000:2.0:1789997357.509278:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 340 00000100:00100000:2.0:1789997357.509289:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43676:x1876946704418048:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:2.0:1789997357.509307:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997357.509327:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb0d expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997357.509353:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789997357.509376:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1546s v=(0 0) 00010000:00010000:2.0:1789997357.509380:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997357.509390:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997357.509408:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997357.509426:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789997357.509489:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43676:x1876946704418048:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 203us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997357.509496:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 340 00000100:00100000:2.0:1789997357.526859:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997357.527039:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704418176 00000100:00100000:0.0:1789997357.527049:0:6662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704418176 00002000:00100000:0.0:1789997357.528088:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x14:0x0] (0->1048575) req@ffff8a37c6127800 x1876946704418176/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:333/0 lens 488/0 e 0 to 0 dl 1789997368 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997357.528101:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c6127800 with x1876946704418176 ext(0->1048575) 00002000:00010000:0.0:1789997357.528107:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c6127800 00000100:00100000:0.0:1789997357.528145:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:0.0:1789997357.528158:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704418176:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:0.0:1789997357.544882:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704418176:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 16720us (18024us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789997357.544894:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00002000:00100000:0.0:1789997357.544905:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x14:0x0] (0->1048575) req@ffff8a37c6127800 x1876946704418176/t4294967336(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:333/0 lens 488/448 e 0 to 0 dl 1789997368 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997357.544913:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c6127800 with x1876946704418176 ext(0->1048575) 00002000:00010000:0.0:1789997357.544919:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c6127800 00000100:00100000:2.0:1789997357.547550:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997357.547866:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704418304 00000100:00100000:1.0:1789997357.547876:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704418304 00000100:00100000:1.0:1789997357.547932:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 654 00000100:00100000:1.0:1789997357.547942:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:43676:x1876946704418304:12345-192.168.204.4@tcp:44:dd.60003 00000100:00100000:0.0:1789997357.590267:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:43676:x1876946704418304:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 42184us (42583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997357.590364:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 654 00000001:00080000:3.0:1789997357.591089:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967546 is committed 00000100:00100000:1.0:1789997357.596942:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997357.596997:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704418432 00000100:00100000:0.0:1789997357.597011:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704418432 00000100:00100000:0.0:1789997357.597085:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 341 00000100:00100000:0.0:1789997357.597096:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2352:x1876946704418432:12345-192.168.204.4@tcp:16:dd.60003 00000001:00080000:0.0:1789997357.647490:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00000100:00100000:1.0:1789997357.647556:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704418432:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 50455us (50617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997357.647567:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 341 00000100:00100000:2.0:1789997357.657363:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997357.658192:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704418688 00000100:00100000:1.0:1789997357.658204:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704418688 00000100:00100000:1.0:1789997357.658262:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 69 00000100:00100000:1.0:1789997357.658272:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de235450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43676:x1876946704418688:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:1.0:1789997357.658955:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de235450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:43676:x1876946704418688:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 682us (1601us total) trans 4294967547 rc 0/0 00000100:00100000:1.0:1789997357.658969:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 69 00010000:00010000:2.0:1789997357.834855:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997358.067858:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00000100:00100000:2.0:1789997358.361311:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997358.361359:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997358.361387:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997358.361410:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997358.361440:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704418944 00000100:00100000:2.0:1789997358.361451:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704418944 00000100:00100000:2.0:1789997358.361510:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1120 00000100:00100000:2.0:1789997358.361521:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704418944:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997358.361601:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704418944:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997358.361609:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1120 00000100:00100000:2.0:1789997358.361632:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704419072 00000100:00100000:2.0:1789997358.361636:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704419072 00000100:00100000:2.0:1789997358.361777:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704419200 00000100:00100000:2.0:1789997358.361781:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704419200 00000100:00100000:2.0:1789997358.361806:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 675 00000100:00100000:2.0:1789997358.361812:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704419072:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997358.361845:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704419072:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997358.361852:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 675 00000100:00100000:2.0:1789997358.361863:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 676 00000100:00100000:2.0:1789997358.361869:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704419200:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997358.361890:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704419200:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 22us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997358.361895:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 676 00000100:00100000:3.0:1789997358.362857:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704418816 00000100:00100000:3.0:1789997358.362865:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704418816 00000100:00100000:3.0:1789997358.362910:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 966 00000100:00100000:3.0:1789997358.362919:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704418816:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997358.362980:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704418816:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 62us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997358.362987:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 966 00000100:00100000:0.0:1789997358.539217:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712933760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997358.539288:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997358.539444:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712933760 00000100:00100000:3.0:1789997358.539453:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712933760 00000100:00100000:3.0:1789997358.539512:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:3.0:1789997358.539521:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712933760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997358.539552:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997358.539600:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712933760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997358.539608:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00080000:3.0:1789997358.539628:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997358.539644:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712933888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997358.539697:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997358.539771:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712933888 00000100:00100000:1.0:1789997358.539777:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712933888 00000100:00100000:3.0:1789997358.539799:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:3.0:1789997358.539807:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38f9b47100, transno 4294967337 00000100:00100000:1.0:1789997358.539812:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1789997358.539822:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712933888:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997358.539830:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712933760:0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997358.539835:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789997358.539876:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712933888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997358.539882:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:1.0:1789997358.539914:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712933888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997358.540200:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789997358.560366:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967547 is committed 00010000:00010000:2.0:1789997358.860310:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997359.407209:0:75508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1548099552378ns, next at 1511806741855ns, rc = 0 00000004:00080000:0.0:1789997359.407353:0:75508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1548099698908ns, next at 1543111274544ns, rc = 0 00000004:00080000:3.0:1789997359.412249:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 59 committed 00000004:00080000:3.0:1789997359.412317:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 56 committed 00010000:00010000:2.0:1789997359.883229:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997360.255163:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997360.255585:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704419328 00000100:00100000:1.0:1789997360.255596:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704419328 00000100:00100000:1.0:1789997360.255711:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 655 00000100:00100000:1.0:1789997360.255723:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43868:x1876946704419328:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00080000:3.0:1789997360.255741:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997360.255844:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43868:x1876946704419328:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 124us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997360.255852:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 655 00000100:00100000:0.0:1789997360.258597:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997360.258763:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704419456 00000100:00100000:2.0:1789997360.258772:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704419456 00000100:00080000:1.0:1789997360.258930:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997360.259039:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 342 00000100:00100000:2.0:1789997360.259051:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43868:x1876946704419456:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997360.259637:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43868:x1876946704419456:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 588us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997360.259646:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 342 00000100:00100000:2.0:1789997360.263084:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997360.263139:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704419584 00000100:00100000:1.0:1789997360.263152:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704419584 00000100:00080000:0.0:1789997360.263220:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997360.263225:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 343 00000100:00100000:1.0:1789997360.263239:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43868:x1876946704419584:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997360.263877:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8034700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43868:x1876946704419584:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 640us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997360.263890:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 343 00000100:00100000:1.0:1789997360.266694:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997360.266807:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704419712 00000100:00100000:2.0:1789997360.266818:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704419712 00000100:00100000:2.0:1789997360.266878:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 656 00000100:00100000:2.0:1789997360.266890:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43868:x1876946704419712:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997360.267420:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43868:x1876946704419712:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 529us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997360.267429:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 656 00000100:00100000:0.0:1789997360.276198:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997360.277145:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704419840 00000100:00100000:2.0:1789997360.277156:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704419840 00000100:00100000:2.0:1789997360.277221:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 657 00000100:00100000:2.0:1789997360.277234:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43868:x1876946704419840:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997360.277349:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43868:x1876946704419840:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 117us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997360.277357:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 657 00000100:00100000:0.0:1789997360.284822:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997360.285051:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704419968 00000100:00100000:1.0:1789997360.285061:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704419968 00000100:00100000:1.0:1789997360.285123:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 344 00000100:00100000:1.0:1789997360.285135:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43868:x1876946704419968:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997360.285622:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:43868:x1876946704419968:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 487us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997360.285631:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 344 00000100:00100000:1.0:1789997360.287629:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997360.287740:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704420096 00000100:00100000:3.0:1789997360.287748:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704420096 00000100:00100000:3.0:1789997360.287801:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 345 00000100:00100000:3.0:1789997360.287812:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43868:x1876946704420096:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997360.289484:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:43868:x1876946704420096:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1669us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997360.289497:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 345 00000100:00100000:0.0:1789997360.295112:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997360.295169:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704420224 00000100:00100000:1.0:1789997360.295179:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704420224 00000100:00100000:1.0:1789997360.295250:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 658 00000100:00100000:1.0:1789997360.295262:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43868:x1876946704420224:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997360.296468:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43868:x1876946704420224:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 1205us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997360.296479:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 658 00000100:00100000:0.0:1789997360.358104:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997360.359831:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704420480 00000100:00100000:2.0:1789997360.359845:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704420480 00000100:00100000:2.0:1789997360.359920:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 659 00000100:00100000:2.0:1789997360.359931:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:43872:x1876946704420480:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:2.0:1789997360.359987:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997360.360016:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb06 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360037:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:2.0:1789997360.360048:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997360.360067:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360082:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360092:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360106:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360116:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360123:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360431:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360440:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.360447:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997360.363057:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:3.0:1789997360.363072:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1549055417229ns, next at 1550055413275ns, rc = 0 00010000:00010000:3.0:1789997360.363173:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363189:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363200:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363209:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363215:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363220:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363249:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997360.363280:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363287:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363293:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363300:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997360.363305:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363312:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363323:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:3.0:1789997360.363326:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997360.363331:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363337:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c28a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363355:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363360:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363366:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363371:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997360.363374:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363378:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363388:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:3.0:1789997360.363390:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997360.363393:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997360.363398:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592c27c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997360.363405:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014ca4429 reply state 00000000b2e6a0ca transno 4294967548 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997360.363413:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997360.363495:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:43872:x1876946704420480:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 3563us (5398us total) trans 4294967548 rc 0/0 00000100:00100000:3.0:1789997360.363502:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 659 00010000:00010000:2.0:1789997360.363696:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997360.363703:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.363710:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997360.363713:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.363720:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.363729:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:2.0:1789997360.363732:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997360.363734:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.363744:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c291 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.363759:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997360.363760:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997360.363762:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997360.367277:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.367295:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.367303:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.367309:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997360.367315:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.367324:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.367342:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0xa8fa037c (ffff8a38d0bdfb00) 00010000:00010000:2.0:1789997360.367351:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997360.367357:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997360.367364:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c283 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997360.906847:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997361.611061:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712934016:0@lo:400:kworker.0 00000100:00100000:1.0:1789997361.611136:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997361.611193:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712934016 00000100:00100000:2.0:1789997361.611203:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712934016 00000100:00100000:0.0:1789997361.611233:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712934144:0@lo:400:kworker.0 00000100:00100000:2.0:1789997361.611250:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1789997361.611259:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712934016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997361.611271:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997361.611299:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712934144 00000100:00100000:1.0:1789997361.611306:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712934144 00000100:00100000:2.0:1789997361.611322:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712934016:12345-0@lo:400:kworker.0 Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997361.611330:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:1.0:1789997361.611357:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789997361.611366:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712934144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997361.611411:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712934144:12345-0@lo:400:kworker.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997361.611420:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789997361.611453:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712934016:0@lo:400:kworker.0 00000100:00100000:2.0:1789997361.611751:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712934144:0@lo:400:kworker.0 00000100:00100000:0.0:1789997361.611834:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712934272:0@lo:400:kworker.0 00000100:00100000:0.0:1789997361.611870:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997361.611871:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712934656:0@lo:400:kworker.0 00000100:00100000:3.0:1789997361.611909:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997361.611911:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997361.611920:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712934400:0@lo:400:kworker.0 00000100:00100000:3.0:1789997361.611944:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997361.611953:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712934528:0@lo:400:kworker.0 00000100:00100000:0.0:1789997361.611958:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997361.611989:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997361.612026:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712934272 00000100:00100000:3.0:1789997361.612031:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712934272 00000100:00100000:3.0:1789997361.612070:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712934656 00000100:00100000:3.0:1789997361.612073:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712934656 00000100:00100000:3.0:1789997361.612096:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1789997361.612103:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712934272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997361.612108:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1789997361.612114:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712934656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997361.612140:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712934272:12345-0@lo:400:kworker.0 Request processed in 38us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997361.612146:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712934656:12345-0@lo:400:kworker.0 Request processed in 33us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997361.612150:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1789997361.612162:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1789997361.612170:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712934400 00000100:00100000:3.0:1789997361.612174:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712934400 00000100:00100000:1.0:1789997361.612189:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712934656:0@lo:400:kworker.0 00000100:00100000:2.0:1789997361.612204:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712934528 00000100:00100000:3.0:1789997361.612207:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1789997361.612211:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712934528 00000100:00100000:3.0:1789997361.612216:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712934400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997361.612248:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1789997361.612255:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712934400:12345-0@lo:400:kworker.0 Request processed in 39us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997361.612260:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712934528:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997361.612273:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997361.612278:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997361.612281:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997361.612302:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712934528:12345-0@lo:400:kworker.0 Request processed in 46us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997361.612310:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1789997361.612352:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1789997361.612392:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712934400:0@lo:400:kworker.0 00000100:00100000:3.0:1789997361.612401:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712934272:0@lo:400:kworker.0 00000100:00100000:0.0:1789997361.612468:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712934528:0@lo:400:kworker.0 00010000:00010000:2.0:1789997361.938373:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997361.972627:0:75653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1550664970406ns, next at 1550055413275ns, rc = 0 00000004:00080000:2.0:1789997362.005786:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 58 committed 00000001:00080000:2.0:1789997362.005832:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967548 is committed 00000004:00080000:2.0:1789997362.005838:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 57 committed 00000100:00100000:0.0:1789997362.006097:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997362.006118:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712934784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997362.006196:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997362.006771:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712934784 00000100:00100000:2.0:1789997362.006781:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712934784 00000100:00100000:2.0:1789997362.006840:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789997362.006849:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712934784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789997362.006877:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:20 count 1 00010000:00010000:2.0:1789997362.006908:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.006929:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.006939:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x14:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1789997362.006943:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997362.007044:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.007076:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.007091:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 5 pid: 6656 timeout: 1650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997362.007103:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c8035880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712934912:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997362.007222:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e01ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1789997362.021753:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997362.021881:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c8035880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712934912:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997362.021910:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997362.021990:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704420608 00000100:00100000:3.0:1789997362.021999:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704420608 00010000:00010000:3.0:1789997362.022058:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 6 pid: 6656 timeout: 1650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789997362.022109:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997362.022160:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 339 00000100:00100000:2.0:1789997362.022171:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704420608:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997362.022263:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997362.022271:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 6 pid: 6656 timeout: 1650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.022290:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 6 pid: 6656 timeout: 1650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.022313:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592c275 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb0d expref: 6 pid: 6656 timeout: 1650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.022331:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997362.022335:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997362.022340:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.022349:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997362.022378:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997362.022486:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997362.022496:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997362.022505:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997362.022512:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997362.022547:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789997362.023032:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704420608:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 861us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997362.023041:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 339 00010000:00010000:0.0:1789997362.023475:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997362.023483:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997362.023493:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997362.023498:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997362.023508:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997362.023529:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997362.023537:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c298 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997362.023556:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997362.023558:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997362.023560:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997362.024320:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712934784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17468us (18121us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789997362.024334:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000004:00080000:0.0:1789997362.024486:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38ffdfbb80/2, rc 0, transno 4294967337 00000100:00100000:0.0:1789997362.024602:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712934784:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789997362.025147:0:75653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1550717492649ns, next at 1543111274544ns, rc = 0 00000004:00080000:3.0:1789997362.030588:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 60 committed 00010000:00010000:0.0:1789997362.954904:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997363.480563:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997363.480613:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997363.480698:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704420736 00000100:00100000:3.0:1789997363.480709:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704420736 00000100:00100000:0.0:1789997363.480714:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997363.480764:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 968 00000100:00100000:2.0:1789997363.480770:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704421120 00000100:00100000:3.0:1789997363.480777:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704420736:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997363.480777:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704421120 00000100:00100000:1.0:1789997363.480837:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704420864 00000100:00100000:2.0:1789997363.480838:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 679 00000100:00100000:1.0:1789997363.480844:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704420864 00000100:00100000:2.0:1789997363.480851:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704421120:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997363.480888:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1124 00000100:00100000:1.0:1789997363.480898:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704420864:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997363.480941:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704420864:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997363.480945:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704421120:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997363.480953:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1124 00000100:00100000:2.0:1789997363.480958:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 679 00000100:00080000:0.0:1789997363.481141:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997363.481147:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997363.481243:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704420736:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 470us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997363.481250:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 968 00000100:00100000:2.0:1789997363.483746:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997363.485879:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704420992 00000100:00100000:1.0:1789997363.485894:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704420992 00000100:00100000:1.0:1789997363.485968:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 680 00000100:00100000:1.0:1789997363.485979:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c8035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704420992:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997363.486069:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c8035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704420992:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 91us (2330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997363.486076:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 680 00000100:00100000:0.0:1789997363.658961:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712935040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997363.658990:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712935168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997363.659042:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997363.659147:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997363.659178:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712935168 00000100:00100000:0.0:1789997363.659186:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712935168 00000100:00100000:0.0:1789997363.659257:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712935040 00000100:00100000:0.0:1789997363.659261:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712935040 00000100:00080000:1.0:1789997363.659263:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997363.659271:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997363.659287:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:0.0:1789997363.659296:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712935168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997363.659327:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789997363.659458:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1789997363.659471:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712935040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997363.659491:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997363.659510:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712935168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 213us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997363.659520:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1789997363.659604:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712935040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997363.659623:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00100000:1.0:1789997363.659878:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712935168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997363.660335:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712935040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997363.980276:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997365.003069:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997365.264778:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 00010000:00010000:0.0:1789997366.028159:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997366.730877:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712935296:0@lo:400:kworker.0 00000100:00100000:1.0:1789997366.730952:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997366.731111:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712935296 00000100:00100000:0.0:1789997366.731120:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712935296 00000100:00100000:0.0:1789997366.731168:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1789997366.731177:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712935296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731290:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712935424:0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731324:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997366.731350:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997366.731356:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712935552:0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731390:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997366.731430:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712935424 00000100:00100000:2.0:1789997366.731439:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712935424 00000100:00100000:2.0:1789997366.731469:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712935552 00000100:00100000:2.0:1789997366.731472:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712935552 00000100:00100000:2.0:1789997366.731498:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1789997366.731504:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712935424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731566:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712935424:12345-0@lo:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997366.731573:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1789997366.731590:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1789997366.731597:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712935552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731624:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712935552:12345-0@lo:400:kworker.0 Request processed in 28us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997366.731630:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1789997366.731697:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712935552:0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731710:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712935424:0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731786:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712935680:0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731821:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997366.731853:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712935680 00000100:00100000:2.0:1789997366.731857:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712935680 00000100:00100000:2.0:1789997366.731885:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1789997366.731899:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712935680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.731935:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712935680:12345-0@lo:400:kworker.0 Request processed in 44us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997366.731942:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1789997366.731967:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:2.0:1789997366.731972:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38ffdfbb80, transno 4294967337 00000100:00100000:2.0:1789997366.731984:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712935680:0@lo:400:kworker.0 00000100:00080000:2.0:1789997366.732364:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997366.732369:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997366.732862:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997366.732875:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712935936:0@lo:400:kworker.0 00000100:00100000:3.0:1789997366.732975:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997366.733096:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712935936 00000100:00100000:3.0:1789997366.733102:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712935936 00000100:00100000:3.0:1789997366.733142:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1789997366.733150:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712935936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.733205:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997366.733215:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712935808:0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.733244:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789997366.733273:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997366.733298:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712935936:0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.733333:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712935808 00000100:00100000:2.0:1789997366.733336:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712935808 00000100:00100000:2.0:1789997366.733375:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1789997366.733382:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712935808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997366.733419:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712935808:12345-0@lo:400:kworker.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997366.733427:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00080000:2.0:1789997366.733445:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997366.733464:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712935808:0@lo:400:kworker.0 00000100:00100000:3.0:1789997366.733507:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712935936:12345-0@lo:400:kworker.0 Request processed in 40us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997366.733516:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1789997366.734032:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712935296:12345-0@lo:400:kworker.0 Request processed in 2854us (3078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997366.734041:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1789997366.734150:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712935296:0@lo:400:kworker.0 00010000:00010000:2.0:1789997367.051225:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997368.075006:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997368.603325:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997368.603421:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704421376 00000100:00100000:3.0:1789997368.603434:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704421376 00000100:00100000:0.0:1789997368.603573:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1128 00000100:00100000:0.0:1789997368.603589:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704421376:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997368.603878:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704421376:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 293us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997368.603887:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1128 00000100:00100000:3.0:1789997368.604037:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997368.604258:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704421632 00000100:00100000:0.0:1789997368.604263:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704421632 00000100:00100000:0.0:1789997368.604305:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 683 00000100:00100000:0.0:1789997368.604313:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704421632:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997368.604350:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704421632:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997368.604356:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 683 00000100:00080000:2.0:1789997368.606198:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997368.606207:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997368.607536:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997368.607635:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997368.607919:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704421504 00000100:00100000:2.0:1789997368.607940:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704421504 00000100:00100000:2.0:1789997368.608152:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 684 00000100:00080000:3.0:1789997368.608153:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997368.608167:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704421504:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997368.608248:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704421504:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997368.608393:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704421248 00000100:00100000:0.0:1789997368.608400:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704421248 00000100:00100000:0.0:1789997368.608439:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 970 00000100:00100000:0.0:1789997368.608447:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704421248:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997368.608484:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704421248:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997368.608491:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 970 00000100:00100000:2.0:1789997368.613922:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 684 00000100:00100000:2.0:1789997368.779824:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712936064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997368.779896:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997368.780098:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712936192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997368.780128:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997368.780541:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712936064 00000100:00100000:0.0:1789997368.780550:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712936064 00000100:00100000:0.0:1789997368.780608:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712936192 00000100:00100000:0.0:1789997368.780611:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712936192 00000100:00100000:0.0:1789997368.780630:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1789997368.780639:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712936064:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997368.780678:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:1.0:1789997368.780691:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712936192:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997368.780712:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997368.780718:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789997368.780723:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997368.780772:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712936192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997368.780780:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00002000:00000024:0.0:1789997368.780784:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997368.780827:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712936064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997368.780834:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:3.0:1789997368.780862:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712936192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997368.780881:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712936064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789997369.099292:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997370.125534:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997371.147688:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997371.851917:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712936704:0@lo:400:kworker.0 00000100:00100000:2.0:1789997371.851930:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712936448:0@lo:400:kworker.0 00000100:00100000:0.0:1789997371.852029:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712936576:0@lo:400:kworker.0 00000100:00100000:2.0:1789997371.852518:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997371.852923:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712936960:0@lo:400:kworker.0 00000100:00100000:3.0:1789997371.852928:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997371.852970:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997371.852976:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789997371.852987:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712936320:0@lo:400:kworker.0 00000100:00100000:2.0:1789997371.853019:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712936448 00000100:00100000:3.0:1789997371.853026:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997371.853029:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712936448 00000100:00100000:1.0:1789997371.853057:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712936960 00000100:00100000:3.0:1789997371.853066:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712936832:0@lo:400:kworker.0 00000100:00100000:1.0:1789997371.853073:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712936960 00000100:00100000:2.0:1789997371.853085:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1789997371.853099:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997371.853101:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712936448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997371.853125:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1789997371.853137:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712936960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997371.853150:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712936704 00000100:00100000:3.0:1789997371.853155:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712936704 00000100:00100000:2.0:1789997371.853166:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712936448:12345-0@lo:400:kworker.0 Request processed in 71us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997371.853175:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1789997371.853193:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712936960:12345-0@lo:400:kworker.0 Request processed in 59us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997371.853195:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712936832 00000100:00100000:3.0:1789997371.853200:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712936832 00000100:00100000:1.0:1789997371.853205:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1789997371.853208:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712936320 00000100:00100000:2.0:1789997371.853214:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712936320 00000100:00080000:1.0:1789997371.853232:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997371.853234:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00080000:1.0:1789997371.853240:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997371.853245:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997371.853246:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712936704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997371.853333:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997371.853346:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1789997371.853358:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712936832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997371.853398:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712936832:12345-0@lo:400:kworker.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997371.853404:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1789997371.853419:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1789997371.853420:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712936704:12345-0@lo:400:kworker.0 Request processed in 47us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997371.853430:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1789997371.853433:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712936320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997371.853467:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712936576 00000100:00100000:3.0:1789997371.853472:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712936576 00000100:00100000:2.0:1789997371.853485:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712936320:12345-0@lo:400:kworker.0 Request processed in 55us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997371.853493:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1789997371.853521:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1789997371.853531:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712936576:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997371.853556:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997371.853560:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712936448:0@lo:400:kworker.0 00000100:00100000:2.0:1789997371.853905:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712936960:0@lo:400:kworker.0 00000100:00100000:0.0:1789997371.854042:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712936576:0@lo:400:kworker.0 00000100:00100000:3.0:1789997371.854051:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712936576:12345-0@lo:400:kworker.0 Request processed in 520us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997371.854061:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712936320:0@lo:400:kworker.0 00000100:00100000:3.0:1789997371.854064:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1789997371.854085:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712936832:0@lo:400:kworker.0 00000100:00100000:2.0:1789997371.854100:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712936704:0@lo:400:kworker.0 00010000:00010000:0.0:1789997372.170916:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997373.195126:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997373.719696:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997373.719767:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997373.719868:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704421760 00000100:00100000:0.0:1789997373.719879:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704421760 00000100:00100000:0.0:1789997373.719943:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 972 00000100:00100000:0.0:1789997373.719954:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704421760:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997373.720025:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704421760:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997373.720033:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 972 00000100:00100000:3.0:1789997373.720232:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997373.720278:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997373.720340:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704422016 00000100:00100000:0.0:1789997373.720344:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704422016 00000100:00100000:0.0:1789997373.720389:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704422144 00000100:00100000:0.0:1789997373.720393:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704422144 00000100:00100000:0.0:1789997373.720425:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 687 00000100:00100000:0.0:1789997373.720433:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704422016:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997373.720469:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704422016:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997373.720488:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 687 00000100:00080000:3.0:1789997373.720495:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997373.720499:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997373.720500:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 688 00000100:00100000:0.0:1789997373.720507:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704422144:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997373.720533:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704422144:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997373.720539:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 688 00000100:00100000:2.0:1789997373.721553:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704421888 00000100:00100000:2.0:1789997373.721562:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704421888 00000100:00080000:0.0:1789997373.721857:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997373.721983:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1132 00000100:00100000:1.0:1789997373.721995:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704421888:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997373.722745:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704421888:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 751us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997373.722757:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1132 00000100:00100000:3.0:1789997373.898847:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997373.898855:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997373.898871:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712937088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997373.898872:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712937216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997373.898951:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997373.899000:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712937088 00000100:00100000:2.0:1789997373.899010:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712937088 00000100:00100000:2.0:1789997373.899130:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:2.0:1789997373.899142:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712937088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997373.899200:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997373.899241:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997373.899272:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712937088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997373.899280:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1789997373.899287:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712937216 00000100:00100000:1.0:1789997373.899292:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712937216 00000100:00100000:1.0:1789997373.899340:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 574 00000100:00080000:0.0:1789997373.899347:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997373.899350:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712937216:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997373.899353:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789997373.899372:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997373.899432:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712937216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997373.899440:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 574 00000100:00100000:0.0:1789997373.899473:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712937216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997373.899505:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712937088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997374.219485:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997375.242987:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997376.266989:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997376.971396:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712937472:0@lo:400:kworker.0 00000100:00100000:0.0:1789997376.971396:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712937344:0@lo:400:kworker.0 00000100:00100000:1.0:1789997376.971405:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712937728:0@lo:400:kworker.0 00000100:00100000:2.0:1789997376.971470:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712937600:0@lo:400:kworker.0 00000100:00100000:3.0:1789997376.972295:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997376.972368:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712937984:0@lo:400:kworker.0 00000100:00100000:3.0:1789997376.972398:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997376.972447:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712937472 00000100:00100000:3.0:1789997376.972455:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712937472 00000100:00100000:3.0:1789997376.972497:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712937984 00000100:00100000:3.0:1789997376.972501:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712937984 00000100:00100000:3.0:1789997376.972532:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1789997376.972542:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712937472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997376.972594:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712937472:12345-0@lo:400:kworker.0 Request processed in 54us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997376.972601:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1789997376.972617:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1789997376.972624:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712937984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997376.972682:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712937984:12345-0@lo:400:kworker.0 Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997376.972688:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1789997376.972732:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712937472:0@lo:400:kworker.0 00000100:00100000:3.0:1789997376.972742:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712937984:0@lo:400:kworker.0 00000100:00080000:3.0:1789997376.973076:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997376.975022:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997376.975286:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712937856:0@lo:400:kworker.0 00000100:00100000:0.0:1789997376.975333:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997376.975399:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712937856 00000100:00100000:3.0:1789997376.975403:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712937344 00000100:00100000:0.0:1789997376.975407:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712937856 00000100:00100000:3.0:1789997376.975410:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712937344 00000100:00100000:3.0:1789997376.975461:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:0.0:1789997376.975465:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1789997376.975474:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712937344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997376.975480:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712937856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997376.977058:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997376.977125:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712937600 00000100:00100000:2.0:1789997376.977131:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712937600 00000100:00100000:2.0:1789997376.977180:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1789997376.977189:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712937600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997376.977412:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712937600:12345-0@lo:400:kworker.0 Request processed in 223us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997376.977420:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1789997376.977473:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712937600:0@lo:400:kworker.0 00000100:00080000:2.0:1789997376.977695:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997376.977700:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997376.977727:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712937344:0@lo:400:kworker.0 00000100:00100000:2.0:1789997376.977739:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712937856:0@lo:400:kworker.0 00000100:00100000:3.0:1789997376.979318:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712937344:12345-0@lo:400:kworker.0 Request processed in 3842us (4294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997376.979330:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1789997376.979787:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997376.979897:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712937728 00000100:00100000:2.0:1789997376.979906:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712937728 00000100:00100000:2.0:1789997376.979965:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1789997376.979974:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712937728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997376.980032:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712937728:12345-0@lo:400:kworker.0 Request processed in 59us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997376.980041:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1789997376.980076:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712937728:0@lo:400:kworker.0 00000100:00080000:3.0:1789997376.980117:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997376.980433:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712937856:12345-0@lo:400:kworker.0 Request processed in 4957us (5097us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997376.980442:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00010000:00010000:0.0:1789997377.291339:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997377.997874:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997377.998873:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704422272 00000100:00100000:0.0:1789997377.998887:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704422272 00000100:00100000:0.0:1789997377.998980:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 660 00000100:00080000:3.0:1789997377.999107:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997377.999201:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44130:x1876946704422272:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997377.999329:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44130:x1876946704422272:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 339us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997377.999349:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 660 00000100:00100000:0.0:1789997378.001142:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997378.001497:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704422400 00000100:00100000:2.0:1789997378.001507:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704422400 00000100:00100000:2.0:1789997378.001580:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 347 00000100:00100000:2.0:1789997378.001590:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:44130:x1876946704422400:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:3.0:1789997378.001596:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997378.002564:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:44130:x1876946704422400:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 971us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997378.002575:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 347 00000100:00100000:3.0:1789997378.005091:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997378.005473:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704422528 00000100:00100000:2.0:1789997378.005483:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704422528 00000100:00100000:0.0:1789997378.005604:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 348 00000100:00100000:0.0:1789997378.005617:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:44130:x1876946704422528:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:3.0:1789997378.005781:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997378.006241:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:44130:x1876946704422528:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 623us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997378.006250:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 348 00000100:00100000:3.0:1789997378.009183:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997378.009414:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704422656 00000100:00100000:0.0:1789997378.009425:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704422656 00000100:00100000:0.0:1789997378.009489:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 661 00000100:00100000:0.0:1789997378.009505:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44130:x1876946704422656:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997378.010024:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44130:x1876946704422656:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 518us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997378.010033:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 661 00000100:00100000:3.0:1789997378.017228:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997378.017444:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704422784 00000100:00100000:2.0:1789997378.017456:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704422784 00000100:00100000:2.0:1789997378.017528:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 662 00000100:00100000:2.0:1789997378.017539:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44130:x1876946704422784:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997378.017884:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44130:x1876946704422784:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 346us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997378.017892:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 662 00000100:00100000:1.0:1789997378.020963:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997378.021127:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704422912 00000100:00100000:2.0:1789997378.021136:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704422912 00000100:00100000:2.0:1789997378.021254:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 349 00000100:00100000:2.0:1789997378.021266:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:44130:x1876946704422912:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997378.021697:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:44130:x1876946704422912:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 433us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997378.021704:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 349 00000100:00100000:0.0:1789997378.028688:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997378.028884:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704423040 00000100:00100000:2.0:1789997378.028895:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704423040 00000100:00100000:2.0:1789997378.029019:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 350 00000100:00100000:2.0:1789997378.029033:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:44130:x1876946704423040:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997378.029450:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:44130:x1876946704423040:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 419us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997378.029459:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 350 00000100:00100000:3.0:1789997378.031235:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997378.031371:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704423168 00000100:00100000:1.0:1789997378.031379:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704423168 00000100:00100000:1.0:1789997378.031431:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 663 00000100:00100000:1.0:1789997378.031441:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44130:x1876946704423168:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997378.032190:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44130:x1876946704423168:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 748us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997378.032199:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 663 00000100:00100000:1.0:1789997378.063823:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997378.063894:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704423296 00000100:00100000:0.0:1789997378.063903:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704423296 00000100:00100000:0.0:1789997378.063962:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 664 00000100:00100000:0.0:1789997378.063973:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:44131:x1876946704423296:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997378.063996:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997378.064017:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c29f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb14 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.064088:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c2a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.064102:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.064115:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997378.064149:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00000004:00200000:0.0:1789997378.064153:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997378.064172:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.064197:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c29f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb14 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.064227:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb14 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.064236:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:0.0:1789997378.064239:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997378.064243:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e800, rc 0) 00000100:00100000:0.0:1789997378.064311:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:44131:x1876946704423296:12345-192.168.204.4@tcp:101:rm.0 Request processed in 339us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997378.064318:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 664 00000100:00100000:0.0:1789997378.071356:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997378.071767:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704423552 00000100:00100000:1.0:1789997378.071780:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704423552 00000100:00100000:1.0:1789997378.071845:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 665 00000100:00100000:1.0:1789997378.071856:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:44131:x1876946704423552:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997378.071876:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997378.071901:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c2ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb1b expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997378.072009:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 16384 00010000:00010000:1.0:1789997378.072270:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c2ad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb1b expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997378.072284:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:1.0:1789997378.072287:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789997378.072292:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c2ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb1b expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997378.072308:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997378.072383:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:44131:x1876946704423552:12345-192.168.204.4@tcp:101:rm.0 Request processed in 529us (1037us total) trans 4294967549 rc 301/301 00000100:00100000:1.0:1789997378.072390:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 665 00000100:00100000:3.0:1789997378.076771:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997378.076997:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704423680 00000100:00100000:1.0:1789997378.077007:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704423680 00000100:00100000:1.0:1789997378.077079:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:1.0:1789997378.077091:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:44131:x1876946704423680:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:1.0:1789997378.086603:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:44131:x1876946704423680:12345-192.168.204.4@tcp:37:rm.0 Request processed in 9503us (9830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997378.086617:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 70 00000100:00100000:1.0:1789997378.097086:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997378.097270:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704423936 00000100:00100000:2.0:1789997378.097281:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704423936 00000100:00100000:2.0:1789997378.097353:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:2.0:1789997378.097380:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:44131:x1876946704423936:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:2.0:1789997378.097974:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:44131:x1876946704423936:12345-192.168.204.4@tcp:35:rm.0 Request processed in 609us (896us total) trans 4294967550 rc 0/0 00000100:00100000:2.0:1789997378.097983:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 71 00000100:00100000:3.0:1789997378.101770:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997378.104146:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704424192 00000100:00100000:0.0:1789997378.104163:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704424192 00000100:00100000:0.0:1789997378.104225:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 666 00000100:00100000:0.0:1789997378.104234:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:44131:x1876946704424192:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789997378.104292:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789997378.104319:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c2a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb14 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.104359:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c24b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeaff expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.104369:0:5810:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592beaf) 00010000:00010000:0.0:1789997378.104373:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:0.0:1789997378.104383:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997378.104410:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.104424:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.104435:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.104446:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.104453:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.104459:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.105857:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.105874:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.105885:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.105923:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.105931:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.105953:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.105964:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997378.105969:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.105976:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106223:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997378.106227:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997378.106233:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106239:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c2c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106261:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106267:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106273:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106278:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997378.106281:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106287:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106300:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997378.106303:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997378.106306:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106311:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c2bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106324:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106340:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106346:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106352:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997378.106354:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106360:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106367:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997378.106368:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997378.106371:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997378.106377:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c2c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997378.106482:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:44131:x1876946704424192:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2245us (4717us total) trans 0 rc -13/-13 00000100:00100000:0.0:1789997378.106490:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 666 00010000:00010000:1.0:1789997378.316793:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997378.845233:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997378.845311:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704424320 00000100:00100000:0.0:1789997378.845331:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704424320 00000100:00100000:0.0:1789997378.845396:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 974 00000100:00100000:0.0:1789997378.845407:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704424320:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997378.845477:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704424320:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997378.845485:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 974 00000100:00100000:0.0:1789997379.018931:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712938112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997379.019010:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997379.019283:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712938240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997379.019323:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997379.019398:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712938112 00000100:00100000:3.0:1789997379.019407:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712938112 00000100:00100000:3.0:1789997379.019463:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712938240 00000100:00100000:3.0:1789997379.019466:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712938240 00000100:00100000:3.0:1789997379.019484:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1789997379.019494:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712938112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997379.019530:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997379.019580:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712938112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997379.019587:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00000100:00100000:3.0:1789997379.019603:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1789997379.019609:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712938240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997379.019624:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997379.019682:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712938240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997379.019689:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:3.0:1789997379.019728:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712938240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997379.019761:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712938112:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997379.019870:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997379.019874:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1789997379.207058:0:75919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfbe7f120 20000000:00000080:2.0:1789997379.207077:0:75919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e7800 uarg=0000000000000000 00010000:00010000:2.0:1789997379.211074:0:75919:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997379.211097:0:75919:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997379.211140:0:75919:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997379.211162:0:75919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997379.211180:0:75919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c228 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997379.211188:0:75919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997379.211230:0:75919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c228 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997379.211246:0:75919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c228 expref: 18 pid: 7594 timeout: 1717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997379.211260:0:75919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75919:1876946712938368:0@lo:104: 00000100:00100000:2.0:1789997379.211345:0:75919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997379.211495:0:75919:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa7b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997379.211890:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712938368 00000100:00100000:0.0:1789997379.211899:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712938368 00000100:00100000:0.0:1789997379.212006:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789997379.212018:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:75919:x1876946712938368:12345-0@lo:104: 00010000:00010000:0.0:1789997379.212033:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997379.212108:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997379.212115:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:75919:x1876946712938368:12345-0@lo:104: Request processed in 100us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997379.212122:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00010000:00010000:1.0:1789997379.212172:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997379.212179:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212187:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997379.212191:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212199:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997379.212207:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997379.212213:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997379.212245:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212252:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997379.212273:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212279:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b600/0x65b43101d592c228 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c22f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212295:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997379.212297:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997379.212299:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997379.212330:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712938496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997379.212365:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997379.212418:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712938496 00000100:00100000:1.0:1789997379.212423:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712938496 00010000:00010000:1.0:1789997379.212443:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c228 expref: 19 pid: 7594 timeout: 1717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997379.212479:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789997379.212486:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712938496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997379.212496:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997379.212501:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c228 expref: 19 pid: 7594 timeout: 1717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212511:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c228 expref: 19 pid: 7594 timeout: 1717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212528:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212536:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212550:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212558:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212565:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212572:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212578:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997379.212582:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212590:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212599:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997379.212608:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997379.212637:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712938496:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997379.212643:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789997379.212707:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712938496:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997379.212913:0:75919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c22f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c228 expref: 18 pid: 7594 timeout: 1717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997379.212925:0:75919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75919:1876946712938368:0@lo:104: 00010000:00010000:2.0:1789997379.212937:0:75919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997379.212946:0:75919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997379.212952:0:75919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997379.212959:0:75919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c2d0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.341249:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997379.831882:0:75967:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd062f1360 20000000:00000080:3.0:1789997379.831898:0:75967:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb46fc00 uarg=0000000000000000 00010000:00010000:3.0:1789997379.832147:0:75967:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997379.832164:0:75967:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997379.832185:0:75967:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997379.832204:0:75967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832219:0:75967:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832229:0:75967:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832236:0:75967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832243:0:75967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832251:0:75967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832257:0:75967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997379.832261:0:75967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832269:0:75967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832282:0:75967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832290:0:75967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997379.832308:0:75967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b800/0x65b43101d592c2d7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.362890:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997380.532742:0:76015:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff855d5070 20000000:00000080:1.0:1789997380.532761:0:76015:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38ffd84000 uarg=0000000000000000 00010000:00010000:1.0:1789997380.532990:0:76015:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997380.533006:0:76015:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997380.533024:0:76015:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997380.533045:0:76015:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533060:0:76015:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533071:0:76015:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533080:0:76015:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533087:0:76015:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533094:0:76015:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533100:0:76015:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997380.533104:0:76015:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533113:0:76015:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533126:0:76015:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533134:0:76015:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.533139:0:76015:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592c2de lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76015 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997380.938730:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997380.938751:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997380.938756:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997380.938806:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.938823:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.938836:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997380.938860:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712938624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997380.938940:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997380.939001:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60900 going to sleep for 11 seconds 00000100:00100000:2.0:1789997380.939233:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712938624 00000100:00100000:2.0:1789997380.939243:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712938624 00000100:00100000:2.0:1789997380.939314:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1789997380.939324:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712938624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997380.939338:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997380.939352:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c2e5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997380.939375:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997380.939385:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997380.939395:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2a00, rc 0) 00000100:00100000:2.0:1789997380.939487:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712938624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997380.939494:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1789997380.941292:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712938624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997380.941320:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.941332:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997380.941355:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997380.941361:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997380.941368:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997381.386900:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997382.093142:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712938752:0@lo:400:kworker.0 00000100:00100000:3.0:1789997382.093229:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997382.093317:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712939264:0@lo:400:kworker.0 00000100:00100000:3.0:1789997382.093354:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997382.093381:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789997382.093390:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712938880:0@lo:400:kworker.0 00000100:00100000:3.0:1789997382.093423:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997382.093453:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712939392:0@lo:400:kworker.0 00000100:00100000:3.0:1789997382.093481:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997382.093526:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712938880 00000100:00100000:3.0:1789997382.093541:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712938880 00000100:00100000:3.0:1789997382.093596:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712939392 00000100:00100000:3.0:1789997382.093600:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712939392 00000100:00100000:0.0:1789997382.093687:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712939008:0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.093724:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997382.093756:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997382.093765:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712939136:0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.093793:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997382.093797:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712939008 00000100:00100000:3.0:1789997382.093803:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712939008 00000100:00100000:0.0:1789997382.093835:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712938752 00000100:00100000:0.0:1789997382.093840:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712938752 00000100:00100000:0.0:1789997382.093879:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1789997382.093899:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1789997382.093900:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712938752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997382.093914:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712938880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.093964:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712938752:12345-0@lo:400:kworker.0 Request processed in 76us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997382.093974:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1789997382.093979:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712938880:12345-0@lo:400:kworker.0 Request processed in 68us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997382.093989:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1789997382.094017:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1789997382.094018:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712939264 00000100:00100000:0.0:1789997382.094023:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712939264 00000100:00100000:3.0:1789997382.094033:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712939392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.094063:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712939136 00000100:00100000:0.0:1789997382.094067:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712939136 00000100:00100000:3.0:1789997382.094077:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712939392:12345-0@lo:400:kworker.0 Request processed in 48us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997382.094085:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1789997382.094101:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1789997382.094110:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1789997382.094115:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712939264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997382.094125:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712939008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.094161:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712939264:12345-0@lo:400:kworker.0 Request processed in 51us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997382.094168:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1789997382.094176:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712939008:12345-0@lo:400:kworker.0 Request processed in 55us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997382.094184:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1789997382.094185:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1789997382.094195:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712939136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.094226:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712939136:12345-0@lo:400:kworker.0 Request processed in 34us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997382.094235:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00080000:0.0:1789997382.094417:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997382.094422:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997382.094425:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997382.094465:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712939136:0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.094477:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712939008:0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.094692:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712938880:0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.094705:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712939392:0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.094714:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712939264:0@lo:400:kworker.0 00000100:00100000:0.0:1789997382.094722:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712938752:0@lo:400:kworker.0 00010000:00010000:3.0:1789997382.411969:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997382.646365:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967549 is committed 00000001:00080000:3.0:1789997382.646400:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967550 is committed 00000020:00000080:3.0:1789997383.390472:0:76212:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccc68a850 20000000:00000080:3.0:1789997383.390518:0:76212:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38ffd84800 uarg=0000000000000000 00010000:00010000:3.0:1789997383.391049:0:76212:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997383.391063:0:76212:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997383.391079:0:76212:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997383.391095:0:76212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997383.391109:0:76212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997383.391117:0:76212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997383.391155:0:76212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997383.391169:0:76212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 18 pid: 5803 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997383.391182:0:76212:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76212:1876946712939520:0@lo:104: 00000100:00100000:3.0:1789997383.391936:0:76212:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997383.392045:0:76212:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a390207bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997383.392145:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712939520 00000100:00100000:1.0:1789997383.392152:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712939520 00000100:00100000:1.0:1789997383.392205:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789997383.392214:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:76212:x1876946712939520:12345-0@lo:104: 00010000:00010000:1.0:1789997383.392236:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997383.392356:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997383.392362:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:76212:x1876946712939520:12345-0@lo:104: Request processed in 150us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997383.392369:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00010000:0.0:1789997383.392460:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997383.392467:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392474:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997383.392479:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392487:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997383.392495:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997383.392501:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997383.392544:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392551:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997383.392580:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392588:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3e00/0x65b43101d592c2e5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c2ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392601:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997383.392603:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997383.392605:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997383.392612:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997383.392624:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712939648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997383.392683:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997383.392716:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712939648 00000100:00100000:0.0:1789997383.392719:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712939648 00010000:00010000:0.0:1789997383.392738:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 19 pid: 5803 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997383.392759:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789997383.392764:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712939648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997383.392779:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997383.392784:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 19 pid: 5803 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392793:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 19 pid: 5803 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392808:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392817:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392833:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392839:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392845:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392851:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392856:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997383.392859:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392866:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392875:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997383.392883:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997383.392910:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712939648:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997383.392916:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789997383.392950:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712939648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997383.393272:0:76212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592c2ec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c2e5 expref: 18 pid: 5803 timeout: 1722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997383.393283:0:76212:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76212:1876946712939520:0@lo:104: 00010000:00010000:2.0:1789997383.393297:0:76212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997383.393381:0:76212:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997383.393389:0:76212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997383.393396:0:76212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b400/0x65b43101d592c2f3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997383.436182:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997383.959004:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997383.959055:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997383.959124:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997383.959174:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997383.959395:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704424448 00000100:00100000:2.0:1789997383.959406:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704424448 00000100:00100000:2.0:1789997383.959465:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 977 00000100:00100000:2.0:1789997383.959476:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704424448:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997383.959555:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704424448:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 81us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997383.959564:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 977 00000100:00100000:1.0:1789997383.959773:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704424576 00000100:00100000:1.0:1789997383.959778:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704424576 00000100:00100000:1.0:1789997383.959838:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1139 00000100:00100000:1.0:1789997383.959847:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704424576:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997383.959888:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704424576:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997383.959895:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1139 00000100:00100000:0.0:1789997383.960473:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704424704 00000100:00100000:0.0:1789997383.960479:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704424704 00000100:00100000:0.0:1789997383.960520:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704424832 00000100:00100000:0.0:1789997383.960523:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704424832 00000100:00100000:0.0:1789997383.960547:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 693 00000100:00100000:0.0:1789997383.960554:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704424704:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997383.960593:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704424704:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997383.960600:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 693 00000100:00100000:0.0:1789997383.960612:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 694 00000100:00100000:0.0:1789997383.960618:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704424832:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997383.960641:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704424832:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997383.960647:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 694 00000100:00080000:2.0:1789997383.960841:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997383.960845:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997383.960848:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997384.141381:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997384.141407:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712939776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997384.141478:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997384.141543:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712939776 00000100:00100000:1.0:1789997384.141552:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712939776 00000100:00100000:1.0:1789997384.141605:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1789997384.141614:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712939776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997384.141649:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997384.141711:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712939776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997384.141719:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1789997384.141769:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712939776:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997384.141946:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997384.142400:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997384.147068:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712939904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997384.147235:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997384.148981:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712939904 00000100:00100000:0.0:1789997384.148994:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712939904 00000100:00100000:1.0:1789997384.149417:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1789997384.149429:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712939904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997384.149469:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997384.149547:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712939904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997384.149555:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:2.0:1789997384.149616:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997384.149709:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712939904:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1789997384.458712:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997384.458731:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997384.458735:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997384.458779:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997384.458790:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997384.458801:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997384.459264:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712940032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997384.459349:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997384.459408:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61a80 going to sleep for 11 seconds 00010000:00010000:3.0:1789997384.459751:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997384.461354:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712940032 00000100:00100000:2.0:1789997384.461370:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712940032 00000100:00100000:2.0:1789997384.461438:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1789997384.461449:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712940032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997384.461465:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997384.461484:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c2fa expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997384.461518:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c2fa expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997384.461531:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c2fa expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997384.461540:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2000, rc 0) 00000100:00100000:2.0:1789997384.461625:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712940032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997384.461633:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1789997384.462018:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712940032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997384.462048:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997384.462058:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997384.462079:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997384.462084:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997384.462091:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997385.488703:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997386.508270:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997387.211408:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712940288:0@lo:400:kworker.0 00000100:00100000:0.0:1789997387.211412:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712940416:0@lo:400:kworker.0 00000100:00100000:1.0:1789997387.211502:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712940544:0@lo:400:kworker.0 00000100:00100000:1.0:1789997387.211561:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997387.211562:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997387.211624:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712940160:0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.211732:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712940800:0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.211755:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997387.211795:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712940288 00000100:00100000:3.0:1789997387.211802:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712940288 00000100:00100000:3.0:1789997387.211840:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712940800 00000100:00100000:3.0:1789997387.211842:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712940800 00000100:00100000:3.0:1789997387.211871:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1789997387.211879:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712940288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.211931:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712940288:12345-0@lo:400:kworker.0 Request processed in 52us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997387.212051:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1789997387.212072:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1789997387.212079:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712940800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.212108:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712940800:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997387.212113:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00080000:3.0:1789997387.212130:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997387.212276:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712940288:0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.212291:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712940800:0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.212461:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712940544 00000100:00100000:3.0:1789997387.212466:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712940544 00000100:00100000:3.0:1789997387.212499:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1789997387.212505:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712940544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.212539:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712940544:12345-0@lo:400:kworker.0 Request processed in 34us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997387.212545:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00080000:3.0:1789997387.212563:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997387.212582:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997387.212619:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712940416 00000100:00100000:3.0:1789997387.212624:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712940416 00000100:00100000:3.0:1789997387.212689:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1789997387.212698:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712940416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.212746:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712940416:12345-0@lo:400:kworker.0 Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997387.212752:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1789997387.212763:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712940416:0@lo:400:kworker.0 00000100:00080000:3.0:1789997387.212771:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997387.212929:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997387.212973:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712940672:0@lo:400:kworker.0 00000100:00100000:2.0:1789997387.213000:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997387.213140:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712940160 00000100:00100000:3.0:1789997387.213145:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712940160 00000100:00100000:3.0:1789997387.213187:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1789997387.213195:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712940160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997387.213236:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712940160:12345-0@lo:400:kworker.0 Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997387.213243:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1789997387.213337:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712940160:0@lo:400:kworker.0 00000100:00100000:0.0:1789997387.213431:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712940672 00000100:00100000:0.0:1789997387.213436:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712940672 00000100:00100000:0.0:1789997387.213480:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1789997387.213487:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712940672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997387.213523:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712940672:12345-0@lo:400:kworker.0 Request processed in 37us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997387.213533:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1789997387.213680:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712940672:0@lo:400:kworker.0 00000100:00080000:3.0:1789997387.213754:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997387.214048:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712940544:0@lo:400:kworker.0 00010000:00010000:0.0:1789997387.530916:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997388.554847:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997389.082752:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997389.082801:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997389.082840:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997389.082884:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997389.082921:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704425216 00000100:00100000:2.0:1789997389.082931:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704425216 00000100:00100000:2.0:1789997389.082987:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704425344 00000100:00100000:2.0:1789997389.082991:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704425344 00000100:00100000:2.0:1789997389.083014:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 697 00000100:00100000:2.0:1789997389.083025:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704425216:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997389.083126:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704425216:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 90us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997389.083134:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 697 00000100:00100000:2.0:1789997389.083151:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 698 00000100:00100000:2.0:1789997389.083158:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704425344:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997389.083184:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704425344:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997389.083191:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 698 00000100:00100000:1.0:1789997389.083881:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704425088 00000100:00100000:1.0:1789997389.083888:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704425088 00000100:00100000:1.0:1789997389.083941:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1143 00000100:00100000:1.0:1789997389.083950:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704425088:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997389.083987:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704425088:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997389.083994:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1143 00000100:00080000:1.0:1789997389.084035:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997389.084040:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997389.084042:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997389.084053:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704424960 00000100:00100000:1.0:1789997389.084058:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704424960 00000100:00100000:1.0:1789997389.084085:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 980 00000100:00100000:1.0:1789997389.084093:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704424960:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997389.084133:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704424960:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997389.084139:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 980 00000100:00100000:3.0:1789997389.259093:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997389.259133:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712940928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997389.259212:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997389.259267:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712940928 00000100:00100000:0.0:1789997389.259276:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712940928 00000100:00080000:3.0:1789997389.259314:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997389.259335:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1789997389.259344:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712940928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997389.259377:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997389.259436:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712940928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997389.259442:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1789997389.259510:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712940928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997389.260223:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712941056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997389.260264:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997389.263022:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712941056 00000100:00100000:0.0:1789997389.263037:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712941056 00000100:00080000:3.0:1789997389.263159:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997389.263437:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1789997389.263451:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712941056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997389.263493:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997389.263637:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712941056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (3372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997389.263645:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:1.0:1789997389.263750:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712941056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997389.580409:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789997389.909580:0:76555:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 19: test nodemap trusted_admin fileops ========================================================== 09:29:48 (1789997388) 00010000:00010000:1.0:1789997390.604909:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1789997390.618041:0:76603:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1789997390.627119:0:76603:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000020:00000080:2.0:1789997391.235596:0:76651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd3f0d560 20000000:00000080:2.0:1789997391.235613:0:76651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c6969800 uarg=0000000000000000 10000000:01000000:2.0:1789997391.236297:0:76651:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997391.236319:0:76651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997391.236337:0:76651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c2fa expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997391.236347:0:76651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997391.236384:0:76651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c2fa expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997391.236398:0:76651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c2fa expref: 18 pid: 5805 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997391.236412:0:76651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb357800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76651:1876946712941184:0@lo:104: 00000100:00100000:2.0:1789997391.236469:0:76651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997391.236589:0:76651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789997391.238958:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712941184 00000100:00100000:0.0:1789997391.239098:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712941184 00000100:00100000:0.0:1789997391.239336:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789997391.239348:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:76651:x1876946712941184:12345-0@lo:104: 00010000:00010000:0.0:1789997391.239367:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997391.239481:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997391.239488:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:76651:x1876946712941184:12345-0@lo:104: Request processed in 143us (3018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997391.239495:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789997391.239600:0:76651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb357800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76651:1876946712941184:0@lo:104: 00010000:00010000:3.0:1789997391.239625:0:76651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.239680:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997391.239687:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.239694:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997391.239698:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.239707:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997391.239713:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997391.239723:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997391.239758:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.239764:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997391.239784:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.239789:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592c2fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c301 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.239806:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997391.239808:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997391.239809:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997391.240004:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712941312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997391.240047:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997391.240107:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712941312 00000100:00100000:3.0:1789997391.240111:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712941312 00010000:00010000:3.0:1789997391.240134:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c2fa expref: 19 pid: 5805 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997391.240169:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789997391.240178:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712941312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997391.240189:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997391.240194:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c2fa expref: 19 pid: 5805 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240275:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c2fa expref: 19 pid: 5805 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240292:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c301 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c2fa expref: 19 pid: 5805 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240306:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240314:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240329:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240336:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240343:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240350:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240356:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997391.240360:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.240367:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997391.241145:0:76651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997391.241264:0:76651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.245715:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.245734:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592c308 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.245760:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997391.245862:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712941312:12345-0@lo:103:ldlm_bl.0 Request processed in 5682us (5811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997391.245872:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789997391.245999:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712941312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997391.627055:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997391.803422:0:76699:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa79cf650 20000000:00000080:3.0:1789997391.803439:0:76699:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e8b000 uarg=0000000000000000 10000000:01000000:3.0:1789997391.803816:0:76699:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997391.803837:0:76699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803850:0:76699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803861:0:76699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803867:0:76699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803875:0:76699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803882:0:76699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803889:0:76699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997391.803894:0:76699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803902:0:76699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803915:0:76699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803921:0:76699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997391.803925:0:76699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b200/0x65b43101d592c30f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997392.331472:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712941440:0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.331578:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997392.331649:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712941952:0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.331719:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997392.331764:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789997392.331774:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712941568:0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.331823:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997392.331845:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712942080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.331864:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997392.331891:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712941696:0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.331914:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997392.331933:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997392.331955:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712941824:0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.331978:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997392.332581:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712941440 00000100:00100000:1.0:1789997392.332590:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712941440 00000100:00100000:1.0:1789997392.332677:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1789997392.332691:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712941440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.332760:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712941440:12345-0@lo:400:kworker.0 Request processed in 72us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997392.332768:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1789997392.332837:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712941568 00000100:00100000:0.0:1789997392.332843:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712941568 00000100:00100000:0.0:1789997392.332880:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712942080 00000100:00100000:0.0:1789997392.332884:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712942080 00000100:00100000:3.0:1789997392.332891:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712941696 00000100:00100000:3.0:1789997392.332898:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712941696 00000100:00100000:0.0:1789997392.332920:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1789997392.332928:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712941568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997392.332970:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712941568:12345-0@lo:400:kworker.0 Request processed in 43us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997392.333259:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1789997392.333268:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712942080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.333301:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712941952 00000100:00100000:1.0:1789997392.333307:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712941952 00000100:00100000:3.0:1789997392.333311:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712942080:12345-0@lo:400:kworker.0 Request processed in 45us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997392.333319:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1789997392.333337:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1789997392.333342:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712941824 00000100:00100000:3.0:1789997392.333347:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712941696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.333347:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712941824 00000100:00100000:1.0:1789997392.333378:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1789997392.333388:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712941952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997392.333394:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712941696:12345-0@lo:400:kworker.0 Request processed in 49us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997392.333401:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00080000:3.0:1789997392.333417:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997392.333421:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997392.333424:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997392.333460:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1789997392.333497:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1789997392.333506:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712941824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.333885:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712941952:12345-0@lo:400:kworker.0 Request processed in 498us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997392.333895:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1789997392.333896:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712941824:12345-0@lo:400:kworker.0 Request processed in 389us (1914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997392.333907:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1789997392.333975:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712941568:0@lo:400:kworker.0 00000100:00100000:0.0:1789997392.333991:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712942080:0@lo:400:kworker.0 00000100:00100000:0.0:1789997392.334001:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712941440:0@lo:400:kworker.0 00000100:00100000:0.0:1789997392.334010:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712941952:0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.334097:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712941824:0@lo:400:kworker.0 00000100:00100000:1.0:1789997392.334112:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712941696:0@lo:400:kworker.0 00000020:00000080:1.0:1789997392.367118:0:76747:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5cc69e70 20000000:00000080:1.0:1789997392.367134:0:76747:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb312400 uarg=0000000000000000 10000000:01000000:1.0:1789997392.367386:0:76747:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997392.367409:0:76747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367425:0:76747:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367436:0:76747:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367444:0:76747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367451:0:76747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367459:0:76747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367465:0:76747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997392.367470:0:76747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367479:0:76747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367493:0:76747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367504:0:76747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.367511:0:76747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592c316 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.650835:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997392.650888:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997392.650892:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997392.650897:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997392.650943:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997392.650955:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997392.650966:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997392.650993:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712942208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997392.651076:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997392.651199:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789997392.651255:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712942208 00000100:00100000:1.0:1789997392.651264:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712942208 00000100:00100000:1.0:1789997392.651318:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1789997392.651328:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712942208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997392.651342:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997392.651356:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c31d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.651391:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c31d expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.651403:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c31d expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.651414:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:1.0:1789997392.651466:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712942208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997392.651473:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1789997392.651718:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb356a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712942208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997392.651735:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997392.651748:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997392.651767:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997392.651772:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997392.651780:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789997392.989632:0:76796:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff488e5e10 20000000:00000080:1.0:1789997392.989647:0:76796:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb311c00 uarg=0000000000000000 10000000:01000000:1.0:1789997392.990409:0:76796:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997392.990431:0:76796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.990448:0:76796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c31d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.990456:0:76796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.990494:0:76796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c31d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997392.990510:0:76796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c31d expref: 18 pid: 5804 timeout: 1731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997392.990524:0:76796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76796:1876946712942336:0@lo:104: 00000100:00100000:1.0:1789997392.990587:0:76796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997392.990760:0:76796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa55a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997392.990912:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712942336 00000100:00100000:3.0:1789997392.990920:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712942336 00000100:00100000:3.0:1789997392.991008:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789997392.991018:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:76796:x1876946712942336:12345-0@lo:104: 00010000:00010000:3.0:1789997392.991030:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997392.991121:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997392.991127:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:76796:x1876946712942336:12345-0@lo:104: Request processed in 111us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997392.991135:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789997392.991230:0:76796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76796:1876946712942336:0@lo:104: 00010000:00010000:2.0:1789997392.991250:0:76796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991312:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997392.991319:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991327:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997392.991332:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991341:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997392.991350:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997392.991357:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997392.991392:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991400:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997392.991421:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991428:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592c31d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c324 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991445:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997392.991447:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997392.991449:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997392.991460:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712942464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997392.991492:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997392.991533:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712942464 00000100:00100000:0.0:1789997392.991537:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712942464 00010000:00010000:0.0:1789997392.991556:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c31d expref: 19 pid: 5804 timeout: 1731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997392.991578:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789997392.991584:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712942464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997392.991594:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997392.991599:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c31d expref: 19 pid: 5804 timeout: 1731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991609:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c31d expref: 19 pid: 5804 timeout: 1731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991623:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c324 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c31d expref: 19 pid: 5804 timeout: 1731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991635:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991643:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991680:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991688:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991695:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991701:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991707:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997392.991711:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991718:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991730:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997392.991741:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997392.991766:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712942464:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997392.991773:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789997392.991812:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712942464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997392.991937:0:76796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997392.991945:0:76796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997392.991952:0:76796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592c32b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789997393.582049:0:76844:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd44dbac60 20000000:00000080:2.0:1789997393.582064:0:76844:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c696b400 uarg=0000000000000000 10000000:01000000:2.0:1789997393.582245:0:76844:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997393.582264:0:76844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582279:0:76844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582288:0:76844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582296:0:76844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582302:0:76844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582309:0:76844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582315:0:76844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997393.582319:0:76844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582327:0:76844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582340:0:76844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582352:0:76844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997393.582358:0:76844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592c332 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997393.678646:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997394.097630:0:76892:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeff07fa00 20000000:00000080:1.0:1789997394.097646:0:76892:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb311c00 uarg=0000000000000000 10000000:01000000:1.0:1789997394.097903:0:76892:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997394.097930:0:76892:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.097948:0:76892:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.097959:0:76892:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.097966:0:76892:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.097978:0:76892:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.097986:0:76892:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.097993:0:76892:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997394.097997:0:76892:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.098005:0:76892:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.098027:0:76892:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.098035:0:76892:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.098042:0:76892:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592c339 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76892 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997394.199795:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997394.199834:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997394.199861:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997394.199879:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997394.199905:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704425856 00000100:00100000:1.0:1789997394.199917:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704425856 00000100:00100000:1.0:1789997394.199968:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704425728 00000100:00100000:1.0:1789997394.199971:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704425728 00000100:00100000:1.0:1789997394.199991:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 701 00000100:00100000:1.0:1789997394.200002:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704425856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997394.200094:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704425856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997394.200102:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 701 00000100:00100000:1.0:1789997394.200120:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 702 00000100:00100000:1.0:1789997394.200127:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704425728:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997394.200148:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704425728:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 22us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997394.200154:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 702 00000100:00100000:1.0:1789997394.200170:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704425472 00000100:00100000:1.0:1789997394.200173:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704425472 00000100:00100000:1.0:1789997394.200193:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 983 00000100:00100000:1.0:1789997394.200199:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704425472:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997394.200224:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704425472:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 21us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997394.200231:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 983 00000100:00080000:1.0:1789997394.200255:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997394.200259:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997394.200379:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704425600 00000100:00100000:0.0:1789997394.200383:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704425600 00000100:00100000:0.0:1789997394.200422:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1147 00000100:00100000:0.0:1789997394.200428:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704425600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997394.200459:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704425600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997394.200465:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1147 00000100:00080000:1.0:1789997394.200532:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997394.379447:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712942592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997394.379527:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997394.379782:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712942592 00000100:00100000:0.0:1789997394.379791:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712942592 00000100:00100000:0.0:1789997394.379912:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1789997394.379921:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712942592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997394.379959:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789997394.380031:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997394.381802:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712942592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1874us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997394.381815:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1789997394.382304:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712942720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997394.382361:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997394.382526:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712942592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997394.382651:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712942720 00000100:00100000:0.0:1789997394.382698:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712942720 00000100:00100000:0.0:1789997394.382764:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1789997394.382775:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712942720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997394.382813:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997394.382871:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712942720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997394.382878:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00080000:3.0:1789997394.382927:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997394.382952:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712942720:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1789997394.638675:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997394.638682:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997394.638686:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997394.638732:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997394.638744:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997394.638755:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997394.638781:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712942848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997394.638849:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997394.638903:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789997394.638926:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712942848 00000100:00100000:3.0:1789997394.638932:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712942848 00000100:00100000:3.0:1789997394.638995:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1789997394.639003:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712942848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997394.639026:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997394.639038:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c340 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997394.639068:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c340 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997394.639078:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c340 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997394.639088:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997394.639122:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712942848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997394.639128:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1789997394.639176:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712942848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997394.639190:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997394.639198:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997394.639219:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997394.639224:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997394.639231:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997394.698794:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997395.722947:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997395.893097:0:77040:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6063b500 20000000:00000080:2.0:1789997395.893116:0:77040:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c696bc00 uarg=0000000000000000 10000000:01000000:2.0:1789997395.893326:0:77040:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997395.893348:0:77040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997395.893367:0:77040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c340 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997395.893376:0:77040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997395.893413:0:77040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c340 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997395.893429:0:77040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c340 expref: 18 pid: 5804 timeout: 1734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997395.893445:0:77040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb355f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77040:1876946712942976:0@lo:104: 00000100:00100000:2.0:1789997395.893525:0:77040:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997395.893574:0:77040:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0a77f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997395.893640:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789997395.893680:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712942976 00000100:00100000:1.0:1789997395.893688:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712942976 00000100:00100000:1.0:1789997395.893736:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789997395.893744:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:77040:x1876946712942976:12345-0@lo:104: 00010000:00010000:1.0:1789997395.893758:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997395.893815:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997395.893822:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd87c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:77040:x1876946712942976:12345-0@lo:104: Request processed in 79us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997395.893834:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:0.0:1789997395.893870:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997395.893878:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997395.893888:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997395.893892:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997395.893903:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997395.893910:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997395.893916:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997395.894092:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997395.894100:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789997395.894117:0:77040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb355f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77040:1876946712942976:0@lo:104: 00010000:00010000:1.0:1789997395.894124:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997395.894132:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592c340 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c347 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894138:0:77040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997395.894147:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997395.894151:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997395.894153:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997395.894167:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712943104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997395.894196:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997395.894248:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712943104 00000100:00100000:3.0:1789997395.894253:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712943104 00010000:00010000:3.0:1789997395.894275:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c340 expref: 19 pid: 5804 timeout: 1734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997395.894298:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789997395.894313:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712943104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997395.894324:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997395.894330:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c340 expref: 19 pid: 5804 timeout: 1734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894342:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c340 expref: 19 pid: 5804 timeout: 1734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894356:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592c347 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c340 expref: 19 pid: 5804 timeout: 1734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894370:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894378:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894390:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894397:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894404:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894411:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894417:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997395.894421:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894429:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894452:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997395.894463:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997395.894491:0:77040:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997395.894501:0:77040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997395.894507:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712943104:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (308us total) trans 0 rc 0/0 00010000:00010000:0.0:1789997395.894511:0:77040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c34e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997395.894520:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789997395.895230:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712943104:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789997396.465357:0:77088:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe935b020 20000000:00000080:1.0:1789997396.465376:0:77088:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb311800 uarg=0000000000000000 10000000:01000000:1.0:1789997396.465575:0:77088:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997396.465597:0:77088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465611:0:77088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465621:0:77088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465628:0:77088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465635:0:77088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465641:0:77088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465648:0:77088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997396.465723:0:77088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465735:0:77088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465750:0:77088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465758:0:77088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997396.465769:0:77088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592c355 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997396.748026:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997397.003818:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997397.003825:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997397.003830:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997397.003893:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997397.003906:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997397.003919:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997397.003947:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712943232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997397.004031:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997397.004085:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c574fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789997397.004156:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712943232 00000100:00100000:1.0:1789997397.004164:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712943232 00000100:00100000:1.0:1789997397.004232:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1789997397.004243:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712943232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997397.004255:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997397.004271:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c35c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997397.004297:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c35c expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997397.004309:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c35c expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997397.004319:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997397.004362:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712943232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997397.004368:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1789997397.004648:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712943232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997397.004693:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997397.004704:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997397.004727:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997397.004733:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997397.004740:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997397.451098:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712943616:0@lo:400:kworker.0 00000100:00100000:1.0:1789997397.451164:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997397.451220:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997397.451227:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712943744:0@lo:400:kworker.0 00000100:00100000:1.0:1789997397.451251:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997397.451290:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712943488:0@lo:400:kworker.0 00000100:00100000:1.0:1789997397.451292:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712943616 00000100:00100000:1.0:1789997397.451301:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712943616 00000100:00100000:2.0:1789997397.451328:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38faf02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712943360:0@lo:400:kworker.0 00000100:00100000:3.0:1789997397.451336:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997397.451366:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712944000:0@lo:400:kworker.0 00000100:00100000:2.0:1789997397.451378:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997397.451398:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997397.451430:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712943872:0@lo:400:kworker.0 00000100:00100000:3.0:1789997397.451450:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712943488 00000100:00100000:3.0:1789997397.451455:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712943488 00000100:00100000:2.0:1789997397.451462:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997397.451496:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712944000 00000100:00100000:3.0:1789997397.451499:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712944000 00000100:00100000:3.0:1789997397.451539:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1789997397.451550:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712943488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997397.452072:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1789997397.452079:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712944000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997397.453007:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712943360 00000100:00100000:2.0:1789997397.453016:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712943360 00000100:00100000:3.0:1789997397.453023:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712943488:12345-0@lo:400:kworker.0 Request processed in 1471us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997397.453024:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712944000:12345-0@lo:400:kworker.0 Request processed in 942us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997397.453040:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1789997397.453047:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1789997397.453058:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1789997397.453066:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1789997397.453071:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712943360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997397.453078:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712943616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997397.453085:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712943744 00000100:00100000:1.0:1789997397.453090:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712943744 00000100:00100000:1.0:1789997397.453125:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712943872 00000100:00100000:2.0:1789997397.453130:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712943360:12345-0@lo:400:kworker.0 Request processed in 61us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997397.453130:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712943872 00000100:00100000:3.0:1789997397.453138:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712943616:12345-0@lo:400:kworker.0 Request processed in 63us (1972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997397.453145:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1789997397.453155:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1789997397.453163:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712943744:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789997397.453172:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997397.453178:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997397.453182:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997397.453202:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1789997397.453203:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712943744:12345-0@lo:400:kworker.0 Request processed in 37us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997397.453212:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1789997397.453220:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712943488:0@lo:400:kworker.0 00000100:00100000:1.0:1789997397.453230:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:1.0:1789997397.453239:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712943872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997397.453240:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712944000:0@lo:400:kworker.0 00000100:00100000:2.0:1789997397.453271:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38faf02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712943360:0@lo:400:kworker.0 00000100:00100000:1.0:1789997397.453283:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712943872:12345-0@lo:400:kworker.0 Request processed in 45us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997397.453290:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712943744:0@lo:400:kworker.0 00000100:00100000:1.0:1789997397.453292:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1789997397.453294:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712943872:0@lo:400:kworker.0 00000100:00100000:3.0:1789997397.453313:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712943616:0@lo:400:kworker.0 00010000:00010000:0.0:1789997397.771767:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997398.795505:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997398.821597:0:77285:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffdeabf710 20000000:00000080:3.0:1789997398.821615:0:77285:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e8a000 uarg=0000000000000000 00010000:00010000:3.0:1789997398.822142:0:77285:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997398.822157:0:77285:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997398.822172:0:77285:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997398.822189:0:77285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.822206:0:77285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c35c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.822214:0:77285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.822256:0:77285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c35c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.822272:0:77285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c35c expref: 18 pid: 5803 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997398.822285:0:77285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77285:1876946712944128:0@lo:104: 00000100:00100000:3.0:1789997398.822344:0:77285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997398.822395:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712944128 00000100:00100000:3.0:1789997398.822397:0:77285:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3395f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997398.822405:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712944128 00000100:00100000:1.0:1789997398.822458:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789997398.822467:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:77285:x1876946712944128:12345-0@lo:104: 00010000:00010000:1.0:1789997398.822480:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997398.822556:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997398.822562:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:77285:x1876946712944128:12345-0@lo:104: Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997398.822570:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789997398.822588:0:77285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77285:1876946712944128:0@lo:104: 00010000:00010000:2.0:1789997398.822609:0:77285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997398.822641:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997398.822649:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997398.822672:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997398.822675:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997398.822682:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997398.822687:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997398.822691:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997398.822716:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997398.822720:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997398.822743:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997398.822751:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38f660e200/0x65b43101d592c35c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c363 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997398.822766:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997398.822768:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997398.822769:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997398.822822:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997398.822835:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712944256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997398.822871:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997398.822944:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712944256 00000100:00100000:3.0:1789997398.822949:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712944256 00010000:00010000:3.0:1789997398.822969:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c35c expref: 19 pid: 5803 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997398.822993:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789997398.823001:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712944256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997398.823012:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997398.823017:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c35c expref: 19 pid: 5803 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823026:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c35c expref: 19 pid: 5803 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823040:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592c363 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c35c expref: 19 pid: 5803 timeout: 1737 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823053:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823061:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823072:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823079:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823086:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823260:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823266:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997398.823270:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823276:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823297:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997398.823306:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997398.823328:0:77285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997398.823338:0:77285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997398.823345:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712944256:12345-0@lo:103:ldlm_bl.0 Request processed in 343us (471us total) trans 0 rc 0/0 00010000:00010000:2.0:1789997398.823351:0:77285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592c36a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997398.823356:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789997398.823369:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712944256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997399.326284:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997399.326325:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997399.326348:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997399.326377:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997399.326404:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704426240 00000100:00100000:2.0:1789997399.326413:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704426240 00000100:00100000:2.0:1789997399.326463:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704426368 00000100:00100000:2.0:1789997399.326465:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704426368 00000100:00100000:2.0:1789997399.326486:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 351 00000100:00100000:2.0:1789997399.326496:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704426240:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:2.0:1789997399.326525:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592c05a 00000100:00080000:2.0:1789997399.326534:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c53dd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789997399.326572:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:2.0:1789997399.326856:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704426240:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 360us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997399.326864:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 351 00000100:00100000:2.0:1789997399.326881:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 352 00000100:00100000:2.0:1789997399.326888:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704426368:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:2.0:1789997399.326901:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592ba1e 00000100:00080000:2.0:1789997399.326906:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c53de000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789997399.326939:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:2.0:1789997399.327078:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704426368:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 190us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997399.327084:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 352 00000100:00100000:2.0:1789997399.327107:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704425984 00000100:00100000:2.0:1789997399.327110:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704425984 00000100:00100000:2.0:1789997399.327133:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 987 00000100:00100000:2.0:1789997399.327139:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704425984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997399.327160:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704425984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 22us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997399.327169:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 987 00000100:00080000:2.0:1789997399.327189:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997399.327193:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997399.327206:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997399.327281:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997399.328123:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704426112 00000100:00100000:0.0:1789997399.328131:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704426112 00000100:00100000:0.0:1789997399.328203:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1151 00000100:00100000:0.0:1789997399.328213:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704426112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997399.328260:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704426112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 49us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997399.328267:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1151 00000100:00080000:2.0:1789997399.329720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997399.498771:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712944384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997399.498862:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997399.498984:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712944384 00000100:00100000:0.0:1789997399.498995:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712944384 00000100:00100000:0.0:1789997399.499050:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1789997399.499059:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712944384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997399.499092:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997399.499143:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712944384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997399.499150:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1789997399.499199:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712944384:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997399.499579:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997399.500870:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712944512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997399.500937:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997399.505212:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712944512 00000100:00100000:2.0:1789997399.505227:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712944512 00000100:00100000:2.0:1789997399.505285:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1789997399.505297:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712944512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997399.505337:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997399.505420:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712944512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (4483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997399.505429:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00080000:2.0:1789997399.505449:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997399.507927:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712944512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789997399.819827:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997399.946787:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997399.946795:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997399.946799:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997399.946850:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997399.946862:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997399.946879:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997399.946917:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb354a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712944640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997399.946992:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997399.947063:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789997399.947151:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712944640 00000100:00100000:3.0:1789997399.947159:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712944640 00000100:00100000:3.0:1789997399.947223:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1789997399.947233:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712944640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997399.947245:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997399.947257:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c371 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997399.947281:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c371 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997399.947291:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c371 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997399.947314:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997399.947367:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712944640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997399.947373:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1789997399.947629:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb354a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712944640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997399.947646:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997399.947697:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997399.947716:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997399.947721:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997399.947730:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997400.845402:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789997401.093649:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997401.093677:0:7614:0:(genops.c:885:class_export_put()) final put ffff8a38c53df000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997401.094801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38c53df000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0001 00000020:00000080:0.0:1789997401.095048:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38c53de000 for lustre-OST0001 00000001:00100000:3.0:1789997401.117954:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:3.0:1789997401.117965:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a38c53df800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:3.0:1789997401.118006:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38c53df800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:3.0:1789997401.118061:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38c53dd000 for lustre-OST0000 00000020:00000080:3.0:1789997401.329205:0:77483:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffba743af0 20000000:00000080:3.0:1789997401.329223:0:77483:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e8a400 uarg=0000000000000000 00010000:00010000:3.0:1789997401.329425:0:77483:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997401.329442:0:77483:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997401.329457:0:77483:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997401.329478:0:77483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997401.329495:0:77483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c371 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997401.329504:0:77483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997401.329545:0:77483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c371 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997401.329560:0:77483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c371 expref: 18 pid: 5804 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997401.329580:0:77483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77483:1876946712944768:0@lo:104: 00000100:00100000:3.0:1789997401.329936:0:77483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997401.329998:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712944768 00000100:00100000:3.0:1789997401.330006:0:77483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e0d99d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789997401.330006:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712944768 00000100:00100000:1.0:1789997401.330053:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1789997401.330063:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:77483:x1876946712944768:12345-0@lo:104: 00010000:00010000:1.0:1789997401.330076:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997401.330150:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997401.330164:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:77483:x1876946712944768:12345-0@lo:104: Request processed in 104us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997401.330170:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789997401.330173:0:77483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77483:1876946712944768:0@lo:104: 00010000:00010000:3.0:1789997401.330189:0:77483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330238:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997401.330245:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330253:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997401.330257:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330265:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997401.330271:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997401.330277:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997401.330372:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330378:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997401.330414:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330421:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592c371 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c378 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330437:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997401.330439:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997401.330440:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997401.330484:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712944896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997401.330514:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997401.330563:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712944896 00000100:00100000:2.0:1789997401.330568:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712944896 00010000:00010000:2.0:1789997401.330590:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c371 expref: 19 pid: 5804 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997401.330627:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789997401.330644:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712944896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997401.330680:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997401.330686:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c371 expref: 19 pid: 5804 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330696:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c371 expref: 19 pid: 5804 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330709:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052be00/0x65b43101d592c378 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c371 expref: 19 pid: 5804 timeout: 1740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330722:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330730:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330743:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330755:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330762:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330770:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330776:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997401.330781:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330789:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330805:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997401.330813:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997401.330841:0:77483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997401.330850:0:77483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997401.330854:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712944896:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (337us total) trans 0 rc 0/0 00010000:00010000:3.0:1789997401.330864:0:77483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c37f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997401.330868:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789997401.331705:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712944896:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789997401.863062:0:77531:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5f153a00 20000000:00000080:0.0:1789997401.863080:0:77531:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb10fc00 uarg=0000000000000000 00010000:00010000:0.0:1789997401.863562:0:77531:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997401.863578:0:77531:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997401.863593:0:77531:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997401.863614:0:77531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863630:0:77531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863641:0:77531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863649:0:77531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863755:0:77531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863764:0:77531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863775:0:77531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997401.863780:0:77531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863788:0:77531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863801:0:77531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863809:0:77531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.863816:0:77531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660e200/0x65b43101d592c386 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997401.867033:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997402.572173:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712945280:0@lo:400:kworker.0 00000100:00100000:0.0:1789997402.572239:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997402.572292:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997402.572298:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712945408:0@lo:400:kworker.0 00000100:00100000:0.0:1789997402.572322:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997402.572363:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712945280 00000100:00100000:0.0:1789997402.572370:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712945280 00000100:00100000:0.0:1789997402.572423:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1789997402.572431:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712945280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997402.572480:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712945280:12345-0@lo:400:kworker.0 Request processed in 50us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997402.572490:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1789997402.572511:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712945408 00000100:00100000:0.0:1789997402.572514:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712945408 00000100:00100000:0.0:1789997402.572538:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:0.0:1789997402.572544:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712945408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997402.572573:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712945408:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997402.572579:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00080000:0.0:1789997402.572593:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997402.572597:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997402.572696:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712945408:0@lo:400:kworker.0 00000100:00100000:0.0:1789997402.572707:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712945280:0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.572798:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712945152:0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.572828:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997402.572870:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712945664:0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.572898:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997402.573037:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789997402.573044:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712945024:0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573073:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997402.573096:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712945536:0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573119:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997402.573146:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712945152 00000100:00100000:3.0:1789997402.573150:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712945152 00000100:00100000:3.0:1789997402.573177:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712945664 00000100:00100000:3.0:1789997402.573180:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712945664 00000100:00100000:3.0:1789997402.573208:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1789997402.573214:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712945152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573251:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712945152:12345-0@lo:400:kworker.0 Request processed in 37us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997402.573258:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1789997402.573271:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1789997402.573276:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712945664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573301:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712945664:12345-0@lo:400:kworker.0 Request processed in 25us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997402.573306:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1789997402.573322:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712945024 00000100:00100000:3.0:1789997402.573325:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712945024 00000100:00100000:3.0:1789997402.573348:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1789997402.573354:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712945024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573380:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712945024:12345-0@lo:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997402.573386:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1789997402.573414:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712945536 00000100:00100000:3.0:1789997402.573418:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712945536 00000100:00100000:3.0:1789997402.573443:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1789997402.573448:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712945536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573476:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712945536:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997402.573482:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00080000:3.0:1789997402.573507:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997402.573511:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997402.573528:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712945024:0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573539:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712945536:0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573548:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712945152:0@lo:400:kworker.0 00000100:00100000:3.0:1789997402.573557:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712945664:0@lo:400:kworker.0 00010000:00010000:0.0:1789997402.890859:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997403.210970:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997403.210978:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997403.210985:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997403.211033:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997403.211045:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997403.211058:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997403.211095:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712945792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997403.211176:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997403.211242:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789997403.211686:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712945792 00000100:00100000:2.0:1789997403.211694:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712945792 00000100:00100000:2.0:1789997403.211749:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1789997403.211759:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712945792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997403.211773:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997403.211787:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c38d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997403.211820:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c38d expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997403.211832:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c38d expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997403.211850:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997403.211902:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712945792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997403.211909:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1789997403.212079:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712945792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997403.212093:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997403.212106:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997403.212248:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997403.212254:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997403.212262:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997403.916387:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997404.445294:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997404.445345:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997404.445434:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704426496 00000100:00100000:0.0:1789997404.445434:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704426624 00000100:00100000:3.0:1789997404.445443:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704426496 00000100:00100000:0.0:1789997404.445444:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704426624 00000100:00100000:3.0:1789997404.445492:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 991 00000100:00100000:0.0:1789997404.445497:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1155 00000100:00100000:0.0:1789997404.445504:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704426624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997404.445505:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704426496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997404.445578:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704426496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997404.445586:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 991 00000100:00080000:2.0:1789997404.445594:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997404.445893:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704426624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 389us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997404.445901:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1155 00000100:00100000:2.0:1789997404.618950:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997404.618972:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712945920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997404.619035:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997404.619375:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712945920 00000100:00100000:1.0:1789997404.619384:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712945920 00000100:00080000:2.0:1789997404.619433:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997404.619462:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1789997404.619474:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712945920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997404.619509:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997404.619572:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faf02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712945920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997404.619580:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1789997404.619618:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712945920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997404.619988:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997404.619998:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712946048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997404.620029:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997404.620237:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712946048 00000100:00100000:3.0:1789997404.620251:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712946048 00000100:00100000:3.0:1789997404.620382:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:3.0:1789997404.620392:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712946048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997404.620447:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997404.620536:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712946048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997404.620544:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1789997404.620571:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712946048:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997404.623687:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997404.938826:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997405.512520:0:77824:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd26c0b630 20000000:00000080:0.0:1789997405.512540:0:77824:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb344c00 uarg=0000000000000000 10000000:01000000:0.0:1789997405.512586:0:77824:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997405.512605:0:77824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997405.512622:0:77824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c38d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997405.512630:0:77824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997405.513145:0:77824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c38d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997405.513161:0:77824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c38d expref: 18 pid: 5804 timeout: 1744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997405.513175:0:77824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77824:1876946712946176:0@lo:104: 00000100:00100000:0.0:1789997405.513240:0:77824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997405.513329:0:77824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789997405.513376:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712946176 00000100:00100000:1.0:1789997405.513384:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712946176 00000100:00100000:1.0:1789997405.513461:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789997405.513472:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:77824:x1876946712946176:12345-0@lo:104: 00010000:00010000:1.0:1789997405.513485:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997405.513583:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997405.513589:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:77824:x1876946712946176:12345-0@lo:104: Request processed in 119us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997405.513596:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:2.0:1789997405.513639:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997405.513646:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.513701:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997405.513705:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.513714:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997405.513722:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997405.513728:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997405.513757:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.513764:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997405.513787:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.513805:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38f660f200/0x65b43101d592c38d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c394 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.513822:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997405.513824:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997405.513825:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997405.513843:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712946304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997405.513873:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997405.513904:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712946304 00000100:00100000:2.0:1789997405.513908:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712946304 00010000:00010000:2.0:1789997405.513929:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c38d expref: 19 pid: 5804 timeout: 1744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997405.513951:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789997405.513957:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712946304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997405.513967:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997405.513971:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c38d expref: 19 pid: 5804 timeout: 1744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.513982:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c38d expref: 19 pid: 5804 timeout: 1744 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.513998:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514005:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514019:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514027:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514035:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514042:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514048:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997405.514052:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514059:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514068:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997405.514081:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997405.514108:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712946304:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997405.514115:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1789997405.514157:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7ff7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712946304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997405.514274:0:77824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592c394 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c38d expref: 18 pid: 5804 timeout: 1744 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997405.514284:0:77824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77824:1876946712946176:0@lo:104: 00010000:00010000:0.0:1789997405.514296:0:77824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997405.514304:0:77824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997405.514310:0:77824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997405.514315:0:77824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c39b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997405.965288:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997406.100971:0:77872:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2268b290 20000000:00000080:0.0:1789997406.100989:0:77872:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb344400 uarg=0000000000000000 10000000:01000000:0.0:1789997406.101038:0:77872:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997406.101059:0:77872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101075:0:77872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101086:0:77872:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101094:0:77872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101106:0:77872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101114:0:77872:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101121:0:77872:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997406.101126:0:77872:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101134:0:77872:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101147:0:77872:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101155:0:77872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.101162:0:77872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660e200/0x65b43101d592c3a2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997406.603476:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997406.603486:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997406.603492:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997406.603555:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997406.603569:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997406.603583:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997406.603615:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712946432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997406.603735:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997406.603808:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c574f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789997406.604309:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712946432 00000100:00100000:0.0:1789997406.604320:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712946432 00000100:00100000:0.0:1789997406.604404:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1789997406.604417:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712946432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997406.604434:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997406.604455:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c3a9 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.604491:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.604504:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.604516:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ec00, rc 0) 00000100:00100000:0.0:1789997406.604590:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712946432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997406.604599:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1789997406.606084:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712946432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997406.606117:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997406.606132:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997406.606160:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997406.606166:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997406.606174:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997406.987071:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997407.692196:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712946944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.692225:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712946560:0@lo:400:kworker.0 00000100:00100000:3.0:1789997407.692276:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997407.692277:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997407.692360:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712946944 00000100:00100000:0.0:1789997407.692369:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712946944 00000100:00100000:0.0:1789997407.692435:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1789997407.692446:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712946944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.693359:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712947072:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.693396:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997407.693473:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712946816:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.693503:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997407.693526:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789997407.693533:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712946688:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.693646:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997407.693691:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712947200:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.693718:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997407.693781:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712946816 00000100:00100000:2.0:1789997407.693788:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712946816 00000100:00080000:1.0:1789997407.693797:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997407.693803:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997407.693822:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712947072 00000100:00100000:2.0:1789997407.693829:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712946688 00000100:00100000:1.0:1789997407.693829:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712947072 00000100:00100000:2.0:1789997407.693834:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712946688 00000100:00100000:2.0:1789997407.693857:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712947200 00000100:00100000:2.0:1789997407.693861:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712947200 00000100:00100000:1.0:1789997407.693875:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1789997407.693887:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712947072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.693893:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1789997407.693905:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712946816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997407.693956:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712947072:12345-0@lo:400:kworker.0 Request processed in 72us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997407.693963:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712946816:12345-0@lo:400:kworker.0 Request processed in 57us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997407.693968:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1789997407.693977:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00080000:1.0:1789997407.693995:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997407.693999:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00080000:1.0:1789997407.694000:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997407.694009:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712946688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997407.694025:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1789997407.694037:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712947200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.694044:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712946688:12345-0@lo:400:kworker.0 Request processed in 36us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997407.694052:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1789997407.694078:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712947200:12345-0@lo:400:kworker.0 Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997407.694079:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712946560 00000100:00100000:2.0:1789997407.694084:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712946560 00000100:00100000:1.0:1789997407.694088:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1789997407.694117:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1789997407.694125:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712946560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.694158:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712946560:12345-0@lo:400:kworker.0 Request processed in 34us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997407.694712:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712946944:12345-0@lo:400:kworker.0 Request processed in 2266us (2436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997407.694722:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1789997407.694799:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1789997407.694820:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712946944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.694873:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712946688:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.694887:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712947200:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.694901:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712946816:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.694938:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712946560:0@lo:400:kworker.0 00000100:00100000:2.0:1789997407.694952:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712947072:0@lo:400:kworker.0 00010000:00010000:1.0:1789997408.013153:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997408.116222:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997408.116343:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704426752 00000100:00100000:2.0:1789997408.116353:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704426752 00000100:00080000:1.0:1789997408.116497:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997408.116551:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 667 00000100:00100000:2.0:1789997408.116561:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45359:x1876946704426752:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997408.116583:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997408.116646:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c3b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb22 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.116757:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c3be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.116771:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.116784:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997408.116820:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789997408.116824:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997408.116847:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c3be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.116872:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c3b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb22 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.116889:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c3be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb22 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.116897:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997408.116899:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997408.116903:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789997408.116955:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45359:x1876946704426752:12345-192.168.204.4@tcp:101:rm.0 Request processed in 396us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997408.116963:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 667 00000100:00100000:2.0:1789997408.119451:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997408.119627:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704426880 00000100:00100000:1.0:1789997408.119636:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704426880 00000100:00100000:0.0:1789997408.119931:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 668 00000100:00100000:0.0:1789997408.119943:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45359:x1876946704426880:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997408.119961:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997408.119979:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb29 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120036:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120051:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120063:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120115:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120124:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120133:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120327:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120335:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120342:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120349:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997408.120354:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120362:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120374:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997408.120378:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997408.120383:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120390:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c3cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120402:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120408:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120414:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120419:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997408.120422:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120428:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120435:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997408.120437:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997408.120440:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120445:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120476:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb29 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120492:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997408.120495:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997408.120499:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb29 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.120509:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e200, rc 0) 00000100:00100000:0.0:1789997408.120871:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45359:x1876946704426880:12345-192.168.204.4@tcp:101:rm.0 Request processed in 929us (1428us total) trans 0 rc 301/301 00000100:00100000:0.0:1789997408.120880:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 668 00000100:00100000:1.0:1789997408.150450:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997408.150495:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997408.150578:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704427008 00000100:00100000:3.0:1789997408.150588:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704427008 00000100:00100000:3.0:1789997408.150776:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704427264 00000100:00100000:3.0:1789997408.150780:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704427264 00000100:00100000:0.0:1789997408.150973:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 669 00000100:00100000:0.0:1789997408.150987:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704427008:12345-192.168.204.4@tcp:41:mkdir.0 00000004:00000024:0.0:1789997408.151033:0:11799:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789997408.151114:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704427008:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 130us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997408.151122:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 669 00000100:00100000:0.0:1789997408.151141:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 670 00000100:00100000:0.0:1789997408.151147:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45363:x1876946704427264:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:0.0:1789997408.151182:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997408.151207:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c3be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb22 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.151223:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997408.151234:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997408.151439:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.151453:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.151463:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.151475:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.151483:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.151489:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997408.152447:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00010000:0.0:1789997408.152459:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.152467:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.152473:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.152479:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997408.152483:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.152491:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.152505:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997408.152507:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997408.152511:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.152517:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997408.152532:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cf09a34 reply state 00000000ed89a1e5 transno 4294967551 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997408.152540:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997408.153799:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45363:x1876946704427264:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 2644us (3297us total) trans 4294967551 rc 0/0 00000100:00100000:0.0:1789997408.153810:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 670 00010000:00010000:0.0:1789997408.155940:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.155960:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.155969:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.155975:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997408.155980:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.155987:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.156006:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997408.156010:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997408.156015:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.156072:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997408.180590:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997408.181249:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704427392 00000100:00100000:0.0:1789997408.181259:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704427392 00000100:00100000:0.0:1789997408.181376:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 671 00000100:00100000:0.0:1789997408.181387:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45367:x1876946704427392:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:0.0:1789997408.181412:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997408.181435:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb30 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.181494:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.181507:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.181518:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997408.181553:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789997408.181556:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997408.181576:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.181600:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c3e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb30 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.181619:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb30 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.181626:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997408.181629:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997408.181632:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e200, rc 0) 00000100:00100000:0.0:1789997408.181731:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45367:x1876946704427392:12345-192.168.204.4@tcp:101:chown.0 Request processed in 345us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997408.181737:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 671 00000100:00100000:1.0:1789997408.185168:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997408.185241:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704427520 00000100:00100000:2.0:1789997408.185252:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704427520 00000100:00100000:2.0:1789997408.185311:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 672 00000100:00100000:2.0:1789997408.185321:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45367:x1876946704427520:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1789997408.185341:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997408.185361:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c3f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb37 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185430:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185443:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185454:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185467:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185474:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185481:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185628:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c40b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185637:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185648:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997408.185717:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:2.0:1789997408.185721:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997408.185753:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c40b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185766:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185772:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185778:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185784:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997408.185788:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185795:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185807:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:2.0:1789997408.185811:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997408.185820:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185826:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c3fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185845:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185851:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185857:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185862:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997408.185864:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185870:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185877:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997408.185880:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997408.185883:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185899:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c404 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185930:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c3f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb37 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185943:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c40b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb37 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.185955:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997408.185958:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997408.185960:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3200, rc 0) 00000100:00100000:2.0:1789997408.186232:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45367:x1876946704427520:12345-192.168.204.4@tcp:101:chown.0 Request processed in 912us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997408.186238:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 672 00000100:00100000:3.0:1789997408.189160:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997408.189395:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704427776 00000100:00100000:1.0:1789997408.189406:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704427776 00000100:00100000:1.0:1789997408.189460:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 673 00000100:00100000:1.0:1789997408.189470:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c8774450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45367:x1876946704427776:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:1.0:1789997408.189520:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997408.189545:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c40b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb37 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.189576:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:1.0:1789997408.189590:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997408.189617:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.189631:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.189643:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997408.189885:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040f419fd reply state 00000000b7e3609b transno 4294967552 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997408.189894:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997408.189907:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:1.0:1789997408.190000:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c8774450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:45367:x1876946704427776:12345-192.168.204.4@tcp:36:chown.0 Request processed in 531us (850us total) trans 4294967552 rc 0/0 00000100:00100000:1.0:1789997408.190007:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 673 00010000:00010000:2.0:1789997408.193276:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.193293:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.193301:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.193308:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997408.193312:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.193320:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.193337:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:2.0:1789997408.193341:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997408.193346:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997408.193352:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c412 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997408.238353:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967551 is committed 00000001:00080000:1.0:1789997408.238375:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967552 is committed 00000020:00000080:1.0:1789997408.778602:0:78070:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe756c5cf0 20000000:00000080:1.0:1789997408.778620:0:78070:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faaf1800 uarg=0000000000000000 10000000:01000000:1.0:1789997408.778898:0:78070:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997408.778918:0:78070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.778936:0:78070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.778946:0:78070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.778989:0:78070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.779003:0:78070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 18 pid: 5805 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997408.779016:0:78070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78070:1876946712947328:0@lo:104: 00000100:00100000:1.0:1789997408.779148:0:78070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997408.779241:0:78070:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61480 going to sleep for 11 seconds 00000100:00100000:0.0:1789997408.779294:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712947328 00000100:00100000:0.0:1789997408.779303:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712947328 00000100:00100000:0.0:1789997408.779392:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789997408.779402:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:78070:x1876946712947328:12345-0@lo:104: 00010000:00010000:0.0:1789997408.779415:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997408.779545:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997408.779552:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:78070:x1876946712947328:12345-0@lo:104: Request processed in 152us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997408.779560:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:1.0:1789997408.779784:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997408.779791:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.779798:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997408.779802:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.779811:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997408.779819:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997408.779826:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997408.779857:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.779864:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997408.779885:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.779893:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592c3a9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c3b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997408.779909:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997408.779911:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997408.779913:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997408.779931:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712947456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997408.779963:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997408.780237:0:78070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78070:1876946712947328:0@lo:104: 00010000:00010000:2.0:1789997408.780262:0:78070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997408.781508:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712947456 00000100:00100000:3.0:1789997408.781517:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712947456 00010000:00010000:3.0:1789997408.781555:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 19 pid: 5805 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997408.781599:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789997408.781610:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712947456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997408.781624:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997408.781631:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 19 pid: 5805 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781646:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 19 pid: 5805 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781693:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c3b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c3a9 expref: 19 pid: 5805 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781712:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781720:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781747:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781755:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781762:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781769:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781776:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997408.781781:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781789:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781808:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.781820:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997408.781888:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712947456:12345-0@lo:103:ldlm_bl.0 Request processed in 280us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997408.781898:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789997408.781953:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712947456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997408.782021:0:78070:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.782030:0:78070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997408.782037:0:78070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592c419 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997409.034911:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997409.440495:0:78118:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd167df410 20000000:00000080:2.0:1789997409.440517:0:78118:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c6969c00 uarg=0000000000000000 10000000:01000000:2.0:1789997409.440573:0:78118:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997409.440597:0:78118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440614:0:78118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440625:0:78118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440632:0:78118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440639:0:78118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440647:0:78118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440669:0:78118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997409.440673:0:78118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440681:0:78118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440696:0:78118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440704:0:78118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997409.440709:0:78118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592c420 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997409.562198:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997409.562235:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997409.562683:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704428032 00000100:00100000:1.0:1789997409.562694:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704428032 00000100:00100000:1.0:1789997409.562760:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1159 00000100:00100000:1.0:1789997409.562770:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704428032:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997409.562842:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704428032:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997409.562850:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1159 00000100:00100000:0.0:1789997409.563435:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704427904 00000100:00100000:0.0:1789997409.563442:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704427904 00000100:00100000:0.0:1789997409.563484:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 994 00000100:00100000:0.0:1789997409.563494:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704427904:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997409.563605:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704427904:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 112us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997409.563612:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 994 00000100:00100000:1.0:1789997409.739008:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997409.739032:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712947712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997409.739095:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997409.739151:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712947584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997409.739173:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997409.739370:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712947712 00000100:00100000:3.0:1789997409.739379:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712947712 00000100:00100000:0.0:1789997409.739385:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712947584 00000100:00100000:0.0:1789997409.739391:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712947584 00000100:00100000:0.0:1789997409.739492:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1789997409.739513:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712947584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997409.739548:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997409.739598:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712947584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997409.739605:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00080000:1.0:1789997409.739644:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997409.739648:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997409.739690:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712947584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997409.739957:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1789997409.739966:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712947712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997409.739987:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997409.740032:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712947712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997409.740038:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1789997409.741647:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712947712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997410.062326:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997410.828014:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997410.828022:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997410.828027:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997410.828080:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997410.828092:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997410.828104:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997410.828132:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712947840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997410.828199:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997410.828261:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789997410.828391:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712947840 00000100:00100000:3.0:1789997410.828399:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712947840 00000100:00100000:3.0:1789997410.828454:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1789997410.828464:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712947840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997410.828488:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997410.828502:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c427 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997410.828528:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c427 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997410.828539:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c427 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997410.828548:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997410.828600:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712947840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997410.828606:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1789997410.829387:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c62680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712947840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997410.829413:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997410.829424:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997410.829445:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997410.829451:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997410.829458:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997411.084461:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997411.626050:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997411.626149:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704428160 00000100:00100000:2.0:1789997411.626162:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704428160 00000100:00100000:2.0:1789997411.626288:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 11 00000100:00080000:1.0:1789997411.626294:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997411.626299:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:5580:x1876946704428160:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997411.626317:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997411.626348:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c3ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb30 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997411.626368:0:6674:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:2.0:1789997411.626380:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997411.626447:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704428160:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 149us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997411.626455:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 11 00010000:00010000:0.0:1789997412.106789:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997412.249500:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997412.249583:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704428288 00000100:00100000:3.0:1789997412.249595:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704428288 00000100:00100000:3.0:1789997412.249687:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 674 00000100:00100000:3.0:1789997412.249698:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45471:x1876946704428288:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997412.249720:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997412.249744:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb3e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.249804:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c43c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.249818:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c43c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.249830:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c43c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997412.249865:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997412.249870:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997412.249893:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c43c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.249915:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb3e expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.249932:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c43c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb3e expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.249940:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997412.249943:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997412.249946:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997412.250007:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45471:x1876946704428288:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 311us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997412.250014:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 674 00000100:00100000:0.0:1789997412.254191:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997412.254335:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704428416 00000100:00100000:1.0:1789997412.254346:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704428416 00000100:00100000:1.0:1789997412.254438:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 675 00000100:00100000:1.0:1789997412.254451:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45471:x1876946704428416:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997412.254473:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997412.254495:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c443 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb45 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.254559:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.254579:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.254593:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.254609:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.254617:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.254624:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.254997:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255008:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255017:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997412.255050:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789997412.255054:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997412.255074:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255086:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255097:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255103:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255109:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997412.255113:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255120:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255133:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:1.0:1789997412.255136:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997412.255142:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255148:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c44a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255161:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255167:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255173:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255178:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997412.255183:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255189:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255199:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38e062dd00) 00010000:00010000:1.0:1789997412.255202:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997412.255205:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255211:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c451 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255244:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c443 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb45 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255260:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb45 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.255267:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997412.255344:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997412.255348:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997412.255420:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45471:x1876946704428416:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 972us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997412.255428:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 675 00000100:00100000:0.0:1789997412.258071:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997412.258176:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704428672 00000100:00100000:1.0:1789997412.258190:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704428672 00000100:00100000:1.0:1789997412.258280:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 676 00000100:00100000:1.0:1789997412.258293:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45471:x1876946704428672:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997412.258342:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997412.258369:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb45 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.258401:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997412.258412:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997412.258438:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.258463:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.258475:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997412.289069:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2669949 reply state 000000004b211a2f transno 4294967553 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997412.289090:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997412.289106:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:2.0:1789997412.289223:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45471:x1876946704428672:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 30929us (31156us total) trans 4294967553 rc 0/0 00000100:00100000:2.0:1789997412.289234:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 676 00000001:00080000:2.0:1789997412.289277:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967553 is committed 00010000:00010000:2.0:1789997412.289298:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.289307:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.289315:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.289322:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997412.289326:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.289333:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.289350:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:2.0:1789997412.289353:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997412.289357:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.289364:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c45f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997412.334791:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997412.334947:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704428800 00000100:00100000:1.0:1789997412.334958:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704428800 00000100:00100000:1.0:1789997412.335019:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 677 00000100:00100000:1.0:1789997412.335030:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45475:x1876946704428800:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997412.335228:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997412.335250:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb4c expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335389:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335407:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335423:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335508:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335518:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335526:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335939:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c47b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335950:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.335959:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997412.335987:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789997412.335991:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997412.336010:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c47b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336022:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336030:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336037:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336049:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997412.336053:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336062:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336076:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:1.0:1789997412.336080:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997412.336085:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336092:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c46d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336105:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336111:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336117:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336122:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997412.336124:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336130:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336141:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38e062da00) 00010000:00010000:1.0:1789997412.336143:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997412.336146:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336152:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c474 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336183:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb4c expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336198:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c47b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb4c expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.336206:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:1.0:1789997412.336209:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997412.336212:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997412.337377:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45475:x1876946704428800:12345-192.168.204.4@tcp:101:touch.0 Request processed in 2342us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997412.337390:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 677 00000100:00100000:1.0:1789997412.340211:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997412.340348:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704429056 00000100:00100000:3.0:1789997412.340358:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704429056 00000100:00100000:3.0:1789997412.340414:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 678 00000100:00100000:3.0:1789997412.340425:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45475:x1876946704429056:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997412.340513:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997412.340599:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c482 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb53 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.341607:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.341625:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.341635:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.341872:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.341881:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.341898:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997412.342570:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:3.0:1789997412.342902:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.342914:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.342923:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.342957:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.342969:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.342977:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.342984:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997412.342988:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.342997:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.343008:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:3.0:1789997412.343011:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997412.343023:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.343030:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c489 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997412.343044:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042728664 reply state 00000000d90ae03d transno 4294967554 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997412.343053:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997412.343086:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c482 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb53 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.343100:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb53 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.343112:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997412.343114:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997412.343117:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789997412.343201:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:45475:x1876946704429056:12345-192.168.204.4@tcp:101:touch.0 Request processed in 2778us (2998us total) trans 4294967554 rc 0/0 00000100:00100000:3.0:1789997412.343209:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 678 00010000:00010000:2.0:1789997412.344711:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.344727:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.344740:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.344756:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997412.344761:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.344769:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.344784:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38ee49e700) 00010000:00010000:2.0:1789997412.344788:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997412.344792:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.344798:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c490 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997412.346757:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997412.346803:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704429312 00000100:00100000:0.0:1789997412.346814:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704429312 00000100:00100000:0.0:1789997412.346868:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 679 00000100:00100000:0.0:1789997412.346879:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:45475:x1876946704429312:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:0.0:1789997412.346935:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997412.346959:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb53 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997412.346978:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:0.0:1789997412.346987:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997412.347028:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997412.347042:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997412.347053:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997412.347194:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c9abfab reply state 00000000ed89a1e5 transno 4294967555 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997412.347204:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997412.347355:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:45475:x1876946704429312:12345-192.168.204.4@tcp:36:touch.0 Request processed in 477us (605us total) trans 4294967555 rc 0/0 00000100:00100000:0.0:1789997412.347363:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 679 00010000:00010000:2.0:1789997412.348435:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.348447:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.348456:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.348462:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997412.348480:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.348492:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.348507:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8a38c28e9600) 00010000:00010000:2.0:1789997412.348510:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997412.348516:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.348522:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c4a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997412.349021:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997412.349229:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704429440 00000100:00100000:3.0:1789997412.349237:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704429440 00000100:00100000:3.0:1789997412.349342:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 680 00000100:00100000:3.0:1789997412.349353:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:45475:x1876946704429440:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997412.349374:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997412.349393:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c4ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb5a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.349445:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c4ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb5a expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.349461:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c4ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb5a expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997412.349479:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997412.349483:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997412.349486:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:3.0:1789997412.349576:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:45475:x1876946704429440:12345-192.168.204.4@tcp:101:touch.0 Request processed in 225us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997412.349586:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 680 00000100:00100000:0.0:1789997412.352112:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997412.352298:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704429568 00000100:00100000:1.0:1789997412.352308:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704429568 00000100:00100000:1.0:1789997412.352357:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 353 00000100:00100000:1.0:1789997412.352365:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876946704429568:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:1.0:1789997412.352397:0:8169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1601 last 0 00000020:00000080:1.0:1789997412.352428:0:8169:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592c4b3 00002000:00100000:1.0:1789997412.352451:0:8169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38fb47b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789997412.352475:0:8169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789997412.352776:0:8169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789997412.352808:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38fb47c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789997412.352880:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704429568:12345-192.168.204.4@tcp:8:touch.0 Request processed in 514us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997412.352888:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 353 00000100:00100000:0.0:1789997412.354800:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997412.354972:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704429696 00000100:00100000:1.0:1789997412.354982:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704429696 00000100:00100000:1.0:1789997412.355058:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 354 00000100:00100000:1.0:1789997412.355069:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:0:x1876946704429696:12345-192.168.204.4@tcp:2:touch.0 00000100:00080000:2.0:1789997412.355084:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997412.390491:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:0:x1876946704429696:12345-192.168.204.4@tcp:2:touch.0 Request processed in 35414us (35689us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789997412.390505:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 354 00000001:00080000:2.0:1789997412.390579:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967338 is committed 00000001:00100000:2.0:1789997412.390589:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:3.0:1789997412.394006:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997412.394158:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704429952 00000100:00100000:0.0:1789997412.394170:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704429952 00000100:00100000:0.0:1789997412.394273:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:0.0:1789997412.394283:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:45475:x1876946704429952:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:0.0:1789997412.394624:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45475:x1876946704429952:12345-192.168.204.4@tcp:35:touch.0 Request processed in 341us (627us total) trans 4294967556 rc 0/0 00000100:00100000:0.0:1789997412.394632:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 72 00000100:00100000:3.0:1789997412.438166:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997412.438291:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704430080 00000100:00100000:1.0:1789997412.438304:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704430080 00000100:00100000:1.0:1789997412.438367:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 681 00000100:00100000:1.0:1789997412.438378:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45479:x1876946704430080:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997412.438402:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997412.438421:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c4ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb61 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438624:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438641:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438712:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438735:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438743:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438750:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438838:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c4cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438846:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.438853:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997412.438970:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 0 00000004:00200000:1.0:1789997412.438976:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997412.438999:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439012:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c4cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439024:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439031:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439038:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439044:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997412.439048:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439055:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439067:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:1.0:1789997412.439070:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997412.439075:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439081:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c4c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439093:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439099:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439104:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439109:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997412.439112:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439117:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439122:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38e062da00) 00010000:00010000:1.0:1789997412.439124:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997412.439126:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439131:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c4c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439161:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c4ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb61 expref: 13 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439174:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c4cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb61 expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.439181:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997412.439183:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997412.439186:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997412.439409:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45479:x1876946704430080:12345-192.168.204.4@tcp:101:rm.0 Request processed in 1031us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997412.439417:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 681 00000100:00100000:3.0:1789997412.447784:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997412.448703:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704430208 00000100:00100000:2.0:1789997412.448715:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704430208 00000100:00100000:2.0:1789997412.448788:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 355 00000100:00100000:2.0:1789997412.448800:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704430208:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997412.448819:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997412.448840:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb68 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997412.448870:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x6ab13164, atime: 0x6ab13164, ctime: 0x6ab13164, blocks: 0x1 00010000:00010000:2.0:1789997412.448891:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=1601s v=(0 0) 00010000:00010000:2.0:1789997412.448895:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997412.448905:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.448930:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.448943:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997412.449014:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704430208:12345-192.168.204.4@tcp:101:rm.0 Request processed in 216us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997412.449022:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 355 00000100:00100000:3.0:1789997412.455149:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997412.455257:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704430464 00000100:00100000:2.0:1789997412.455268:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704430464 00000100:00100000:2.0:1789997412.455333:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 682 00000100:00100000:2.0:1789997412.455344:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45479:x1876946704430464:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997412.455403:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997412.455436:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c4cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb61 expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455459:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c4ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb5a expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455471:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:2.0:1789997412.455500:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997412.455523:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455537:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455551:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455565:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455573:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455580:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455895:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455904:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.455912:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997412.456479:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9536 00000004:00080000:2.0:1789997412.456489:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1601148834873ns, next at 1602148832553ns, rc = 0 00010000:00010000:2.0:1789997412.456550:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.456561:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.456569:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.456582:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.456589:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.456596:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457077:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997412.457105:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457113:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457120:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457125:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997412.457130:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457138:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457150:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997412.457153:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997412.457157:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457168:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c4eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457185:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457191:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457196:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457201:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997412.457204:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457210:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457217:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:2.0:1789997412.457220:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997412.457223:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.457229:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c4dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997412.457239:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bf59ca1 reply state 00000000f5f78d6f transno 4294967557 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997412.457248:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997412.457333:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45479:x1876946704430464:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1988us (2192us total) trans 4294967557 rc 0/0 00000100:00100000:2.0:1789997412.457342:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 682 00010000:00010000:1.0:1789997412.458278:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997412.458287:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.458296:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997412.458300:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.458308:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.458322:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:1.0:1789997412.458324:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997412.458328:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.458334:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c4f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997412.458353:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997412.458355:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997412.458357:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997412.459509:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.459523:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.459530:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.459535:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997412.459539:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.459546:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.459560:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997412.459563:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997412.459567:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997412.459573:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c4e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997412.811875:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712947968:0@lo:400:kworker.0 00000100:00100000:2.0:1789997412.811956:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997412.812056:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712947968 00000100:00100000:0.0:1789997412.812066:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712947968 00000100:00100000:0.0:1789997412.812112:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:0.0:1789997412.812121:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712947968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.812325:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712947968:12345-0@lo:400:kworker.0 Request processed in 204us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997412.812333:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1789997412.812518:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997412.812561:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997412.812570:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712948352:0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.812598:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997412.812622:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712948352 00000100:00100000:0.0:1789997412.812625:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712948352 00000100:00100000:0.0:1789997412.812688:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1789997412.812695:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712948352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.812733:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712948352:12345-0@lo:400:kworker.0 Request processed in 38us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997412.812738:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1789997412.812774:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712948352:0@lo:400:kworker.0 00000100:00100000:2.0:1789997412.812850:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712947968:0@lo:400:kworker.0 00000100:00100000:2.0:1789997412.812863:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997412.812869:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712948096:0@lo:400:kworker.0 00000100:00100000:2.0:1789997412.812960:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789997412.813072:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997412.813990:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712948096 00000100:00100000:0.0:1789997412.814000:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712948096 00000100:00100000:0.0:1789997412.814043:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1789997412.814052:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712948096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.814118:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712948096:12345-0@lo:400:kworker.0 Request processed in 66us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997412.814126:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1789997412.814135:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712948224:0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.814186:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712948096:0@lo:400:kworker.0 00000100:00100000:3.0:1789997412.814195:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997412.814697:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712948224 00000100:00100000:0.0:1789997412.814702:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712948224 00000100:00100000:0.0:1789997412.814742:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1789997412.814750:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712948224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.814795:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712948224:12345-0@lo:400:kworker.0 Request processed in 46us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997412.814802:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:3.0:1789997412.814826:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997412.814837:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712948224:0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.816897:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712948480:0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.816964:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997412.817089:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712948480 00000100:00100000:3.0:1789997412.817097:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712948480 00000100:00100000:3.0:1789997412.817155:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1789997412.817164:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712948480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997412.819649:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712948480:12345-0@lo:400:kworker.0 Request processed in 2480us (2679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997412.819685:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00080000:3.0:1789997412.819722:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997412.821781:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712948608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997412.821856:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997412.821971:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712948608 00000100:00100000:2.0:1789997412.821981:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712948608 00000100:00100000:2.0:1789997412.822038:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1789997412.822046:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712948608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997412.823778:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712948480:0@lo:400:kworker.0 00000100:00100000:2.0:1789997412.824049:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712948608:12345-0@lo:400:kworker.0 Request processed in 2001us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997412.824059:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00080000:2.0:1789997412.824100:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997412.826041:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712948608:0@lo:400:kworker.0 00000100:00100000:3.0:1789997413.058123:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997413.058407:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704430592 00000100:00100000:0.0:1789997413.058418:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704430592 00000100:00100000:0.0:1789997413.058506:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 683 00000100:00100000:0.0:1789997413.058517:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45495:x1876946704430592:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997413.058545:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997413.058567:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c4f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb6f expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.058785:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c500 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789997413.058791:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997413.058805:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.058822:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997413.058858:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:0.0:1789997413.058862:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997413.058896:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.058925:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c4f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb6f expref: 13 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.058944:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb6f expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.058953:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:0.0:1789997413.058956:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997413.058959:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ee00, rc 0) 00000100:00100000:0.0:1789997413.059027:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45495:x1876946704430592:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 512us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997413.059035:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 683 00000100:00100000:3.0:1789997413.061252:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997413.061988:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704430848 00000100:00100000:0.0:1789997413.062000:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704430848 00000100:00100000:0.0:1789997413.062090:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 684 00000100:00100000:0.0:1789997413.062554:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45495:x1876946704430848:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997413.062617:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997413.062688:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb6f expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.062785:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c47b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb4c expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.062798:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:0.0:1789997413.062810:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997413.062840:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.062855:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.063317:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997413.109191:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967558 is committed 00000004:00080000:2.0:1789997413.109216:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 61 committed 00000004:00010000:0.0:1789997413.109332:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e9b042b reply state 00000000b347de66 transno 4294967558 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997413.109347:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997413.109365:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00080000:0.0:1789997413.109480:0:5810:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997413.109506:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45495:x1876946704430848:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 47401us (48265us total) trans 4294967558 rc 0/0 00000100:00100000:0.0:1789997413.109516:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 684 00010000:00010000:1.0:1789997413.109548:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.109559:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.109567:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.109574:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997413.109579:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.109588:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.109603:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:1.0:1789997413.109606:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997413.109611:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.109618:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c507 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997413.109693:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712948736:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997413.109752:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997413.109822:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712948736 00000100:00100000:1.0:1789997413.109829:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712948736 00000100:00100000:1.0:1789997413.109960:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789997413.109971:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712948736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789997413.109996:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:21 count 1 00010000:00010000:1.0:1789997413.110020:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.110037:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.110053:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997413.110071:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997413.110077:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.110107:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.110122:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 5 pid: 6658 timeout: 1701 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997413.110134:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712948864:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997413.110173:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d057b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789997413.112546:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997413.112622:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712948864:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997413.112676:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997413.114367:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704430976 00000100:00100000:0.0:1789997413.114381:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704430976 00010000:00010000:0.0:1789997413.114434:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 6 pid: 6658 timeout: 1701 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997413.114492:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 349 00000100:00100000:0.0:1789997413.114503:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704430976:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789997413.114521:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997413.114528:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 6 pid: 6658 timeout: 1701 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.114542:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 6 pid: 6658 timeout: 1701 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.114571:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592c4d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb68 expref: 6 pid: 6658 timeout: 1701 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.114588:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997413.114593:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997413.114598:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.114608:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.114636:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997413.114682:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.114694:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.114704:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.114714:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.114734:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997413.114745:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704430976:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 243us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997413.114753:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 349 00010000:00010000:2.0:1789997413.115361:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997413.115368:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.115377:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997413.115381:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.115390:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.115403:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.115410:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c50e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.115430:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997413.115432:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997413.115435:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997413.115568:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712948736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5597us (5814us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1789997413.115577:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000004:00080000:0.0:1789997413.115593:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3e1880/2, rc 0, transno 4294967339 00000100:00100000:0.0:1789997413.115602:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712948736:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789997413.133100:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997413.160353:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997413.160454:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704431104 00000100:00100000:0.0:1789997413.160539:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704431104 00000100:00100000:0.0:1789997413.160838:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 685 00000100:00100000:0.0:1789997413.160850:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45499:x1876946704431104:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997413.160877:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997413.160904:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb76 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.160972:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.160988:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.160999:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161014:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161022:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161029:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161405:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c52a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161416:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c52a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161423:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c52a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997413.161452:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:0.0:1789997413.161456:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997413.161624:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c52a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161642:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161686:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161694:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161700:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997413.161705:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161713:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161725:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:0.0:1789997413.161729:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997413.161734:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161740:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c51c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161752:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161758:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161763:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161768:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997413.161770:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161775:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161782:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997413.161784:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997413.161787:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161792:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161823:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb76 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161843:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c52a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb76 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.161850:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997413.161853:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997413.161855:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ee00, rc 0) 00000100:00100000:0.0:1789997413.162017:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45499:x1876946704431104:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1167us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997413.162025:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 685 00000100:00100000:0.0:1789997413.164475:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997413.164549:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704431360 00000100:00100000:1.0:1789997413.164560:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704431360 00000100:00100000:1.0:1789997413.164619:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 686 00000100:00100000:1.0:1789997413.164630:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45499:x1876946704431360:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997413.164688:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997413.164708:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c531 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb7d expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.164976:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.164992:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.165005:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.165019:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.165026:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.165033:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997413.165793:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:1.0:1789997413.166111:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166127:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166137:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166178:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166186:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166192:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166199:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997413.166203:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166210:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166222:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:1.0:1789997413.166226:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997413.166232:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166238:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c538 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997413.166254:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009dda08e5 reply state 0000000054181496 transno 4294967559 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997413.166266:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997413.166309:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c531 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb7d expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166327:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb7d expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.166335:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:1.0:1789997413.166337:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997413.166339:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997413.166500:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:45499:x1876946704431360:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1871us (2049us total) trans 4294967559 rc 0/0 00000100:00100000:1.0:1789997413.166510:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 686 00010000:00010000:1.0:1789997413.168815:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.168834:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.168842:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.168854:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997413.168860:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.168868:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.168884:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38e062da00) 00010000:00010000:1.0:1789997413.168887:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997413.168892:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.168900:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c53f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997413.173991:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997413.174142:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704431616 00000100:00100000:1.0:1789997413.174213:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704431616 00000100:00100000:1.0:1789997413.174305:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 687 00000100:00100000:1.0:1789997413.174316:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:45499:x1876946704431616:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:1.0:1789997413.174367:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997413.174392:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb7d expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.174434:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:1.0:1789997413.174445:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997413.174494:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.174510:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.174523:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997413.174706:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d21461e reply state 000000002a51bf91 transno 4294967560 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997413.174715:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997413.174809:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:45499:x1876946704431616:12345-192.168.204.4@tcp:36:touch.0 Request processed in 495us (827us total) trans 4294967560 rc 0/0 00000100:00100000:1.0:1789997413.174817:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 687 00010000:00010000:0.0:1789997413.176071:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.176084:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.176091:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.176097:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997413.176101:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.176109:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.176121:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:0.0:1789997413.176125:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997413.176130:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997413.176136:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c554 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997413.178784:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997413.178965:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704431744 00000100:00100000:2.0:1789997413.178975:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704431744 00000100:00100000:2.0:1789997413.179064:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 688 00000100:00100000:2.0:1789997413.179074:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:45499:x1876946704431744:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997413.179100:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997413.179120:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c55b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb84 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.179180:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c55b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb84 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.179195:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c55b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb84 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.179213:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997413.179216:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997413.179220:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2400, rc 0) 00000100:00100000:2.0:1789997413.179289:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:45499:x1876946704431744:12345-192.168.204.4@tcp:101:touch.0 Request processed in 216us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997413.179300:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 688 00000100:00100000:3.0:1789997413.181243:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997413.181611:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704431872 00000100:00100000:1.0:1789997413.181619:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704431872 00000100:00100000:1.0:1789997413.181746:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 357 00000100:00100000:1.0:1789997413.181754:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876946704431872:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:1.0:1789997413.181796:0:8169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1601 last 0 00000020:00000080:1.0:1789997413.181827:0:8169:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592c562 00002000:00100000:1.0:1789997413.181841:0:8169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38fb47e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789997413.181866:0:8169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789997413.182095:0:8169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789997413.182122:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38fb47e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789997413.182175:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704431872:12345-192.168.204.4@tcp:8:touch.0 Request processed in 419us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997413.182182:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 357 00000100:00100000:3.0:1789997413.184407:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997413.184482:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704432000 00000100:00100000:0.0:1789997413.184492:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704432000 00000100:00100000:0.0:1789997413.184562:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 358 00000100:00100000:0.0:1789997413.184572:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:0:x1876946704432000:12345-192.168.204.4@tcp:2:touch.0 00000100:00080000:2.0:1789997413.184931:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789997413.218129:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00000001:00100000:1.0:1789997413.218146:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:0.0:1789997413.218420:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7414850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:0:x1876946704432000:12345-192.168.204.4@tcp:2:touch.0 Request processed in 33842us (34015us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789997413.218433:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 358 00000100:00100000:0.0:1789997413.220819:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997413.221120:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704432256 00000100:00100000:1.0:1789997413.221132:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704432256 00000100:00100000:1.0:1789997413.221332:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:1.0:1789997413.221343:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:45499:x1876946704432256:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:1.0:1789997413.221852:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45499:x1876946704432256:12345-192.168.204.4@tcp:35:touch.0 Request processed in 509us (1038us total) trans 4294967561 rc 0/0 00000100:00100000:1.0:1789997413.221860:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 73 00000100:00100000:3.0:1789997413.265278:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997413.265408:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704432384 00000100:00100000:1.0:1789997413.265419:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704432384 00000100:00100000:1.0:1789997413.265486:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 689 00000100:00100000:1.0:1789997413.265498:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45503:x1876946704432384:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997413.265526:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997413.265548:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb8b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265613:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265629:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265686:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265706:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265714:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265722:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265817:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c57e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265827:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265834:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997413.265886:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x39:0x0]: returning size 0 00000004:00200000:1.0:1789997413.265891:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997413.265916:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265929:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c57e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265938:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265945:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265952:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265958:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997413.265962:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265970:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265983:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:1.0:1789997413.265986:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997413.265991:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.265997:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266010:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266016:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266022:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266027:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997413.266029:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266035:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266043:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38e062d000) 00010000:00010000:1.0:1789997413.266045:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997413.266048:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266053:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266089:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb8b expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266106:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c57e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb8b expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.266115:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:1.0:1789997413.266117:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997413.266120:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997413.266198:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45503:x1876946704432384:12345-192.168.204.4@tcp:101:rm.0 Request processed in 702us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997413.266206:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 689 00000100:00100000:3.0:1789997413.270169:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997413.270287:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704432512 00000100:00100000:2.0:1789997413.270299:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704432512 00000100:00100000:2.0:1789997413.270366:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 359 00000100:00100000:2.0:1789997413.270376:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704432512:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997413.270396:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997413.270425:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb92 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997413.270455:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x6ab13165, atime: 0x6ab13165, ctime: 0x6ab13165, blocks: 0x1 00010000:00010000:2.0:1789997413.270477:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=1601s v=(0 0) 00010000:00010000:2.0:1789997413.270481:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997413.270492:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.270513:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.270531:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997413.270598:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704432512:12345-192.168.204.4@tcp:101:rm.0 Request processed in 222us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997413.270605:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 359 00000100:00100000:0.0:1789997413.273965:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997413.274074:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704432768 00000100:00100000:3.0:1789997413.274084:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704432768 00000100:00100000:3.0:1789997413.274144:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 690 00000100:00100000:3.0:1789997413.274156:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45503:x1876946704432768:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997413.274211:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997413.274241:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c57e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb8b expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274399:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c55b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb84 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274411:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:3.0:1789997413.274425:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997413.274453:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274467:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274476:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274490:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274498:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274504:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274608:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274618:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.274625:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997413.275506:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9536 00000004:00080000:3.0:1789997413.275518:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1601967863694ns, next at 1602967861613ns, rc = 0 00010000:00010000:3.0:1789997413.275581:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275592:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275601:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275608:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275633:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275649:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275701:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997413.275722:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275728:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275735:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275741:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997413.275745:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275753:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275762:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997413.275765:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997413.275769:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275774:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c59a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275792:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275798:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275804:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275809:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997413.275812:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275820:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275826:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:3.0:1789997413.275829:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997413.275831:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.275837:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c58c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997413.275847:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5bde584 reply state 00000000c86a6e28 transno 4294967562 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997413.275856:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997413.275947:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45503:x1876946704432768:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1790us (1990us total) trans 4294967562 rc 0/0 00000100:00100000:3.0:1789997413.275956:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 690 00010000:00010000:1.0:1789997413.276040:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997413.276048:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.276054:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997413.276057:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.276063:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.276072:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:1.0:1789997413.276074:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997413.276077:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.276082:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c5a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.276097:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997413.276099:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997413.276100:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997413.280422:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.280441:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.280450:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.280455:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997413.280460:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.280468:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.280487:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38ee49ed00) 00010000:00010000:1.0:1789997413.280491:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997413.280497:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.280503:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c593 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997413.974624:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997413.974717:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704432896 00000100:00100000:1.0:1789997413.974728:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704432896 00000100:00100000:1.0:1789997413.974792:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 691 00000100:00100000:1.0:1789997413.974804:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45517:x1876946704432896:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997413.974831:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997413.974854:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c5a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeb99 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.974940:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c5af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.974956:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.974971:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997413.975007:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789997413.975011:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997413.975030:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c5af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.975054:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c5a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb99 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.975072:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c5af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb99 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997413.975081:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:1.0:1789997413.975084:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997413.975088:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997413.975155:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45517:x1876946704432896:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 353us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997413.975166:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 691 00000100:00100000:3.0:1789997413.977592:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997413.977706:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704433152 00000100:00100000:2.0:1789997413.977715:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704433152 00000100:00100000:2.0:1789997413.977770:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 692 00000100:00100000:2.0:1789997413.977784:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45517:x1876946704433152:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997413.977844:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997413.977879:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c5af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb99 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.977904:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c52a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb76 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.977916:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:2.0:1789997413.977931:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997413.977958:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.977971:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997413.977983:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997413.978237:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffd04675 reply state 000000009cf95056 transno 4294967563 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997413.978259:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997413.978268:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:2.0:1789997413.978347:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45517:x1876946704433152:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 564us (762us total) trans 4294967563 rc 0/0 00000100:00100000:2.0:1789997413.978355:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 692 00010000:00010000:3.0:1789997413.980564:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.980583:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.980592:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.980598:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997413.980604:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.980613:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.980640:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997413.980644:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997413.980650:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997413.980679:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c5b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997414.099065:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997414.099146:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704433280 00000100:00100000:1.0:1789997414.099157:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704433280 00000100:00100000:1.0:1789997414.099223:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 693 00000100:00100000:1.0:1789997414.099234:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45529:x1876946704433280:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997414.099339:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45529:x1876946704433280:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997414.099347:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 693 00000100:00100000:2.0:1789997414.104207:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997414.104623:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704433408 00000100:00100000:1.0:1789997414.104644:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704433408 00000100:00100000:1.0:1789997414.104745:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 360 00000100:00100000:1.0:1789997414.104756:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45529:x1876946704433408:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997414.105304:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45529:x1876946704433408:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 430us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997414.105315:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 360 00000100:00100000:2.0:1789997414.109841:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997414.110212:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704433536 00000100:00100000:1.0:1789997414.110224:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704433536 00000100:00100000:1.0:1789997414.110364:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 361 00000100:00100000:1.0:1789997414.110376:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45529:x1876946704433536:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997414.110857:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45529:x1876946704433536:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 481us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997414.110864:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 361 00000100:00080000:2.0:1789997414.111465:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997414.112734:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997414.112792:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704433664 00000100:00100000:1.0:1789997414.112800:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704433664 00000100:00100000:1.0:1789997414.112853:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 694 00000100:00100000:1.0:1789997414.112866:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45529:x1876946704433664:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997414.114958:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45529:x1876946704433664:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 2088us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997414.114971:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 694 00000100:00100000:3.0:1789997414.120969:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997414.121196:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704433792 00000100:00100000:2.0:1789997414.121207:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704433792 00000100:00100000:2.0:1789997414.121269:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 695 00000100:00100000:2.0:1789997414.121280:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45529:x1876946704433792:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997414.121393:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45529:x1876946704433792:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 114us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997414.121401:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 695 00000100:00100000:3.0:1789997414.127590:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997414.127821:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704433920 00000100:00100000:1.0:1789997414.127834:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704433920 00000100:00100000:1.0:1789997414.127945:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 362 00000100:00100000:1.0:1789997414.127956:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45529:x1876946704433920:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997414.128376:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45529:x1876946704433920:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 420us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997414.128384:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 362 00000100:00100000:3.0:1789997414.132583:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997414.133016:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704434048 00000100:00100000:2.0:1789997414.133028:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704434048 00000100:00100000:2.0:1789997414.133094:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 363 00000100:00100000:2.0:1789997414.133106:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45529:x1876946704434048:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997414.133514:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45529:x1876946704434048:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 408us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997414.133522:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 363 00000100:00100000:3.0:1789997414.138313:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997414.138398:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704434176 00000100:00100000:1.0:1789997414.138410:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704434176 00000100:00100000:1.0:1789997414.138476:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 696 00000100:00100000:1.0:1789997414.138488:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45529:x1876946704434176:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997414.142582:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45529:x1876946704434176:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 4085us (4266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997414.142597:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 696 00010000:00010000:2.0:1789997414.155704:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997414.191280:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997414.191552:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704434304 00000100:00100000:2.0:1789997414.191562:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704434304 00000100:00100000:2.0:1789997414.191754:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 697 00000100:00100000:2.0:1789997414.191766:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:45533:x1876946704434304:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:2.0:1789997414.191788:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997414.191809:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c5bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeba0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.191880:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.191895:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.191917:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.191933:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.191940:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.191946:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192221:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c5d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192230:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192238:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997414.192266:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:2.0:1789997414.192270:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997414.192289:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c5d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192300:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192307:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192318:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192324:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997414.192328:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192336:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192348:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:2.0:1789997414.192351:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997414.192357:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192363:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592c5c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192375:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192382:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192388:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192392:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997414.192395:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192405:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192412:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997414.192414:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997414.192417:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.192424:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c5cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.193889:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c5bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeba0 expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.193911:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c5d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeba0 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997414.193920:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997414.193923:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997414.193926:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:3.0:1789997414.194766:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45533:x1876946704434304:12345-192.168.204.4@tcp:101:dd.0 Request processed in 2998us (3492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997414.194775:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 697 00000100:00100000:0.0:1789997414.200021:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997414.202479:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704434560 00000100:00100000:3.0:1789997414.202493:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704434560 00000100:00100000:3.0:1789997414.202636:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 698 00000100:00100000:3.0:1789997414.202649:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:45533:x1876946704434560:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:3.0:1789997414.202689:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997414.202713:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c5d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeba7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.202845:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.202866:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.202879:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.202894:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.202902:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.202909:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997414.203445:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:3.0:1789997414.203641:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c5ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203670:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203679:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c5ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203720:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203732:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203739:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203745:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997414.203750:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203757:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203771:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997414.203774:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997414.203781:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203787:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c5e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997414.203802:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009401c306 reply state 000000003f483622 transno 4294967564 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997414.203810:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997414.203843:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c5d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeba7 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203856:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c5ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeba7 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.203867:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997414.203870:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997414.203872:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997414.203950:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+15:45533:x1876946704434560:12345-192.168.204.4@tcp:101:dd.0 Request processed in 1303us (3937us total) trans 4294967564 rc 0/0 00000100:00100000:3.0:1789997414.203958:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 698 00010000:00010000:1.0:1789997414.214214:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.214236:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.214245:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.214252:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997414.214257:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.214269:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.214347:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38ee49e600) 00010000:00010000:1.0:1789997414.214351:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997414.214358:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.214365:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c5e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997414.215051:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997414.215290:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704434688 00000100:00100000:0.0:1789997414.215301:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704434688 00000100:00100000:0.0:1789997414.215365:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 364 00000100:00100000:0.0:1789997414.215382:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45533:x1876946704434688:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997414.215402:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997414.215424:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebae expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997414.215450:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789997414.215472:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1602s v=(0 0) 00010000:00010000:0.0:1789997414.215478:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997414.215489:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997414.215508:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997414.215521:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660f800, rc 0) 00000100:00100000:0.0:1789997414.215589:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45533:x1876946704434688:12345-192.168.204.4@tcp:101:dd.0 Request processed in 210us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997414.215596:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 364 00000100:00100000:2.0:1789997414.245773:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997414.246414:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704434816 00000100:00100000:0.0:1789997414.246426:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704434816 00002000:00100000:0.0:1789997414.246485:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x16:0x0] (0->1048575) req@ffff8a38ffd70700 x1876946704434816/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:390/0 lens 488/0 e 0 to 0 dl 1789997425 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789997414.246498:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38ffd70700 with x1876946704434816 ext(0->1048575) 00002000:00010000:0.0:1789997414.246505:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38ffd70700 00000100:00100000:0.0:1789997414.246543:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:0.0:1789997414.246553:0:6663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704434816:12345-192.168.204.4@tcp:4:dd.0 00000100:00100000:0.0:1789997414.275123:0:6663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704434816:12345-192.168.204.4@tcp:4:dd.0 Request processed in 28559us (29348us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789997414.275210:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00002000:00100000:0.0:1789997414.275226:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x16:0x0] (0->1048575) req@ffff8a38ffd70700 x1876946704434816/t4294967340(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:390/0 lens 488/448 e 0 to 0 dl 1789997425 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789997414.275237:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38ffd70700 with x1876946704434816 ext(0->1048575) 00002000:00010000:0.0:1789997414.275245:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38ffd70700 00000100:00100000:3.0:1789997414.279838:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997414.280837:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704434944 00000100:00100000:0.0:1789997414.280848:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704434944 00000100:00100000:0.0:1789997414.281116:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 699 00000100:00100000:0.0:1789997414.281127:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:45533:x1876946704434944:12345-192.168.204.4@tcp:44:dd.0 00000100:00100000:3.0:1789997414.311034:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:45533:x1876946704434944:12345-192.168.204.4@tcp:44:dd.0 Request processed in 29897us (31194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997414.311047:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 699 00000001:00080000:1.0:1789997414.311401:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967561 is committed 00000001:00080000:1.0:1789997414.311418:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967563 is committed 00000001:00080000:1.0:1789997414.311427:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967564 is committed 00000004:00080000:1.0:1789997414.311437:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 59 committed 00000100:00100000:3.0:1789997414.311714:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997414.311731:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712948992:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789997414.311788:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997414.311864:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712948992 00000100:00100000:3.0:1789997414.311872:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712948992 00000100:00100000:3.0:1789997414.311925:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789997414.311934:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712948992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789997414.311960:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:21 count 1 00010000:00010000:3.0:1789997414.311987:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.312011:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.312022:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789997414.312027:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997414.312032:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.312064:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.312080:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 5 pid: 6658 timeout: 1703 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997414.312094:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946712949120:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997414.312164:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5ce40 going to sleep for 11 seconds 00000100:00080000:3.0:1789997414.312178:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997414.314507:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946712949120:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997414.314536:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997414.323228:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997414.323282:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997414.323373:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704435072 00000100:00100000:3.0:1789997414.323384:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704435072 00000100:00100000:3.0:1789997414.323443:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 366 00000100:00100000:3.0:1789997414.323458:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704435072:12345-192.168.204.4@tcp:16:dd.0 00000100:00100000:1.0:1789997414.324517:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704435200 00000100:00100000:1.0:1789997414.324524:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704435200 00010000:00010000:1.0:1789997414.324554:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 6 pid: 6658 timeout: 1703 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997414.324593:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 350 00000100:00100000:1.0:1789997414.324601:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704435200:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997414.324613:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997414.324630:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 6 pid: 6658 timeout: 1703 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.324643:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 6 pid: 6658 timeout: 1703 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.324696:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cb882fe/0x65b43101d592c585 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb92 expref: 6 pid: 6658 timeout: 1703 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.324713:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997414.324717:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997414.324722:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.324935:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.324970:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997414.325032:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704435200:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 432us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997414.325039:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 350 00010000:00010000:3.0:1789997414.325095:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.325105:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.325115:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.325129:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997414.325150:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997414.327517:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997414.327530:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.327544:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997414.327549:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.327561:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.327590:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.327599:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592c603 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997414.327636:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997414.327638:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997414.327640:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997414.327708:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712948992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15772us (15917us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1789997414.327719:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000004:00080000:2.0:1789997414.327921:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3baa00/2, rc 0, transno 4294967339 00000100:00100000:2.0:1789997414.327930:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712948992:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1789997414.357133:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967340 is committed 00000001:00080000:2.0:1789997414.357157:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00000100:00100000:3.0:1789997414.358224:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704435072:12345-192.168.204.4@tcp:16:dd.0 Request processed in 34760us (34997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997414.358237:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 366 00000100:00100000:0.0:1789997414.362917:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997414.364472:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704435456 00000100:00100000:3.0:1789997414.364486:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704435456 00000100:00100000:3.0:1789997414.364559:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:3.0:1789997414.364570:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45533:x1876946704435456:12345-192.168.204.4@tcp:35:dd.0 00000100:00100000:3.0:1789997414.365281:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:45533:x1876946704435456:12345-192.168.204.4@tcp:35:dd.0 Request processed in 710us (2427us total) trans 4294967565 rc 0/0 00000100:00100000:3.0:1789997414.365291:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 74 00000100:00100000:0.0:1789997414.678470:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997414.680208:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704435584 00000100:00100000:3.0:1789997414.680222:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704435584 00000100:00100000:3.0:1789997414.680355:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 997 00000100:00100000:3.0:1789997414.680366:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704435584:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997414.680454:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704435584:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 90us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997414.680461:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 997 00000100:00100000:0.0:1789997414.859036:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712949248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997414.859113:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997414.859469:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712949248 00000100:00100000:3.0:1789997414.859480:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712949248 00000100:00100000:3.0:1789997414.859533:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1789997414.859543:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712949248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997414.859578:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997414.859643:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712949248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997414.859649:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1789997414.859804:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712949376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997414.859853:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997414.859916:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712949248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997414.859976:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712949376 00000100:00100000:2.0:1789997414.859981:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712949376 00000100:00100000:2.0:1789997414.860028:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1789997414.860035:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712949376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997414.860057:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789997414.860090:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712949376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997414.860096:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00080000:0.0:1789997414.860192:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997414.860212:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:0.0:1789997414.860229:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3e1880, transno 4294967339 00000100:00100000:0.0:1789997414.860250:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712949376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997415.179565:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997415.197957:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967565 is committed 00000004:00080000:1.0:1789997416.054408:0:78508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1604746751004ns, next at 1602967861613ns, rc = 0 00000004:00080000:1.0:1789997416.054900:0:78508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1604747245391ns, next at 1602148832553ns, rc = 0 00000004:00080000:2.0:1789997416.057880:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 60 committed 00000004:00080000:2.0:1789997416.062901:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 62 committed 00010000:00010000:3.0:1789997416.203019:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997416.917017:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00000100:00100000:1.0:1789997417.004844:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997417.005039:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704435712 00000100:00100000:3.0:1789997417.005050:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704435712 00000100:00100000:3.0:1789997417.005119:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 700 00000100:00100000:3.0:1789997417.005131:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45725:x1876946704435712:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997417.005242:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45725:x1876946704435712:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 113us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997417.005249:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 700 00000100:00080000:1.0:1789997417.005462:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997417.007696:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997417.007732:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704435840 00000100:00100000:1.0:1789997417.007741:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704435840 00000100:00080000:0.0:1789997417.007776:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997417.007805:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 367 00000100:00100000:0.0:1789997417.007818:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45725:x1876946704435840:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997417.008836:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45725:x1876946704435840:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1016us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997417.008846:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 367 00000100:00100000:3.0:1789997417.011225:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997417.011462:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704435968 00000100:00100000:1.0:1789997417.011474:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704435968 00000100:00100000:1.0:1789997417.011632:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 368 00000100:00100000:1.0:1789997417.011643:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45725:x1876946704435968:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997417.012036:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45725:x1876946704435968:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 394us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997417.012044:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 368 00000100:00080000:0.0:1789997417.012188:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997417.018183:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997417.018245:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704436096 00000100:00100000:0.0:1789997417.018256:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704436096 00000100:00100000:0.0:1789997417.018333:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 701 00000100:00100000:0.0:1789997417.018345:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45725:x1876946704436096:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997417.018907:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45725:x1876946704436096:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 561us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997417.018916:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 701 00000100:00100000:1.0:1789997417.023897:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997417.023982:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704436224 00000100:00100000:0.0:1789997417.023995:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704436224 00000100:00100000:0.0:1789997417.024061:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 702 00000100:00100000:0.0:1789997417.024073:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45725:x1876946704436224:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997417.024775:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45725:x1876946704436224:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 702us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997417.024784:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 702 00000100:00100000:3.0:1789997417.027985:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997417.028188:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704436352 00000100:00100000:1.0:1789997417.028438:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704436352 00000100:00100000:1.0:1789997417.028501:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 369 00000100:00100000:1.0:1789997417.028513:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45725:x1876946704436352:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997417.030042:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45725:x1876946704436352:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1525us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997417.030053:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 369 00000100:00100000:1.0:1789997417.034965:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997417.035019:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704436480 00000100:00100000:3.0:1789997417.035031:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704436480 00000100:00100000:3.0:1789997417.035100:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 370 00000100:00100000:3.0:1789997417.035112:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45725:x1876946704436480:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997417.035892:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:45725:x1876946704436480:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 780us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997417.035901:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 370 00000100:00100000:3.0:1789997417.037914:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997417.038309:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704436608 00000100:00100000:1.0:1789997417.038318:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704436608 00000100:00100000:1.0:1789997417.038366:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 703 00000100:00100000:1.0:1789997417.038374:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45725:x1876946704436608:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997417.038956:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45725:x1876946704436608:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 579us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997417.038966:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 703 00000100:00100000:0.0:1789997417.094593:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997417.094969:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704436864 00000100:00100000:1.0:1789997417.094982:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704436864 00000100:00100000:1.0:1789997417.095054:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 704 00000100:00100000:1.0:1789997417.095066:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:45729:x1876946704436864:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997417.095115:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997417.095148:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c5ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeba7 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095168:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:1.0:1789997417.095179:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997417.095203:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095217:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095226:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095242:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095249:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095255:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095550:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095560:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.095577:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997417.096839:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9600 00000004:00080000:1.0:1789997417.096853:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1605789198684ns, next at 1606789195477ns, rc = 0 00010000:00010000:1.0:1789997417.096956:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.096971:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.096981:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.096989:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.096996:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097002:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097027:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997417.097052:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097059:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097066:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097071:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997417.097075:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097087:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097098:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997417.097101:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997417.097105:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097111:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c618 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097129:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097135:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997417.097141:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997417.097141:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097145:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997417.097148:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097149:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997417.097155:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997417.097156:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997417.097159:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097163:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997417.097165:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097166:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997417.097169:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997417.097173:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:3.0:1789997417.097176:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997417.097179:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.097179:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c60a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997417.097185:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c61f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997417.097189:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d74ab151 reply state 000000009173a052 transno 4294967566 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997417.097196:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997417.097198:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997417.097200:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997417.097201:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997417.097342:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:45729:x1876946704436864:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2275us (2769us total) trans 4294967566 rc 0/0 00000100:00100000:1.0:1789997417.097350:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 704 00010000:00010000:0.0:1789997417.099931:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997417.099949:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997417.099957:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997417.099964:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997417.099969:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997417.099978:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997417.099995:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38e062d000) 00010000:00010000:0.0:1789997417.099998:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997417.100003:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997417.100010:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c611 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997417.226950:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997417.932438:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712949632:0@lo:400:kworker.0 00000100:00100000:1.0:1789997417.932487:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712949760:0@lo:400:kworker.0 00000100:00100000:3.0:1789997417.932517:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997417.932535:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712949888:0@lo:400:kworker.0 00000100:00100000:3.0:1789997417.932596:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712950144:0@lo:400:kworker.0 00000100:00100000:3.0:1789997417.932620:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997417.932647:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789997417.932675:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712949504:0@lo:400:kworker.0 00000100:00100000:3.0:1789997417.932705:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997417.932732:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712950016:0@lo:400:kworker.0 00000100:00100000:1.0:1789997417.932764:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997417.932776:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712949632 00000100:00100000:3.0:1789997417.932785:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712949632 00000100:00100000:3.0:1789997417.932828:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712950144 00000100:00100000:3.0:1789997417.932832:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712950144 00000100:00100000:1.0:1789997417.932868:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712949888 00000100:00100000:3.0:1789997417.932874:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1789997417.932874:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712949888 00000100:00100000:3.0:1789997417.932888:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712949632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997417.932913:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1789997417.932922:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712949888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997417.932942:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712949632:12345-0@lo:400:kworker.0 Request processed in 56us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997417.932950:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1789997417.932970:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712949888:12345-0@lo:400:kworker.0 Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997417.932972:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1789997417.932982:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1789997417.932986:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712950144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997417.933020:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000100:00100000:3.0:1789997417.933026:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712950144:12345-0@lo:400:kworker.0 Request processed in 44us (404us total) trans 0 rc 0/0 00000004:00080000:1.0:1789997417.933026:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3baa00, transno 4294967339 00000100:00100000:3.0:1789997417.933036:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1789997417.933043:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712949888:0@lo:400:kworker.0 00000100:00100000:3.0:1789997417.933065:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712949504 00000100:00100000:3.0:1789997417.933070:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712949504 00000100:00100000:3.0:1789997417.933096:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1789997417.933104:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712949504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997417.933134:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712949504:12345-0@lo:400:kworker.0 Request processed in 32us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997417.933140:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00080000:3.0:1789997417.933167:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997417.933172:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997417.933186:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997417.933217:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712949760 00000100:00100000:3.0:1789997417.933221:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712949760 00000100:00100000:3.0:1789997417.933248:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1789997417.933254:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712949760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997417.933293:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712949760:12345-0@lo:400:kworker.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997417.933299:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00080000:3.0:1789997417.933313:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997417.933333:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712949760:0@lo:400:kworker.0 00000100:00100000:1.0:1789997417.933460:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997417.933499:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712949632:0@lo:400:kworker.0 00000100:00100000:2.0:1789997417.933510:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712950016 00000100:00100000:1.0:1789997417.933514:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712950144:0@lo:400:kworker.0 00000100:00100000:2.0:1789997417.933518:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712950016 00000100:00100000:1.0:1789997417.933537:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712949504:0@lo:400:kworker.0 00000100:00100000:2.0:1789997417.933576:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1789997417.933584:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712950016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997417.933632:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712950016:12345-0@lo:400:kworker.0 Request processed in 49us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997417.933638:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1789997417.933729:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712950016:0@lo:400:kworker.0 00000100:00080000:3.0:1789997417.934738:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789997418.250843:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789997418.590286:0:78653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1607282628649ns, next at 1602967861613ns, rc = 0 00000004:00080000:2.0:1789997418.590461:0:78653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1607282806840ns, next at 1606789195477ns, rc = 0 00000001:00080000:3.0:1789997418.621429:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967566 is committed 00000004:00080000:3.0:1789997418.621442:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 63 committed 00000004:00080000:3.0:1789997418.621468:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 64 committed 00000004:00080000:3.0:1789997418.621480:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 61 committed 00000100:00100000:2.0:1789997418.621784:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997418.621810:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712950272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997418.621893:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997418.621995:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712950272 00000100:00100000:1.0:1789997418.622006:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712950272 00000100:00100000:1.0:1789997418.622067:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789997418.622081:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712950272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789997418.622114:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00010000:00010000:1.0:1789997418.622147:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.622173:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.622183:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1789997418.622188:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997418.622193:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.622223:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.622240:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 5 pid: 6656 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997418.622259:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712950400:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997418.622368:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997418.625272:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997418.625284:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946712950400:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997418.625317:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997418.625419:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704436992 00000100:00100000:2.0:1789997418.625427:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704436992 00010000:00010000:2.0:1789997418.625469:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 6 pid: 6656 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997418.625514:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 351 00000100:00100000:2.0:1789997418.625524:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c35c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704436992:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997418.625550:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997418.625556:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 6 pid: 6656 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997418.625568:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 6 pid: 6656 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997418.625594:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000219e872d/0x65b43101d592c5fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebae expref: 6 pid: 6656 timeout: 1707 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997418.625612:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997418.625617:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997418.625623:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997418.625633:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997418.625767:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997418.625827:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c35c2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704436992:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 303us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997418.625835:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 351 00010000:00010000:3.0:1789997418.625946:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997418.625957:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997418.625967:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997418.625974:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997418.626011:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997418.626099:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997418.626105:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.626113:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997418.626118:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.626129:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.626151:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.626160:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592c626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997418.626180:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997418.626183:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997418.626185:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997418.627530:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712950272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5452us (5633us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789997418.627552:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000004:00080000:2.0:1789997418.627639:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3b9500/2, rc 0, transno 4294967341 00000100:00100000:2.0:1789997418.627745:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712950272:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789997419.276062:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997419.805697:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997419.805753:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997419.805790:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997419.805831:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997419.805874:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704437376 00000100:00100000:0.0:1789997419.805884:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704437376 00000100:00100000:1.0:1789997419.805898:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704437504 00000100:00100000:1.0:1789997419.805905:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704437504 00000100:00100000:2.0:1789997419.805963:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704437120 00000100:00100000:2.0:1789997419.805970:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704437120 00000100:00100000:3.0:1789997419.805980:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704437248 00000100:00100000:3.0:1789997419.805987:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704437248 00000100:00100000:2.0:1789997419.806013:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 999 00000100:00100000:2.0:1789997419.806026:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704437120:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997419.806030:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1166 00000100:00100000:3.0:1789997419.806043:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704437248:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997419.806098:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704437120:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997419.806105:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 999 00000100:00080000:2.0:1789997419.806165:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997419.806170:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997419.806172:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997419.806225:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 713 00000100:00100000:3.0:1789997419.806253:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704437248:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 213us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997419.806261:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1166 00000100:00100000:0.0:1789997419.806543:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704437376:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997419.806575:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704437376:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 343us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997419.806582:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 713 00000100:00100000:1.0:1789997419.808080:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 714 00000100:00100000:1.0:1789997419.808094:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704437504:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997419.808149:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704437504:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 60us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997419.808156:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 714 00000100:00100000:0.0:1789997419.978951:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997419.978976:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712950528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997419.979008:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712950656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997419.979048:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997419.979200:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997419.982685:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712950528 00000100:00100000:1.0:1789997419.982701:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712950528 00000100:00100000:3.0:1789997419.982880:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712950656 00000100:00100000:3.0:1789997419.982885:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712950656 00000100:00100000:1.0:1789997419.983016:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1789997419.983036:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712950528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997419.983076:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997419.983156:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712950528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (4109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997419.983162:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1789997419.983213:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712950528:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997419.983863:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997419.983868:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997419.983935:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1789997419.983944:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712950656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997419.983971:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997419.984012:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712950656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (4814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997419.984016:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1789997419.984115:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712950656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997420.301324:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997421.322920:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997422.052362:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967341 is committed 00010000:00010000:2.0:1789997422.347229:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997423.050995:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712950784:0@lo:400:kworker.0 00000100:00100000:1.0:1789997423.051080:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997423.051149:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712950784 00000100:00100000:2.0:1789997423.051210:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712950912:0@lo:400:kworker.0 00000100:00100000:2.0:1789997423.051254:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997423.051284:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997423.051291:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712951040:0@lo:400:kworker.0 00000100:00100000:2.0:1789997423.051313:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997423.051341:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712950912 00000100:00100000:2.0:1789997423.051347:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712950912 00000100:00100000:2.0:1789997423.051401:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712951040 00000100:00100000:2.0:1789997423.051404:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712951040 00000100:00100000:2.0:1789997423.051433:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1789997423.051442:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712950912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997423.051765:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712950784 00000100:00100000:1.0:1789997423.051800:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997423.051801:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1789997423.051812:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712950784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997423.051850:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712950784:12345-0@lo:400:kworker.0 Request processed in 41us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997423.051857:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1789997423.051889:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1789997423.051896:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712951040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997423.051941:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712951168:0@lo:400:kworker.0 00000100:00100000:1.0:1789997423.051974:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997423.052008:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712950784:0@lo:400:kworker.0 00000100:00080000:1.0:1789997423.052066:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997423.052095:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712951168 00000100:00100000:2.0:1789997423.052099:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712950912:12345-0@lo:400:kworker.0 Request processed in 656us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997423.052100:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712951168 00000100:00100000:2.0:1789997423.052110:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1789997423.052138:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1789997423.052145:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712951168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997423.052178:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712951168:12345-0@lo:400:kworker.0 Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997423.052184:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00080000:1.0:1789997423.052202:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997423.052217:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712951168:0@lo:400:kworker.0 00000100:00100000:3.0:1789997423.052235:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712951040:12345-0@lo:400:kworker.0 Request processed in 338us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997423.052243:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1789997423.052309:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712951040:0@lo:400:kworker.0 00000100:00100000:2.0:1789997423.052320:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712950912:0@lo:400:kworker.0 00000100:00100000:3.0:1789997423.052928:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712951424:0@lo:400:kworker.0 00000100:00100000:3.0:1789997423.052962:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997423.053060:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712951424 00000100:00100000:0.0:1789997423.053066:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712951424 00000100:00100000:1.0:1789997423.053087:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712951296:0@lo:400:kworker.0 00000100:00100000:0.0:1789997423.053110:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1789997423.053119:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712951424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997423.053125:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789997423.053172:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997423.053202:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712951296 00000100:00100000:1.0:1789997423.053206:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712951296 00000100:00100000:1.0:1789997423.053242:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1789997423.053250:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712951296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997423.053366:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712951296:12345-0@lo:400:kworker.0 Request processed in 117us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997423.053373:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00080000:1.0:1789997423.053389:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997423.053604:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712951424:12345-0@lo:400:kworker.0 Request processed in 486us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997423.053611:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1789997423.053797:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:2.0:1789997423.053803:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3b9500, transno 4294967341 00000100:00100000:3.0:1789997423.054000:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712951424:0@lo:400:kworker.0 00000100:00100000:2.0:1789997423.054043:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712951296:0@lo:400:kworker.0 00010000:00010000:3.0:1789997423.371186:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997424.397768:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997424.921899:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997424.921947:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997424.921974:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997424.922059:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704437888 00000100:00100000:1.0:1789997424.922070:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704437888 00000100:00100000:1.0:1789997424.922132:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 717 00000100:00100000:1.0:1789997424.922145:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704437888:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997424.922155:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997424.922183:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704438016 00000100:00100000:0.0:1789997424.922188:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704438016 00000100:00100000:0.0:1789997424.922229:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 718 00000100:00100000:1.0:1789997424.922231:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704437888:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997424.922241:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704438016:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997424.922243:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 717 00000100:00080000:1.0:1789997424.922271:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997424.922277:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997424.922282:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704438016:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997424.922290:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 718 00000100:00100000:2.0:1789997424.922391:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704437632 00000100:00100000:2.0:1789997424.922396:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704437632 00000100:00100000:2.0:1789997424.922453:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1001 00000100:00100000:2.0:1789997424.922460:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704437632:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997424.922505:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704437632:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997424.922511:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1001 00000100:00100000:3.0:1789997424.923322:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704437760 00000100:00100000:3.0:1789997424.923329:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704437760 00000100:00080000:1.0:1789997424.923465:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997424.923565:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1170 00000100:00100000:3.0:1789997424.923575:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704437760:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997424.923633:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704437760:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 60us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997424.923645:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1170 00000100:00100000:3.0:1789997425.099012:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712951552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997425.099085:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997425.099212:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712951552 00000100:00100000:2.0:1789997425.099221:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712951552 00000100:00100000:2.0:1789997425.099283:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1789997425.099293:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712951552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997425.099338:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997425.099407:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712951552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997425.099425:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1789997425.099482:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712951552:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997425.099604:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997425.100121:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712951680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997425.100152:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997425.100204:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712951680 00000100:00100000:0.0:1789997425.100210:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712951680 00000100:00100000:0.0:1789997425.100256:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1789997425.100265:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712951680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997425.100288:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997425.100458:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712951680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997425.100461:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712951680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997425.100472:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00080000:3.0:1789997425.100694:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997425.419546:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997426.444217:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997427.466931:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997428.170948:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712952064:0@lo:400:kworker.0 00000100:00100000:2.0:1789997428.170989:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712951808:0@lo:400:kworker.0 00000100:00100000:3.0:1789997428.171013:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997428.171067:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712951936:0@lo:400:kworker.0 00000100:00100000:1.0:1789997428.171165:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712952192:0@lo:400:kworker.0 00000100:00100000:2.0:1789997428.171484:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997428.171526:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712952320:0@lo:400:kworker.0 00000100:00100000:2.0:1789997428.171550:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997428.171789:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712952064 00000100:00100000:2.0:1789997428.171798:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712952064 00000100:00100000:2.0:1789997428.171856:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1789997428.171866:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712952064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997428.171916:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712952064:12345-0@lo:400:kworker.0 Request processed in 52us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997428.171923:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:2.0:1789997428.171943:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997428.172088:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712952320 00000100:00100000:2.0:1789997428.172093:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712952320 00000100:00100000:2.0:1789997428.172674:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1789997428.172688:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712952320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997428.172741:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712952320:12345-0@lo:400:kworker.0 Request processed in 58us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997428.172748:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00080000:2.0:1789997428.172769:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997428.172808:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712952320:0@lo:400:kworker.0 00000100:00100000:2.0:1789997428.172850:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712951808 00000100:00100000:2.0:1789997428.172854:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712951808 00000100:00100000:0.0:1789997428.173709:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997428.173749:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712952448:0@lo:400:kworker.0 00000100:00100000:0.0:1789997428.173779:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997428.173819:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712951936 00000100:00100000:0.0:1789997428.173824:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712951936 00000100:00100000:0.0:1789997428.173861:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712952448 00000100:00100000:0.0:1789997428.173864:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712952448 00000100:00100000:2.0:1789997428.173877:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1789997428.173889:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712951808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997428.173905:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1789997428.173915:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712951936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997428.173943:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712951808:12345-0@lo:400:kworker.0 Request processed in 57us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997428.173950:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1789997428.173969:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712951936:12345-0@lo:400:kworker.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997428.173977:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1789997428.173994:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1789997428.174003:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712951808:0@lo:400:kworker.0 00000100:00100000:0.0:1789997428.174004:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712952448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997428.174038:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712952448:12345-0@lo:400:kworker.0 Request processed in 38us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997428.174045:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:2.0:1789997428.174060:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997428.174078:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712951936:0@lo:400:kworker.0 00000100:00100000:0.0:1789997428.174090:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712952448:0@lo:400:kworker.0 00000100:00100000:1.0:1789997428.176668:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997428.177610:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712952192 00000100:00100000:0.0:1789997428.177621:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712952192 00000100:00100000:0.0:1789997428.177723:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1789997428.177734:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712952192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789997428.177761:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997428.177820:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712952192:12345-0@lo:400:kworker.0 Request processed in 88us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997428.177828:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1789997428.178025:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712952192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997428.179751:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712952064:0@lo:400:kworker.0 00010000:00010000:2.0:1789997428.491301:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997429.514898:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997430.038437:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997430.038488:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997430.038521:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997430.038590:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997430.038780:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704438144 00000100:00100000:3.0:1789997430.038791:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704438144 00000100:00100000:2.0:1789997430.038825:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704438400 00000100:00100000:2.0:1789997430.038833:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704438400 00000100:00100000:0.0:1789997430.038838:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704438528 00000100:00100000:0.0:1789997430.038845:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704438528 00000100:00100000:3.0:1789997430.038858:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1003 00000100:00100000:3.0:1789997430.038871:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704438144:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997430.038953:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704438144:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997430.038962:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1003 00000100:00100000:0.0:1789997430.039069:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 721 00000100:00100000:0.0:1789997430.039080:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704438528:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997430.039115:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704438272 00000100:00100000:3.0:1789997430.039120:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704438272 00000100:00100000:0.0:1789997430.039122:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704438528:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997430.039131:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 721 00000100:00100000:0.0:1789997430.039149:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 722 00000100:00100000:0.0:1789997430.039157:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704438400:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997430.039161:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1174 00000100:00100000:3.0:1789997430.039173:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704438272:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997430.039191:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704438400:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997430.039198:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 722 00000100:00100000:3.0:1789997430.039209:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704438272:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997430.039217:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1174 00000100:00080000:3.0:1789997430.039247:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997430.039251:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997430.039254:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997430.219179:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712952576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997430.219252:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997430.219529:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712952576 00000100:00100000:0.0:1789997430.219538:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712952576 00000100:00080000:3.0:1789997430.219630:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997430.219715:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:0.0:1789997430.219728:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712952576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997430.219771:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997430.219838:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712952704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997430.219840:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712952576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997430.219847:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1789997430.219866:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997430.219971:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712952704 00000100:00100000:2.0:1789997430.219976:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712952704 00000100:00100000:1.0:1789997430.219980:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712952576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997430.220009:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1789997430.220017:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712952704:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997430.220026:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789997430.220036:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997430.220075:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712952704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997430.220081:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1789997430.220095:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712952704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789997430.538936:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997431.563114:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997432.586859:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997433.293436:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712953088:0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.293505:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997433.293569:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789997433.293575:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712952960:0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.293596:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997433.293610:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712953472:0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.293627:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997433.293676:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712953088 00000100:00100000:1.0:1789997433.293683:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712953088 00000100:00100000:1.0:1789997433.293729:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712952960 00000100:00100000:1.0:1789997433.293732:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712952960 00000100:00100000:1.0:1789997433.293748:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712953472 00000100:00100000:1.0:1789997433.293750:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712953472 00000100:00100000:1.0:1789997433.293768:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1789997433.293776:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712953088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.293823:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712953088:12345-0@lo:400:kworker.0 Request processed in 47us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997433.293830:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1789997433.293846:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1789997433.293851:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712952960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.293874:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712952960:12345-0@lo:400:kworker.0 Request processed in 24us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997433.293880:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:1.0:1789997433.293890:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1789997433.293896:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712953472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.293919:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712953472:12345-0@lo:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997433.293924:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:1.0:1789997433.293941:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997433.293969:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712952960:0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.293978:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712953472:0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.293985:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712953088:0@lo:400:kworker.0 00000100:00100000:2.0:1789997433.294021:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712953216:0@lo:400:kworker.0 00000100:00100000:2.0:1789997433.294059:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997433.294100:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789997433.294108:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712952832:0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.294121:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712953216 00000100:00100000:1.0:1789997433.294127:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712953216 00000100:00100000:2.0:1789997433.294157:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997433.294165:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1789997433.294174:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712953216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997433.294191:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712953344:0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.294211:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712953216:12345-0@lo:400:kworker.0 Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997433.294219:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1789997433.294224:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997433.294277:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712953216:0@lo:400:kworker.0 00000100:00100000:2.0:1789997433.294303:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712952832 00000100:00100000:2.0:1789997433.294307:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712952832 00000100:00100000:2.0:1789997433.294343:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1789997433.294367:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712952832:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997433.294375:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997433.294407:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712952832:12345-0@lo:400:kworker.0 Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997433.294415:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1789997433.294452:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712952832:0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.296381:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712953344 00000100:00100000:1.0:1789997433.296393:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712953344 00000100:00100000:1.0:1789997433.296467:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1789997433.296478:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712953344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997433.296551:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712953344:12345-0@lo:400:kworker.0 Request processed in 77us (2330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997433.296558:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1789997433.296613:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712953344:0@lo:400:kworker.0 00000100:00080000:2.0:1789997433.296836:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997433.610930:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997434.560284:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997434.561165:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704438656 00000100:00100000:1.0:1789997434.561177:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704438656 00000100:00080000:2.0:1789997434.561260:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997434.561301:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 705 00000100:00100000:1.0:1789997434.561314:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45987:x1876946704438656:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997434.561439:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45987:x1876946704438656:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 128us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997434.561446:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 705 00000100:00100000:3.0:1789997434.563778:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997434.563882:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704438784 00000100:00100000:1.0:1789997434.563889:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704438784 00000100:00100000:1.0:1789997434.563957:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 372 00000100:00100000:1.0:1789997434.563968:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45987:x1876946704438784:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997434.564290:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45987:x1876946704438784:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 324us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997434.564297:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 372 00000100:00080000:2.0:1789997434.564470:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997434.566534:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997434.566602:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704438912 00000100:00100000:3.0:1789997434.566610:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704438912 00000100:00100000:3.0:1789997434.566700:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 373 00000100:00100000:3.0:1789997434.566710:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45987:x1876946704438912:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997434.567051:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45987:x1876946704438912:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 342us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997434.567059:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 373 00000100:00080000:2.0:1789997434.567120:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997434.573318:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997434.574006:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704439040 00000100:00100000:1.0:1789997434.574017:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704439040 00000100:00100000:1.0:1789997434.574109:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 706 00000100:00100000:1.0:1789997434.574120:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45987:x1876946704439040:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997434.574560:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45987:x1876946704439040:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 440us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997434.574568:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 706 00000100:00100000:0.0:1789997434.576813:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997434.576961:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704439168 00000100:00100000:3.0:1789997434.576969:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704439168 00000100:00100000:3.0:1789997434.577068:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 707 00000100:00100000:3.0:1789997434.577077:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45987:x1876946704439168:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997434.577162:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45987:x1876946704439168:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997434.577169:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 707 00000100:00100000:2.0:1789997434.578807:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997434.578890:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704439296 00000100:00100000:1.0:1789997434.578897:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704439296 00000100:00100000:1.0:1789997434.578948:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 374 00000100:00100000:1.0:1789997434.578957:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45987:x1876946704439296:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997434.579542:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45987:x1876946704439296:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 584us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997434.579551:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 374 00000100:00100000:1.0:1789997434.582598:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997434.582833:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704439424 00000100:00100000:0.0:1789997434.582843:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704439424 00000100:00100000:0.0:1789997434.582897:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 375 00000100:00100000:0.0:1789997434.582908:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45987:x1876946704439424:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997434.583446:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:45987:x1876946704439424:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 539us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997434.583515:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 375 00000100:00100000:0.0:1789997434.584899:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997434.585247:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704439552 00000100:00100000:3.0:1789997434.585254:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704439552 00000100:00100000:3.0:1789997434.585359:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 708 00000100:00100000:3.0:1789997434.585369:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45987:x1876946704439552:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997434.585805:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:45987:x1876946704439552:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 436us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997434.585813:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 708 00010000:00010000:0.0:1789997434.635028:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997435.160707:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997435.160807:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997435.160847:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997435.160888:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997435.160915:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704440064 00000100:00100000:2.0:1789997435.160924:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704440064 00000100:00100000:2.0:1789997435.160975:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704439936 00000100:00100000:1.0:1789997435.160977:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704439680 00000100:00100000:2.0:1789997435.160978:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704439936 00000100:00100000:1.0:1789997435.160982:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704439680 00000100:00100000:2.0:1789997435.161004:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 725 00000100:00100000:1.0:1789997435.161012:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1005 00000100:00100000:2.0:1789997435.161014:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704440064:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997435.161020:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704439680:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997435.161083:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704440064:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 70us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997435.161092:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 725 00000100:00100000:2.0:1789997435.161125:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 726 00000100:00100000:2.0:1789997435.161134:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704439936:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997435.161259:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704439808 00000100:00100000:3.0:1789997435.161264:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704439808 00000100:00100000:3.0:1789997435.161301:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1178 00000100:00100000:3.0:1789997435.161310:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704439808:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997435.163640:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704439680:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2614us (2827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997435.163668:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1005 00000100:00100000:2.0:1789997435.163703:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704439936:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2569us (2814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997435.163716:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 726 00000100:00100000:3.0:1789997435.165140:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704439808:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3825us (4436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997435.165153:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1178 00000100:00100000:1.0:1789997435.338817:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712953600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997435.338892:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997435.338919:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997435.339057:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712953600 00000100:00100000:2.0:1789997435.339067:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712953600 00000100:00080000:1.0:1789997435.339137:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997435.339145:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1789997435.339178:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712953728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997435.339234:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997435.339339:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712953600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997435.339377:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997435.339432:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712953600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 278us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997435.339449:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1789997435.339461:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712953728 00000100:00100000:3.0:1789997435.339468:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712953728 00000100:00080000:2.0:1789997435.339502:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997435.339520:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1789997435.339529:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712953728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997435.339548:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997435.339602:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712953728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997435.339610:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:2.0:1789997435.339687:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712953728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997435.339792:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712953600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997435.527166:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997435.527279:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704440192 00000100:00100000:0.0:1789997435.527290:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704440192 00000100:00100000:0.0:1789997435.527345:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 709 00000100:00100000:0.0:1789997435.527358:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46001:x1876946704440192:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997435.527379:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997435.527400:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c62d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebb5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.527467:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.527482:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.527502:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997435.527543:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:0.0:1789997435.527547:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997435.527566:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.527592:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c62d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebb5 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.527610:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebb5 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.527619:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:0.0:1789997435.527622:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997435.527626:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660fe00, rc 0) 00000100:00100000:0.0:1789997435.527709:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46001:x1876946704440192:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 354us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997435.527716:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 709 00000100:00100000:1.0:1789997435.534724:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997435.534818:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704440448 00000100:00100000:3.0:1789997435.534831:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704440448 00000100:00100000:3.0:1789997435.534927:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 710 00000100:00100000:3.0:1789997435.534939:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46001:x1876946704440448:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997435.534996:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997435.535023:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebb5 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.535046:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c5d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeba0 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.535057:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997435.535067:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997435.535096:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.535111:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.535121:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997435.556533:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fd78784 reply state 00000000817f548e transno 4294967567 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997435.556551:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997435.556566:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:0.0:1789997435.556689:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46001:x1876946704440448:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 21748us (22034us total) trans 4294967567 rc 0/0 00000100:00100000:0.0:1789997435.556698:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 710 00000001:00080000:0.0:1789997435.556739:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967567 is committed 00010000:00010000:1.0:1789997435.556960:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.556969:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.556977:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.556983:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997435.556988:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.556995:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.557010:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:1.0:1789997435.557013:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997435.557018:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.557023:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c63b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997435.601284:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997435.601415:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704440576 00000100:00100000:2.0:1789997435.601426:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704440576 00000100:00100000:2.0:1789997435.601484:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 711 00000100:00100000:2.0:1789997435.601496:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46005:x1876946704440576:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997435.601521:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997435.601540:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebbc expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.601604:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.601618:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.601630:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.601645:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.601679:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.601688:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.601996:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602006:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602015:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997435.602037:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:2.0:1789997435.602041:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997435.602060:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602071:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602078:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602089:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602096:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997435.602100:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602249:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602261:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:2.0:1789997435.602265:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997435.602270:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602276:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602288:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602294:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602300:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602307:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997435.602310:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602320:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602328:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997435.602330:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997435.602333:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602339:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c650 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602371:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebbc expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602385:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebbc expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.602393:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997435.602396:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997435.602398:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997435.602544:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46005:x1876946704440576:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1049us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997435.602552:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 711 00000100:00100000:0.0:1789997435.604737:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997435.604839:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704440832 00000100:00100000:3.0:1789997435.604848:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704440832 00000100:00100000:3.0:1789997435.604942:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 712 00000100:00100000:3.0:1789997435.604953:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46005:x1876946704440832:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997435.604973:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997435.605004:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c65e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebc3 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.605323:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.605338:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.605349:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.605377:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.605386:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.605394:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997435.606129:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:3.0:1789997435.606423:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c673 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606435:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606448:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c673 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606482:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606489:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606496:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606502:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997435.606505:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606512:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606524:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:3.0:1789997435.606527:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997435.606532:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606539:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c665 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997435.606552:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085ba0175 reply state 000000004d144e4e transno 4294967568 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997435.606561:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997435.606590:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c65e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebc3 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606605:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c673 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebc3 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.606612:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8a38ee49e300) 00010000:00010000:3.0:1789997435.606614:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997435.606617:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997435.606704:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46005:x1876946704440832:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1753us (1976us total) trans 4294967568 rc 0/0 00000100:00100000:3.0:1789997435.606713:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 712 00010000:00010000:1.0:1789997435.608921:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.608936:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.608944:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.608955:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997435.608959:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.608967:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.608982:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38ee49e100) 00010000:00010000:1.0:1789997435.608986:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997435.608991:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.608998:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592c66c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997435.609259:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997435.609326:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704441088 00000100:00100000:1.0:1789997435.609335:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704441088 00000100:00100000:1.0:1789997435.609390:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 713 00000100:00100000:1.0:1789997435.609401:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46005:x1876946704441088:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:1.0:1789997435.609450:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997435.609466:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592c673 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebc3 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.609478:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8a38ee49e300) 00010000:00010000:1.0:1789997435.609486:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997435.609523:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.609535:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.609545:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997435.609721:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd0a874b reply state 000000008ff2980d transno 4294967569 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997435.609730:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997435.609817:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46005:x1876946704441088:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 417us (560us total) trans 4294967569 rc 0/0 00000100:00100000:1.0:1789997435.609824:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 713 00010000:00010000:3.0:1789997435.611743:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.611758:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.611765:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.611771:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997435.611775:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.611783:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.611798:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:3.0:1789997435.611801:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997435.611806:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.611811:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c681 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997435.612608:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997435.612815:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704441216 00000100:00100000:3.0:1789997435.612825:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704441216 00000100:00100000:3.0:1789997435.612880:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 714 00000100:00100000:3.0:1789997435.612890:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46005:x1876946704441216:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997435.612912:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997435.612929:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebca expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.612983:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebca expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.612997:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c688 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebca expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.613015:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997435.613018:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997435.613020:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997435.613990:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46005:x1876946704441216:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1097us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997435.613998:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 714 00000100:00100000:0.0:1789997435.616786:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997435.616908:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704441344 00000100:00100000:1.0:1789997435.616917:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704441344 00000100:00100000:1.0:1789997435.617022:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 376 00000100:00100000:1.0:1789997435.617033:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704441344:12345-192.168.204.4@tcp:2:touch.60003 00000100:00100000:1.0:1789997435.617482:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704441344:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 450us (702us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789997435.617491:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 376 00000100:00100000:0.0:1789997435.619708:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997435.619893:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704441600 00000100:00100000:2.0:1789997435.619903:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704441600 00000100:00100000:2.0:1789997435.619957:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:2.0:1789997435.619968:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de234c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46005:x1876946704441600:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:2.0:1789997435.620372:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de234c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46005:x1876946704441600:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 404us (670us total) trans 4294967570 rc 0/0 00000100:00100000:2.0:1789997435.620379:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 75 00000100:00100000:0.0:1789997435.659765:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:3.0:1789997435.659779:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997435.659823:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704441728 00000100:00100000:1.0:1789997435.659834:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704441728 00000100:00100000:1.0:1789997435.660026:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 715 00000100:00100000:1.0:1789997435.660037:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46009:x1876946704441728:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:1.0:1789997435.660081:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997435.660101:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c68f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebd1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660157:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660177:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660185:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660202:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660221:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660227:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660338:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c6a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660351:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660357:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997435.660403:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3b:0x0]: returning size 0 00000004:00200000:1.0:1789997435.660408:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997435.660429:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660440:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660452:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660458:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660464:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660470:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997435.660475:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660482:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660494:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:1.0:1789997435.660497:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997435.660501:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660508:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c696 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660521:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660527:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660533:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660538:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997435.660541:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660547:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660554:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38e062d800) 00010000:00010000:1.0:1789997435.660556:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997435.660559:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660565:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592c69d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660595:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c68f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd1 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660608:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd1 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.660614:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:1.0:1789997435.660617:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997435.660619:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997435.660718:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46009:x1876946704441728:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 681us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997435.660725:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 715 00000100:00100000:0.0:1789997435.663071:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997435.663138:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704441856 00000100:00100000:2.0:1789997435.663146:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704441856 00000100:00100000:2.0:1789997435.663213:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 377 00000100:00100000:2.0:1789997435.663225:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704441856:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:2.0:1789997435.663241:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997435.663261:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebd8 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997435.663286:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x6ab1317b, atime: 0x6ab1317b, ctime: 0x6ab1317b, blocks: 0x1 00010000:00010000:2.0:1789997435.663304:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=1624s v=(0 0) 00010000:00010000:2.0:1789997435.663309:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997435.663318:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.663336:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997435.663349:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997435.663405:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704441856:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 182us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997435.663411:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 377 00000100:00100000:0.0:1789997435.667462:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997435.667574:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704442112 00000100:00100000:3.0:1789997435.667584:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704442112 00000100:00100000:3.0:1789997435.667644:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 716 00000100:00100000:3.0:1789997435.667678:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46009:x1876946704442112:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997435.667729:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997435.667751:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c6a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd1 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667767:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebca expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667775:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997435.667783:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997435.667800:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667863:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667875:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667886:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667891:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667895:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667969:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667974:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.667978:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997435.668752:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 64 off9600 00000004:00080000:3.0:1789997435.668763:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1624361108377ns, next at 1625361106274ns, rc = 0 00010000:00010000:3.0:1789997435.668882:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.668894:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.668902:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.668909:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.668916:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.668922:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669005:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997435.669027:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669034:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669042:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669048:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997435.669052:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669059:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669070:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997435.669073:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997435.669077:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669084:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c6c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669100:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669106:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669112:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669117:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997435.669120:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669129:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669136:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:3.0:1789997435.669139:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997435.669142:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997435.669147:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c6b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997435.669159:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002106ef7d reply state 0000000096f6187b transno 4294967571 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997435.669168:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997435.669266:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46009:x1876946704442112:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1612us (1811us total) trans 4294967571 rc 0/0 00000100:00100000:3.0:1789997435.669274:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 716 00010000:00010000:0.0:1789997435.669540:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997435.669547:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.669554:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997435.669557:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.669564:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.669573:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:0.0:1789997435.669576:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997435.669579:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.669585:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592c6c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997435.669599:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997435.669601:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997435.669603:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997435.670781:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.670792:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.670797:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.670801:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997435.670804:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.670809:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.670821:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38ee49ea00) 00010000:00010000:1.0:1789997435.670824:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997435.670828:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997435.670835:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592c6b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997436.264086:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997436.264497:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704442240 00000100:00100000:2.0:1789997436.264508:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704442240 00000100:00100000:2.0:1789997436.264587:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 717 00000100:00100000:2.0:1789997436.264598:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46024:x1876946704442240:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997436.264621:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997436.264641:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c6ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebdf expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789997436.264717:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789997436.264742:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c6d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997436.264756:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997436.264768:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997436.264804:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:2.0:1789997436.264808:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997436.264827:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c6d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997436.264852:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c6ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebdf expref: 13 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997436.264868:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c6d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebdf expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997436.264876:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997436.264879:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997436.264883:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997436.264957:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46024:x1876946704442240:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 360us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997436.264965:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 717 00000100:00100000:2.0:1789997436.274084:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997436.274431:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704442496 00000100:00100000:0.0:1789997436.274442:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704442496 00000100:00100000:0.0:1789997436.274503:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 718 00000100:00100000:0.0:1789997436.274514:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46024:x1876946704442496:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997436.274562:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997436.274590:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c6d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebdf expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.274613:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebbc expref: 11 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.274624:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997436.274634:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997436.274690:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.274705:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.274716:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997436.328390:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967572 is committed 00000004:00080000:2.0:1789997436.328438:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 62 committed 00000100:00100000:2.0:1789997436.328621:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997436.328644:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712953856:0@lo:6:osp-syn-0-0.0 00000004:00010000:0.0:1789997436.328935:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036ed35d6 reply state 00000000052594e9 transno 4294967572 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997436.328949:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997436.328964:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00080000:0.0:1789997436.330317:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997436.330345:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46024:x1876946704442496:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 55826us (56264us total) trans 4294967572 rc 0/0 00000100:00100000:0.0:1789997436.330360:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 718 00000100:00100000:2.0:1789997436.330518:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789997436.330848:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.330861:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.330868:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.330875:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997436.330880:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.330891:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.330912:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:3.0:1789997436.330915:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997436.330922:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.330929:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c6dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997436.331040:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712953856 00000100:00100000:0.0:1789997436.331049:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712953856 00000100:00100000:0.0:1789997436.331143:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789997436.331154:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712953856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997436.331203:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00010000:00010000:0.0:1789997436.331225:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.331243:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.331253:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789997436.331257:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997436.331262:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.331303:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.331320:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 6 pid: 6656 timeout: 1725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997436.331336:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712953984:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997436.331399:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b51c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789997436.334161:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712953984:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997436.334205:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997436.337380:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997436.337547:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704442624 00000100:00100000:3.0:1789997436.337560:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704442624 00000100:00080000:1.0:1789997436.337627:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789997436.337637:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 7 pid: 6656 timeout: 1725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997436.337767:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 352 00000100:00100000:3.0:1789997436.337780:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704442624:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997436.337805:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997436.337813:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 7 pid: 6656 timeout: 1725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.337827:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 7 pid: 6656 timeout: 1725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.337858:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6f69bfa/0x65b43101d592c6ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebd8 expref: 7 pid: 6656 timeout: 1725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.337884:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997436.337889:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997436.337895:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.337905:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.337941:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997436.338004:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704442624:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 227us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997436.338013:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 352 00010000:00010000:0.0:1789997436.338014:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.338029:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.338040:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.338049:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.338070:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997436.339122:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712953856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7966us (8600us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789997436.339132:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00010000:0.0:1789997436.339168:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997436.339178:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.339188:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1492910) 00000004:00080000:2.0:1789997436.339206:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fab28e00/2, rc 0, transno 4294967341 00010000:00010000:0.0:1789997436.339207:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997436.339218:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712953856:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789997436.339963:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.339985:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.339995:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5be7ab0/0x65b43101d592c6e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.340018:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997436.340020:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997436.340022:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997436.372979:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997436.373577:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704442752 00000100:00100000:1.0:1789997436.373590:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704442752 00000100:00100000:1.0:1789997436.373769:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 719 00000100:00100000:1.0:1789997436.373782:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46028:x1876946704442752:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997436.373809:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997436.373830:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c6ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebe6 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.374386:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.374402:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.374415:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.374430:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.374436:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.374444:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375389:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c6ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375404:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375412:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997436.375443:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:1.0:1789997436.375446:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997436.375466:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c6ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375479:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375486:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375493:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375497:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997436.375500:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375505:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375514:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:1.0:1789997436.375516:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997436.375519:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375523:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c6f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375533:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375540:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375546:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375551:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997436.375554:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375560:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375568:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997436.375570:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997436.375573:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375579:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c6f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375791:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c6ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebe6 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375822:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c6ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebe6 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.375830:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997436.375833:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997436.375835:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997436.375906:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46028:x1876946704442752:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 2128us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997436.375913:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 719 00010000:00010000:3.0:1789997436.683176:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997436.981271:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997436.981420:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704442880 00000100:00100000:3.0:1789997436.981432:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704442880 00000100:00100000:3.0:1789997436.981501:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 720 00000100:00100000:3.0:1789997436.981512:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46042:x1876946704442880:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997436.981534:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997436.981556:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.981621:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c70d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.981636:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.981649:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997436.981706:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:3.0:1789997436.981711:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997436.981732:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c70d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.981758:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebed expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.981776:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c70d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebed expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997436.981786:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:3.0:1789997436.981789:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997436.981794:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997436.981970:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46042:x1876946704442880:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 459us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997436.981979:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 720 00000100:00100000:3.0:1789997436.985644:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997436.985722:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704443136 00000100:00100000:1.0:1789997436.985735:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704443136 00000100:00100000:1.0:1789997436.985802:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 721 00000100:00100000:1.0:1789997436.985814:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46042:x1876946704443136:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997436.985875:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997436.985904:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592c70d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebed expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.985927:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c6ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebe6 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.985938:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997436.985948:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997436.985973:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.985987:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997436.985997:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997436.986350:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008245f545 reply state 0000000072454866 transno 4294967573 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997436.986360:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997436.986368:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000100:00100000:1.0:1789997436.986462:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46042:x1876946704443136:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 649us (826us total) trans 4294967573 rc 0/0 00000100:00100000:1.0:1789997436.986471:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 721 00010000:00010000:0.0:1789997436.988218:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.988232:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.988245:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.988252:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997436.988257:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.988266:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.988287:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997436.988290:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997436.988296:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997436.988303:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c714 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997437.092481:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997437.092918:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704443264 00000100:00100000:2.0:1789997437.092934:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704443264 00000100:00100000:2.0:1789997437.093016:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 722 00000100:00100000:2.0:1789997437.093029:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46054:x1876946704443264:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997437.093187:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46054:x1876946704443264:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 150us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997437.093197:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 722 00000100:00100000:3.0:1789997437.095006:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997437.095257:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704443392 00000100:00100000:1.0:1789997437.095269:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704443392 00000100:00100000:2.0:1789997437.095602:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 379 00000100:00100000:2.0:1789997437.095628:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46054:x1876946704443392:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997437.096804:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46054:x1876946704443392:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1182us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997437.096816:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 379 00000100:00100000:3.0:1789997437.099357:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997437.099611:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704443520 00000100:00100000:2.0:1789997437.099621:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704443520 00000100:00080000:1.0:1789997437.099691:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997437.099758:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 380 00000100:00100000:2.0:1789997437.099773:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46054:x1876946704443520:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997437.100156:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46054:x1876946704443520:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 388us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997437.100165:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 380 00000100:00100000:3.0:1789997437.101736:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997437.101965:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704443648 00000100:00100000:2.0:1789997437.101971:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704443648 00000100:00100000:2.0:1789997437.102017:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 723 00000100:00100000:2.0:1789997437.102026:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46054:x1876946704443648:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997437.103047:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46054:x1876946704443648:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 381us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997437.103057:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 723 00000100:00100000:3.0:1789997437.105594:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997437.105780:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704443776 00000100:00100000:0.0:1789997437.105789:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704443776 00000100:00100000:0.0:1789997437.105845:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 724 00000100:00100000:0.0:1789997437.105856:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46054:x1876946704443776:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997437.105990:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46054:x1876946704443776:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 136us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997437.105999:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 724 00000100:00100000:1.0:1789997437.109915:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997437.110232:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704443904 00000100:00100000:3.0:1789997437.110241:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704443904 00000100:00100000:3.0:1789997437.110303:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 381 00000100:00100000:3.0:1789997437.110314:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46054:x1876946704443904:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997437.110721:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46054:x1876946704443904:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 408us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997437.110729:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 381 00000100:00100000:3.0:1789997437.112430:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997437.112487:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704444032 00000100:00100000:0.0:1789997437.112494:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704444032 00000100:00100000:0.0:1789997437.112780:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 382 00000100:00100000:0.0:1789997437.112802:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46054:x1876946704444032:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997437.113140:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46054:x1876946704444032:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 349us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997437.114070:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 382 00000100:00100000:0.0:1789997437.114916:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997437.114998:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704444160 00000100:00100000:2.0:1789997437.115006:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704444160 00000100:00100000:2.0:1789997437.115089:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 725 00000100:00100000:2.0:1789997437.115099:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46054:x1876946704444160:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997437.115501:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46054:x1876946704444160:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 402us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997437.115508:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 725 00000100:00100000:1.0:1789997437.154465:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997437.154631:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704444288 00000100:00100000:3.0:1789997437.154642:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704444288 00000100:00100000:3.0:1789997437.154735:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 726 00000100:00100000:3.0:1789997437.154747:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46058:x1876946704444288:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997437.154886:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997437.154909:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c71b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebf4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.154975:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.154988:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.154999:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155012:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155018:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155024:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155483:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c730 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155493:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155499:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997437.155521:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:0.0:1789997437.155524:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997437.155542:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c730 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155559:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155565:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155572:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155585:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997437.155589:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155597:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155609:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:0.0:1789997437.155612:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997437.155617:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155623:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c722 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155636:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155753:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155760:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155766:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997437.155770:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155776:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155785:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997437.155788:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997437.155791:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155797:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c729 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155830:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c71b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebf4 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155843:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c730 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebf4 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.155851:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997437.155858:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997437.155860:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ec00, rc 0) 00000100:00100000:0.0:1789997437.155921:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46058:x1876946704444288:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 1177us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997437.155930:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 726 00000100:00100000:3.0:1789997437.158229:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997437.158476:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704444544 00000100:00100000:1.0:1789997437.158486:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704444544 00000100:00100000:1.0:1789997437.158545:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 727 00000100:00100000:1.0:1789997437.158556:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46058:x1876946704444544:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789997437.158576:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997437.158595:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c737 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaebfb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.159152:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.159169:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.159192:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.159207:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.159216:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.159223:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997437.160238:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:1.0:1789997437.160604:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c74c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160619:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c74c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160630:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c74c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160686:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160694:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160701:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160708:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997437.160713:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160720:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160732:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:1.0:1789997437.160735:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997437.160740:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160747:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c73e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997437.160764:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3540e37 reply state 00000000a1fd1a2b transno 4294967574 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997437.160772:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997437.160880:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c737 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebfb expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160897:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c74c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebfb expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.160905:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789997437.160908:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997437.160910:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997437.161047:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46058:x1876946704444544:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 2492us (2825us total) trans 4294967574 rc 0/0 00000100:00100000:1.0:1789997437.161057:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 727 00000100:00100000:3.0:1789997437.165421:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997437.165507:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704444672 00000100:00100000:0.0:1789997437.165519:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704444672 00000100:00100000:0.0:1789997437.165576:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 383 00000100:00100000:0.0:1789997437.165586:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46058:x1876946704444672:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997437.165603:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997437.165623:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec02 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997437.165649:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789997437.165690:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=1625s v=(0 0) 00010000:00010000:0.0:1789997437.165695:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997437.165704:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.165721:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997437.165732:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ee00, rc 0) 00000100:00100000:0.0:1789997437.165782:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46058:x1876946704444672:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 198us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997437.165789:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 383 00010000:00010000:1.0:1789997437.165994:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.166005:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.166012:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.166019:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997437.166023:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.166035:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.166057:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38e062d700) 00010000:00010000:1.0:1789997437.166061:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997437.166065:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997437.166078:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c745 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997437.185896:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997437.186012:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704444800 00000100:00100000:2.0:1789997437.186023:0:6664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704444800 00002000:00100000:2.0:1789997437.186075:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (0->1048575) req@ffff8a37c6adc000 x1876946704444800/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:413/0 lens 488/0 e 0 to 0 dl 1789997448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789997437.186087:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c6adc000 with x1876946704444800 ext(0->1048575) 00002000:00010000:2.0:1789997437.186093:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a37c6adc000 00000100:00100000:2.0:1789997437.186164:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:2.0:1789997437.186184:0:6664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704444800:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:2.0:1789997437.203524:0:6664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704444800:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 17339us (17626us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789997437.203540:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00002000:00100000:2.0:1789997437.203554:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (0->1048575) req@ffff8a37c6adc000 x1876946704444800/t4294967342(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:413/0 lens 488/448 e 0 to 0 dl 1789997448 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789997437.203565:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c6adc000 with x1876946704444800 ext(0->1048575) 00002000:00010000:2.0:1789997437.203572:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a37c6adc000 00000100:00100000:0.0:1789997437.206798:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997437.209300:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704444928 00000100:00100000:1.0:1789997437.209314:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704444928 00000100:00100000:1.0:1789997437.209382:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 728 00000100:00100000:1.0:1789997437.209392:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46058:x1876946704444928:12345-192.168.204.4@tcp:44:dd.60003 00000001:00080000:0.0:1789997437.238412:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967574 is committed 00000100:00100000:1.0:1789997437.238696:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46058:x1876946704444928:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 29299us (31905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997437.238709:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 728 00000100:00100000:2.0:1789997437.242226:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997437.242433:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704445056 00000100:00100000:1.0:1789997437.242444:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704445056 00000100:00100000:1.0:1789997437.242557:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 384 00000100:00100000:1.0:1789997437.242568:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704445056:12345-192.168.204.4@tcp:16:dd.60003 00000001:00080000:3.0:1789997437.282027:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967342 is committed 00000100:00100000:1.0:1789997437.282288:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704445056:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 39716us (40066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997437.282301:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 384 00000100:00100000:2.0:1789997437.284859:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997437.285090:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704445312 00000100:00100000:1.0:1789997437.285100:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704445312 00000100:00100000:1.0:1789997437.285166:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 76 00000100:00100000:1.0:1789997437.285186:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46058:x1876946704445312:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:1.0:1789997437.286384:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46058:x1876946704445312:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 1203us (1528us total) trans 4294967575 rc 0/0 00000100:00100000:1.0:1789997437.286394:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 76 00000001:00080000:1.0:1789997437.412375:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00000001:00080000:1.0:1789997437.412395:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00010000:00010000:0.0:1789997437.707005:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997438.069490:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967575 is committed 00000100:00100000:2.0:1789997438.412951:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712954368:0@lo:400:kworker.0 00000100:00100000:2.0:1789997438.413024:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997438.413085:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997438.413091:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712954496:0@lo:400:kworker.0 00000100:00100000:2.0:1789997438.413114:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997438.413141:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712954368 00000100:00100000:2.0:1789997438.413148:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712954368 00000100:00100000:2.0:1789997438.413213:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1789997438.413222:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712954368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997438.413267:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712954368:12345-0@lo:400:kworker.0 Request processed in 47us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997438.413274:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1789997438.413389:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712954112:0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.413435:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997438.413465:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712954624:0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.413488:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997438.413509:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789997438.413515:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712954240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.413537:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997438.413555:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712954752:0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.413574:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997438.413603:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712954112 00000100:00100000:3.0:1789997438.413607:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712954112 00000100:00100000:3.0:1789997438.413639:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1789997438.413646:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712954112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.413702:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712954112:12345-0@lo:400:kworker.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997438.413709:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1789997438.413739:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712954496 00000100:00100000:3.0:1789997438.413743:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712954496 00000100:00100000:3.0:1789997438.413769:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712954624 00000100:00100000:3.0:1789997438.413773:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712954624 00000100:00100000:3.0:1789997438.413795:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1789997438.413801:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712954496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.413831:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712954496:12345-0@lo:400:kworker.0 Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997438.413836:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1789997438.413847:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1789997438.413853:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712954624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.413880:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712954624:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997438.413886:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1789997438.413902:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712954240 00000100:00100000:3.0:1789997438.413906:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712954240 00000100:00100000:3.0:1789997438.413926:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712954752 00000100:00100000:3.0:1789997438.413929:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712954752 00000100:00100000:3.0:1789997438.413949:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1789997438.413956:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712954240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.413984:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712954240:12345-0@lo:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997438.413990:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:3.0:1789997438.414002:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1789997438.414008:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712954752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.414035:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712954752:12345-0@lo:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997438.414041:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1789997438.414094:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712954240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.414104:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712954752:0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.414111:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712954112:0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.414119:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712954624:0@lo:400:kworker.0 00000100:00080000:3.0:1789997438.414175:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997438.414179:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997438.414181:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997438.414209:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:3.0:1789997438.414214:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fab28e00, transno 4294967341 00000100:00100000:3.0:1789997438.414224:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712954496:0@lo:400:kworker.0 00000100:00100000:3.0:1789997438.414234:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712954368:0@lo:400:kworker.0 00010000:00010000:0.0:1789997438.730886:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997438.893046:0:79115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1627585389625ns, next at 1625361106274ns, rc = 0 00000004:00080000:3.0:1789997438.893164:0:79115:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1627585508996ns, next at 1606789195477ns, rc = 0 00000004:00080000:1.0:1789997438.935509:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 65 committed 00000004:00080000:1.0:1789997438.935530:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 63 committed 00000100:00100000:3.0:1789997439.740263:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997439.740335:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704445440 00000100:00100000:1.0:1789997439.740345:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704445440 00000100:00100000:1.0:1789997439.740414:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 729 00000100:00100000:1.0:1789997439.740425:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46250:x1876946704445440:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00080000:3.0:1789997439.740477:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997439.740533:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46250:x1876946704445440:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997439.740541:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 729 00000100:00100000:2.0:1789997439.741993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997439.742160:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704445568 00000100:00100000:3.0:1789997439.742167:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704445568 00000100:00100000:3.0:1789997439.742282:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 385 00000100:00100000:3.0:1789997439.742292:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46250:x1876946704445568:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:1.0:1789997439.742480:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997439.742982:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46250:x1876946704445568:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 690us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997439.742990:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 385 00000100:00100000:2.0:1789997439.744814:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997439.744894:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704445696 00000100:00100000:3.0:1789997439.744903:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704445696 00000100:00080000:1.0:1789997439.744958:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997439.745010:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 386 00000100:00100000:3.0:1789997439.745021:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46250:x1876946704445696:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997439.745452:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46250:x1876946704445696:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 432us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997439.745460:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 386 00000100:00100000:2.0:1789997439.747110:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997439.747319:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704445824 00000100:00100000:3.0:1789997439.747326:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704445824 00000100:00100000:3.0:1789997439.747477:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 730 00000100:00100000:3.0:1789997439.747538:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46250:x1876946704445824:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997439.747875:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46250:x1876946704445824:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 338us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997439.747884:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 730 00000100:00100000:1.0:1789997439.751239:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997439.751346:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704445952 00000100:00100000:0.0:1789997439.751354:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704445952 00000100:00100000:0.0:1789997439.751400:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 731 00000100:00100000:0.0:1789997439.751411:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46250:x1876946704445952:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997439.751510:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46250:x1876946704445952:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 101us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997439.751516:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 731 00000100:00100000:2.0:1789997439.753777:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997439.753856:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704446080 00000100:00100000:3.0:1789997439.753865:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704446080 00000100:00100000:3.0:1789997439.753914:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 387 00000100:00100000:3.0:1789997439.753924:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46250:x1876946704446080:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997439.754330:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46250:x1876946704446080:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 406us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997439.754338:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 387 00000100:00100000:3.0:1789997439.755978:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:2.0:1789997439.756004:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997439.756243:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704446208 00000100:00100000:1.0:1789997439.756252:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704446208 00000100:00100000:1.0:1789997439.756296:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 388 00000100:00100000:1.0:1789997439.756307:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46250:x1876946704446208:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997439.756645:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46250:x1876946704446208:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 339us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997439.756680:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 388 00000100:00100000:2.0:1789997439.758463:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997439.758495:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704446336 00000100:00100000:2.0:1789997439.758502:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704446336 00000100:00100000:2.0:1789997439.758546:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 732 00000100:00100000:2.0:1789997439.758555:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46250:x1876946704446336:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997439.758945:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46250:x1876946704446336:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 390us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997439.758953:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 732 00000100:00100000:3.0:1789997439.799080:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997439.799297:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704446592 00000100:00100000:1.0:1789997439.799309:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704446592 00000100:00100000:1.0:1789997439.799413:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 733 00000100:00100000:1.0:1789997439.799424:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46254:x1876946704446592:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:1.0:1789997439.799468:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997439.799493:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592c74c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebfb expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799511:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789997439.799522:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997439.799546:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799559:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799569:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799580:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799586:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799592:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799908:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799918:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.799923:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997439.800827:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9664 00000004:00080000:1.0:1789997439.800837:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1628493182961ns, next at 1629493180866ns, rc = 0 00010000:00010000:1.0:1789997439.800927:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.800938:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.800947:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.800955:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.800961:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.800967:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.800990:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997439.801012:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801018:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801025:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801031:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997439.801035:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801042:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801052:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997439.801055:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997439.801059:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801066:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c76f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801082:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801088:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801094:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801099:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997439.801102:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801112:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801119:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:1.0:1789997439.801122:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997439.801135:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997439.801141:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592c761 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997439.801151:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8dab438 reply state 00000000a1c03419 transno 4294967576 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.801158:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789997439.801161:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997439.801166:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.801176:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997439.801179:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.801187:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.801197:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:0.0:1789997439.801200:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997439.801204:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.801210:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c776 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.801225:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997439.801227:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997439.801229:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997439.801252:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46254:x1876946704446592:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1828us (2179us total) trans 4294967576 rc 0/0 00000100:00100000:1.0:1789997439.801262:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 733 00010000:00010000:0.0:1789997439.803929:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.803944:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.803951:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.803957:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997439.803961:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.803969:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.803985:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0xf9c7deb2 (ffff8a38e062df00) 00010000:00010000:0.0:1789997439.803988:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997439.803994:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997439.804000:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592c768 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997440.281479:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997440.281531:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997440.281561:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997440.281587:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997440.281615:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704447104 00000100:00100000:2.0:1789997440.281626:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704447104 00000100:00100000:2.0:1789997440.281688:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704446976 00000100:00100000:2.0:1789997440.281691:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704446976 00000100:00100000:0.0:1789997440.281696:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704446848 00000100:00100000:0.0:1789997440.281699:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704446848 00000100:00100000:2.0:1789997440.281715:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 729 00000100:00100000:2.0:1789997440.281724:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704447104:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997440.281727:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1182 00000100:00100000:0.0:1789997440.281733:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704446848:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997440.281791:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704447104:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 67us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997440.281791:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704446848:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 57us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997440.281799:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 729 00000100:00100000:0.0:1789997440.281799:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1182 00000100:00100000:2.0:1789997440.281816:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 730 00000100:00100000:2.0:1789997440.281823:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704446976:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997440.281848:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704446976:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997440.281854:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 730 00000100:00100000:2.0:1789997440.282011:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704446720 00000100:00100000:2.0:1789997440.282015:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704446720 00000100:00100000:2.0:1789997440.282042:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1007 00000100:00100000:2.0:1789997440.282048:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704446720:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997440.282073:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704446720:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997440.282079:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1007 00000100:00100000:3.0:1789997440.459861:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712954880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997440.459936:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997440.459969:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712954880 00000100:00100000:3.0:1789997440.460052:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712955008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997440.460078:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997440.460101:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712954880 00000100:00100000:3.0:1789997440.460121:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712955008 00000100:00100000:3.0:1789997440.460127:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712955008 00000100:00100000:1.0:1789997440.460176:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1789997440.460189:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712954880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997440.460223:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789997440.460282:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712954880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997440.460289:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1789997440.460362:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712954880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997440.460778:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1789997440.460787:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712955008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997440.460808:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789997440.460812:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997440.460818:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997440.460856:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712955008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997440.460864:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1789997440.460884:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712955008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789997440.778802:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997440.966043:0:79262:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1629658386948ns, next at 1625361106274ns, rc = 0 00000004:00080000:1.0:1789997440.966161:0:79262:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1629658506866ns, next at 1629493180866ns, rc = 0 00000004:00080000:2.0:1789997440.983156:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 67 committed 00000004:00080000:2.0:1789997440.983193:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 64 committed 00000001:00080000:2.0:1789997440.983301:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967576 is committed 00000004:00080000:2.0:1789997440.983306:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 66 committed 00000100:00100000:2.0:1789997440.983482:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712955136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997440.983552:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997440.983865:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712955136 00000100:00100000:2.0:1789997440.983874:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712955136 00000100:00100000:2.0:1789997440.983931:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789997440.983940:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712955136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789997440.983980:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00010000:00010000:2.0:1789997440.984020:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.984043:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.984059:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x17:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1789997440.984063:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997440.984068:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.984097:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.984124:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 5 pid: 6659 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997440.984137:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712955264:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997440.984241:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c000 going to sleep for 11 seconds 00000100:00100000:0.0:1789997440.986887:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712955264:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997440.986917:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997440.987041:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997440.987173:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704447232 00000100:00100000:1.0:1789997440.987191:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704447232 00010000:00010000:1.0:1789997440.987226:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 6 pid: 6659 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997440.987278:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 353 00000100:00100000:1.0:1789997440.987287:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704447232:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997440.987302:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997440.987308:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 6 pid: 6659 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997440.987321:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 6 pid: 6659 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997440.987360:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5be7ab0/0x65b43101d592c75a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec02 expref: 6 pid: 6659 timeout: 1729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997440.987377:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997440.987382:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997440.987387:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997440.987397:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997440.987420:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997440.987476:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704447232:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 189us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997440.987485:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 353 00010000:00010000:0.0:1789997440.987650:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997440.987736:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997440.987746:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997440.987754:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997440.987813:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997440.988456:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712955136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4515us (4901us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789997440.988467:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000004:00080000:3.0:1789997440.988569:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3e0e00/2, rc 0, transno 4294967343 00000100:00100000:3.0:1789997440.988604:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712955136:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789997440.989452:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997440.989462:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.989473:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997440.989477:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.989488:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.989512:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.989520:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081b0de7d/0x65b43101d592c77d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997440.989538:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997440.989540:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997440.989541:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997441.804384:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997442.828327:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997443.531207:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997443.531231:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712955392:0@lo:400:kworker.0 00000100:00100000:2.0:1789997443.531370:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712955520:0@lo:400:kworker.0 00000100:00100000:2.0:1789997443.531414:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997443.531461:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712955520 00000100:00100000:2.0:1789997443.531467:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712955520 00000100:00100000:2.0:1789997443.531501:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1789997443.531508:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712955520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997443.531514:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997443.531640:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712955392 00000100:00100000:3.0:1789997443.531645:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712955392 00000100:00100000:3.0:1789997443.531690:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1789997443.531696:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712955392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997443.531729:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712955392:12345-0@lo:400:kworker.0 Request processed in 33us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997443.531736:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1789997443.531776:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712955392:0@lo:400:kworker.0 00000100:00100000:0.0:1789997443.531915:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712955648:0@lo:400:kworker.0 00000100:00100000:0.0:1789997443.531963:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997443.531988:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997443.531996:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712956032:0@lo:400:kworker.0 00000100:00100000:3.0:1789997443.532002:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712955776:0@lo:400:kworker.0 00000100:00100000:0.0:1789997443.532027:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997443.532043:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997443.532070:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712955648 00000100:00100000:0.0:1789997443.532075:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712955648 00000100:00100000:3.0:1789997443.532092:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997443.532100:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712955904:0@lo:400:kworker.0 00000100:00100000:0.0:1789997443.532112:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712956032 00000100:00100000:0.0:1789997443.532116:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712956032 00000100:00100000:3.0:1789997443.532129:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997443.532143:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1789997443.532151:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712955648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997443.532164:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712955776 00000100:00100000:3.0:1789997443.532169:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712955776 00000100:00100000:0.0:1789997443.532207:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712955648:12345-0@lo:400:kworker.0 Request processed in 56us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997443.532214:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712955904 00000100:00100000:0.0:1789997443.532214:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1789997443.532220:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712955904 00000100:00100000:0.0:1789997443.532236:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1789997443.532247:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712956032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997443.532252:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1789997443.532262:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712955776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997443.532279:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712956032:12345-0@lo:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997443.532286:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00080000:0.0:1789997443.532304:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997443.532309:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997443.532312:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997443.532325:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712955776:12345-0@lo:400:kworker.0 Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997443.532334:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1789997443.532343:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712955904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997443.532386:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712955520:12345-0@lo:400:kworker.0 Request processed in 875us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997443.532386:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712955904:12345-0@lo:400:kworker.0 Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997443.532404:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1789997443.532473:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712955904:0@lo:400:kworker.0 00000100:00100000:2.0:1789997443.532484:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712955776:0@lo:400:kworker.0 00000100:00100000:2.0:1789997443.532533:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712955520:0@lo:400:kworker.0 00000100:00100000:1.0:1789997443.532877:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712956032:0@lo:400:kworker.0 00000100:00100000:1.0:1789997443.532894:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712955648:0@lo:400:kworker.0 00000100:00100000:3.0:1789997443.532954:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1789997443.533041:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00010000:00010000:2.0:1789997443.851493:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997444.874860:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997445.085603:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967343 is committed 00000100:00100000:2.0:1789997445.401566:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997445.401699:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997445.401748:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997445.401792:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997445.401850:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704447488 00000100:00100000:0.0:1789997445.401859:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704447488 00000100:00100000:0.0:1789997445.401971:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1186 00000100:00100000:2.0:1789997445.402010:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704447744 00000100:00100000:2.0:1789997445.402024:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704447744 00000100:00100000:2.0:1789997445.402056:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 733 00000100:00100000:2.0:1789997445.402063:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704447744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997445.402066:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704447616 00000100:00100000:3.0:1789997445.402074:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704447616 00000100:00100000:3.0:1789997445.402113:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 734 00000100:00100000:3.0:1789997445.402121:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704447616:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997445.402135:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704447744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 70us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997445.402149:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 733 00000100:00100000:3.0:1789997445.402157:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704447616:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997445.402165:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 734 00000100:00080000:3.0:1789997445.402212:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997445.402216:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997445.402219:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997445.402300:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704447488:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997445.402346:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704447488:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 363us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997445.402353:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1186 00000100:00100000:1.0:1789997445.402551:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704447360 00000100:00100000:1.0:1789997445.402557:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704447360 00000100:00100000:1.0:1789997445.402597:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1009 00000100:00100000:1.0:1789997445.402606:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704447360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997445.402633:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704447360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997445.402640:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1009 00000100:00100000:2.0:1789997445.578912:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997445.579159:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712956288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997445.579287:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997445.579302:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712956160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997445.579341:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997445.579477:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712956288 00000100:00100000:1.0:1789997445.579487:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712956288 00000100:00100000:1.0:1789997445.579549:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712956160 00000100:00100000:1.0:1789997445.579553:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712956160 00000100:00100000:1.0:1789997445.579569:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1789997445.579577:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712956288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997445.579608:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997445.579674:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712956288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997445.579681:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1789997445.579697:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1789997445.579702:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712956160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997445.579720:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997445.579751:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712956160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997445.579756:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1789997445.579809:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712956160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997445.579840:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:1.0:1789997445.579845:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3e0e00, transno 4294967343 00000100:00100000:1.0:1789997445.579859:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712956288:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997445.580836:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997445.580841:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997445.899166:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997446.922901:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997447.947387:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997448.650974:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997448.651029:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712956800:0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.651126:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997448.651148:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712956928:0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.651205:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712956416:0@lo:400:kworker.0 00000100:00100000:2.0:1789997448.651215:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997448.651244:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997448.651265:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712956800 00000100:00100000:2.0:1789997448.651273:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712956800 00000100:00100000:3.0:1789997448.651293:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712956928 00000100:00100000:3.0:1789997448.651298:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712956928 00000100:00100000:2.0:1789997448.651332:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1789997448.651339:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1789997448.651345:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712956800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.651352:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712956928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.651408:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712956928:12345-0@lo:400:kworker.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997448.651414:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712956800:12345-0@lo:400:kworker.0 Request processed in 73us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997448.651420:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1789997448.651429:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1789997448.651521:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712956928:0@lo:400:kworker.0 00000100:00100000:2.0:1789997448.651556:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712956800:0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.651559:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712956416 00000100:00100000:3.0:1789997448.651564:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712956416 00000100:00100000:3.0:1789997448.651596:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1789997448.651605:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712956416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997448.651618:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712956672:0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.651680:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712956416:12345-0@lo:400:kworker.0 Request processed in 76us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997448.651688:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:2.0:1789997448.651693:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997448.651721:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789997448.651730:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712956416:0@lo:400:kworker.0 00000100:00100000:2.0:1789997448.651742:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712956544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997448.651783:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997448.651802:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712957056:0@lo:400:kworker.0 00000100:00100000:2.0:1789997448.651822:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997448.651846:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712956672 00000100:00100000:3.0:1789997448.651852:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712956672 00000100:00100000:2.0:1789997448.651855:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712956544 00000100:00100000:2.0:1789997448.651861:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712956544 00000100:00100000:3.0:1789997448.651885:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712957056 00000100:00100000:3.0:1789997448.651890:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712957056 00000100:00100000:2.0:1789997448.651902:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1789997448.651913:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712956672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.651923:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1789997448.651933:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712956544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997448.651968:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712956672:12345-0@lo:400:kworker.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997448.651976:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1789997448.651989:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712956544:12345-0@lo:400:kworker.0 Request processed in 58us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997448.651996:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1789997448.652006:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712957056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.652008:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1789997448.652055:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712956544:0@lo:400:kworker.0 00000100:00100000:3.0:1789997448.652066:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712956672:0@lo:400:kworker.0 00000100:00080000:3.0:1789997448.652097:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997448.652101:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997448.652103:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997448.652899:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712957056:12345-0@lo:400:kworker.0 Request processed in 892us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997448.653086:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712957056:0@lo:400:kworker.0 00000100:00100000:2.0:1789997448.653088:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00010000:00010000:2.0:1789997448.971012:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997449.996257:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997450.519583:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997450.519789:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997450.519896:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704448000 00000100:00100000:1.0:1789997450.519896:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704447872 00000100:00100000:1.0:1789997450.519907:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704447872 00000100:00100000:3.0:1789997450.519908:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704448000 00000100:00100000:3.0:1789997450.519984:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1190 00000100:00100000:3.0:1789997450.519994:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704448000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:0.0:1789997450.520044:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997450.520291:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704448000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 297us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997450.520299:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1190 00000100:00100000:3.0:1789997450.520344:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997450.520423:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704448256 00000100:00100000:3.0:1789997450.520427:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704448256 00000100:00100000:3.0:1789997450.520586:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 737 00000100:00100000:3.0:1789997450.520593:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704448256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997450.520626:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704448256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997450.520632:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 737 00000100:00080000:3.0:1789997450.520646:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997450.520695:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997450.520750:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1011 00000100:00100000:1.0:1789997450.520762:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704447872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997450.520770:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704448128 00000100:00100000:3.0:1789997450.520776:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704448128 00000100:00100000:1.0:1789997450.520814:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704447872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 55us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997450.520821:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1011 00000100:00100000:0.0:1789997450.521232:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 738 00000100:00100000:0.0:1789997450.521241:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704448128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997450.521279:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704448128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997450.521286:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 738 00000100:00080000:2.0:1789997450.521296:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997450.699831:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712957184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997450.699980:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997450.700029:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712957312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997450.700068:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997450.702959:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712957184 00000100:00100000:2.0:1789997450.704122:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712957312 00000100:00100000:2.0:1789997450.704132:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712957312 00000100:00100000:2.0:1789997450.704332:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:2.0:1789997450.704342:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712957312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997450.704400:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997450.704420:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712957184 00000100:00100000:2.0:1789997450.704777:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712957312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 436us (4707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997450.704784:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:1.0:1789997450.705007:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712957312:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997450.705109:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997450.705114:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997450.705690:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1789997450.705700:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712957184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997450.705727:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997450.705792:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712957184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (5811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997450.705809:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:1.0:1789997450.705871:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712957184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789997451.018943:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997452.045423:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997453.067328:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997453.771353:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997453.771472:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712957568:0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.771546:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997453.771618:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997453.771713:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712957696:0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.771739:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997453.771777:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712957568 00000100:00100000:3.0:1789997453.771785:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712957568 00000100:00100000:3.0:1789997453.771826:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712957696 00000100:00100000:3.0:1789997453.771829:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712957696 00000100:00100000:3.0:1789997453.771875:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1789997453.771885:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712957568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.771938:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712957568:12345-0@lo:400:kworker.0 Request processed in 55us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997453.771946:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1789997453.771965:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1789997453.771971:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712957696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.771995:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712957696:12345-0@lo:400:kworker.0 Request processed in 25us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997453.772000:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:3.0:1789997453.772021:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997453.772046:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712957696:0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.772058:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712957568:0@lo:400:kworker.0 00000100:00100000:0.0:1789997453.772275:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997453.772286:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712957824:0@lo:400:kworker.0 00000100:00100000:0.0:1789997453.772321:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997453.772508:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712957440:0@lo:400:kworker.0 00000100:00100000:1.0:1789997453.772614:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997453.772721:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712957824 00000100:00100000:3.0:1789997453.772727:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712957824 00000100:00100000:0.0:1789997453.772752:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712957440 00000100:00100000:1.0:1789997453.772753:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997453.772760:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712957440 00000100:00100000:1.0:1789997453.772767:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712957952:0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.772779:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1789997453.772785:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712958080:0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.772793:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712957824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997453.772805:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997453.772805:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1789997453.772819:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712957440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997453.772836:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997453.772863:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712957952 00000100:00100000:3.0:1789997453.772867:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712957824:12345-0@lo:400:kworker.0 Request processed in 79us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997453.772870:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712957952 00000100:00100000:3.0:1789997453.772878:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1789997453.772897:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712957440:12345-0@lo:400:kworker.0 Request processed in 79us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997453.772901:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712958080 00000100:00100000:3.0:1789997453.772906:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1789997453.772907:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1789997453.772908:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712958080 00000100:00100000:3.0:1789997453.772920:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712957952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997453.772942:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712957440:0@lo:400:kworker.0 00000100:00100000:2.0:1789997453.772956:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1789997453.772966:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712958080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997453.772971:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712957952:0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.772972:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712957952:12345-0@lo:400:kworker.0 Request processed in 53us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997453.772983:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1789997453.773008:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712958080:12345-0@lo:400:kworker.0 Request processed in 44us (173us total) trans 0 rc 0/0 00000100:00080000:3.0:1789997453.773012:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997453.773016:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00080000:3.0:1789997453.773020:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997453.773025:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997453.773045:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712957824:0@lo:400:kworker.0 00000100:00100000:3.0:1789997453.773073:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712958080:0@lo:400:kworker.0 00010000:00010000:0.0:1789997454.090889:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997455.114915:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997455.639370:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997455.639427:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997455.639469:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997455.639506:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997455.639548:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704448768 00000100:00100000:2.0:1789997455.639556:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704448384 00000100:00100000:0.0:1789997455.639560:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704448768 00000100:00100000:2.0:1789997455.639563:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704448384 00000100:00100000:0.0:1789997455.639611:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704448640 00000100:00100000:0.0:1789997455.639615:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704448640 00000100:00100000:0.0:1789997455.639641:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 741 00000100:00100000:0.0:1789997455.639682:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704448768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997455.639755:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704448768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 105us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997455.639763:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 741 00000100:00100000:0.0:1789997455.639780:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 742 00000100:00100000:0.0:1789997455.639787:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704448640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997455.639824:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704448640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997455.639831:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 742 00000100:00100000:2.0:1789997455.639930:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1013 00000100:00100000:2.0:1789997455.639939:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704448384:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997455.639968:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704448384:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997455.639978:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1013 00000100:00100000:3.0:1789997455.640211:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704448512 00000100:00100000:3.0:1789997455.640217:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704448512 00000100:00100000:2.0:1789997455.640484:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1194 00000100:00100000:2.0:1789997455.640494:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704448512:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1789997455.640545:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997455.640550:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704448512:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 56us (1188us total) trans 0 rc 0/0 00000100:00080000:3.0:1789997455.640553:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997455.640557:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997455.640562:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1194 00000100:00100000:0.0:1789997455.818941:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712958208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997455.819060:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997455.819076:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712958336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997455.819241:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997455.819277:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997455.819493:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712958208 00000100:00100000:1.0:1789997455.819502:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712958208 00000100:00100000:1.0:1789997455.819603:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712958336 00000100:00100000:1.0:1789997455.819607:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712958336 00000100:00100000:0.0:1789997455.819637:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1789997455.819651:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712958208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997455.819709:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997455.819717:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997455.819722:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997455.819762:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712958208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997455.819770:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1789997455.819791:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1789997455.819797:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712958336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997455.819828:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997455.819876:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712958336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997455.819882:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1789997455.819902:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712958208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997455.819981:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712958336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997456.139126:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997456.588204:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997456.588291:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704448896 00000100:00100000:3.0:1789997456.588302:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704448896 00000100:00100000:3.0:1789997456.588364:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 734 00000100:00100000:3.0:1789997456.588375:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46512:x1876946704448896:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997456.588471:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46512:x1876946704448896:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 98us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997456.588476:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 734 00000100:00100000:0.0:1789997456.592011:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997456.592113:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704449024 00000100:00100000:1.0:1789997456.592124:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704449024 00000100:00100000:1.0:1789997456.592182:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 390 00000100:00100000:1.0:1789997456.592193:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46512:x1876946704449024:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997456.592564:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46512:x1876946704449024:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 372us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997456.592572:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 390 00000100:00100000:0.0:1789997456.594134:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997456.594279:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704449152 00000100:00100000:3.0:1789997456.594287:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704449152 00000100:00100000:3.0:1789997456.594335:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 391 00000100:00100000:3.0:1789997456.594344:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46512:x1876946704449152:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997456.594775:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46512:x1876946704449152:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 431us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997456.594783:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 391 00000100:00100000:2.0:1789997456.596860:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997456.597104:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704449280 00000100:00100000:1.0:1789997456.597113:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704449280 00000100:00100000:1.0:1789997456.597203:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 735 00000100:00100000:1.0:1789997456.597213:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46512:x1876946704449280:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997456.597606:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46512:x1876946704449280:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 390us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997456.597628:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 735 00000100:00100000:0.0:1789997456.599872:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997456.600145:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704449408 00000100:00100000:3.0:1789997456.600163:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704449408 00000100:00100000:3.0:1789997456.600259:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 736 00000100:00100000:3.0:1789997456.600269:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46512:x1876946704449408:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997456.600365:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46512:x1876946704449408:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 97us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997456.600373:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 736 00000100:00100000:0.0:1789997456.601963:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997456.602245:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704449536 00000100:00100000:1.0:1789997456.602253:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704449536 00000100:00100000:1.0:1789997456.602357:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 392 00000100:00100000:1.0:1789997456.602368:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46512:x1876946704449536:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997456.603263:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46512:x1876946704449536:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 894us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997456.603272:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 392 00000100:00100000:0.0:1789997456.606439:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997456.606833:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704449664 00000100:00100000:1.0:1789997456.606844:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704449664 00000100:00100000:1.0:1789997456.606903:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 393 00000100:00100000:1.0:1789997456.606913:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46512:x1876946704449664:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997456.608338:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46512:x1876946704449664:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1421us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997456.608348:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 393 00000100:00100000:0.0:1789997456.609992:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997456.611078:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704449792 00000100:00100000:2.0:1789997456.611099:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704449792 00000100:00100000:2.0:1789997456.611218:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 737 00000100:00100000:2.0:1789997456.611229:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46512:x1876946704449792:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997456.611878:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46512:x1876946704449792:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 648us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997456.611887:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 737 00000100:00100000:0.0:1789997456.628019:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997456.628325:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704449920 00000100:00100000:3.0:1789997456.628336:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704449920 00000100:00100000:3.0:1789997456.628441:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 738 00000100:00100000:3.0:1789997456.628454:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46513:x1876946704449920:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997456.628475:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997456.628548:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec09 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.628635:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c78b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.628650:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.629085:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997456.629121:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00000004:00200000:3.0:1789997456.629125:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997456.629144:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c78b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.629170:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec09 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.629191:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c78b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec09 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.629199:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:3.0:1789997456.629202:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997456.629206:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997456.629297:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46513:x1876946704449920:12345-192.168.204.4@tcp:101:rm.0 Request processed in 845us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997456.629305:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 738 00000100:00100000:0.0:1789997456.632394:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997456.632529:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704450176 00000100:00100000:3.0:1789997456.632543:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704450176 00000100:00100000:3.0:1789997456.632616:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 739 00000100:00100000:3.0:1789997456.632628:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46513:x1876946704450176:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997456.632650:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997456.633045:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec10 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997456.633133:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00010000:3.0:1789997456.633409:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c792 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec10 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.633432:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997456.633436:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789997456.633443:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec10 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.633459:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997456.633524:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46513:x1876946704450176:12345-192.168.204.4@tcp:101:rm.0 Request processed in 896us (1134us total) trans 4294967577 rc 301/301 00000100:00100000:3.0:1789997456.633533:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 739 00000100:00100000:0.0:1789997456.638930:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997456.639044:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704450304 00000100:00100000:1.0:1789997456.639053:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704450304 00000100:00100000:1.0:1789997456.639107:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:1.0:1789997456.639118:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46513:x1876946704450304:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:3.0:1789997456.645642:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46513:x1876946704450304:12345-192.168.204.4@tcp:37:rm.0 Request processed in 6514us (6709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997456.645670:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 77 00000100:00100000:0.0:1789997456.648585:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997456.648712:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704450560 00000100:00100000:2.0:1789997456.648722:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704450560 00000100:00100000:2.0:1789997456.648764:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:2.0:1789997456.648773:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46513:x1876946704450560:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:2.0:1789997456.648995:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46513:x1876946704450560:12345-192.168.204.4@tcp:35:rm.0 Request processed in 222us (414us total) trans 4294967578 rc 0/0 00000100:00100000:2.0:1789997456.649002:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 78 00000100:00100000:0.0:1789997456.651351:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997456.651416:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704450816 00000100:00100000:3.0:1789997456.651424:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704450816 00000100:00100000:3.0:1789997456.651493:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 740 00000100:00100000:3.0:1789997456.651506:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46513:x1876946704450816:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997456.651566:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789997456.651593:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c78b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec09 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.651616:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c730 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaebf4 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.651633:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:3.0:1789997456.651649:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c43c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeb3e expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.651695:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997456.651704:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997456.651731:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.651745:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.651754:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.651827:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.651835:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.651843:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.652198:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.652208:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.652215:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997456.653276:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 16384 00010000:00010000:3.0:1789997456.653296:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653304:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653312:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653319:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997456.653323:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653332:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653347:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997456.653351:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997456.653357:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653364:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592c7ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653389:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653394:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653400:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653405:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997456.653408:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653413:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653420:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997456.653422:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997456.653425:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997456.653430:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c7a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997456.654993:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd00beee reply state 0000000081aa7c7f transno 4294967579 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997456.655008:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997456.655098:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46513:x1876946704450816:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3591us (3751us total) trans 4294967579 rc 0/0 00000100:00100000:3.0:1789997456.655107:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 740 00010000:00010000:2.0:1789997456.662133:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997456.662152:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997456.662161:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997456.662167:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997456.662173:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997456.662181:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997456.662197:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38ee49ed00) 00010000:00010000:2.0:1789997456.662201:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997456.662206:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997456.662226:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c7a7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997457.165152:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997458.187975:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997458.540478:0:79624:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdcfddfea0 20000000:00000080:0.0:1789997458.540496:0:79624:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38e0fed800 uarg=0000000000000000 10000000:01000000:0.0:1789997458.540544:0:79624:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997458.540563:0:79624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997458.540580:0:79624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c427 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997458.540588:0:79624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997458.540630:0:79624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c427 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997458.540644:0:79624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c427 expref: 18 pid: 7594 timeout: 1797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997458.540693:0:79624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79624:1876946712958464:0@lo:104: 00000100:00100000:0.0:1789997458.540754:0:79624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997458.540826:0:79624:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6000 going to sleep for 11 seconds 00000100:00100000:1.0:1789997458.541222:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712958464 00000100:00100000:1.0:1789997458.541228:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712958464 00000100:00100000:1.0:1789997458.541269:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1789997458.541280:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:79624:x1876946712958464:12345-0@lo:104: 00010000:00010000:1.0:1789997458.541293:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997458.541361:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997458.541368:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:79624:x1876946712958464:12345-0@lo:104: Request processed in 90us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997458.541375:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:2.0:1789997458.541388:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997458.541395:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997458.541403:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997458.541407:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997458.541416:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997458.541423:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997458.541430:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:0.0:1789997458.541479:0:79624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79624:1876946712958464:0@lo:104: 00010000:00010000:2.0:1789997458.541497:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997458.541497:0:79624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997458.541505:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997458.541538:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997458.541546:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592c427 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c42e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997458.541558:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789997458.541561:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997458.541563:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997458.541564:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997458.541569:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712958592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997458.541598:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997458.541645:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712958592 00000100:00100000:3.0:1789997458.541650:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712958592 00010000:00010000:3.0:1789997458.541854:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c427 expref: 19 pid: 7594 timeout: 1797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997458.541980:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789997458.541988:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712958592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997458.541999:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997458.542005:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c427 expref: 19 pid: 7594 timeout: 1797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542020:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c427 expref: 19 pid: 7594 timeout: 1797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542031:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592c42e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c427 expref: 19 pid: 7594 timeout: 1797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542043:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542051:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542063:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542069:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542075:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542080:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542086:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997458.542090:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542096:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542122:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997458.542130:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997458.542166:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712958592:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997458.542172:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789997458.542174:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712958592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997458.542221:0:79624:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997458.542227:0:79624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997458.542231:0:79624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ee00/0x65b43101d592c7b5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997458.892510:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712958976:0@lo:400:kworker.0 00000100:00100000:1.0:1789997458.892581:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997458.892640:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997458.892648:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712959104:0@lo:400:kworker.0 00000100:00100000:1.0:1789997458.892721:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997458.892776:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712958976 00000100:00100000:0.0:1789997458.892778:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712959104 00000100:00100000:1.0:1789997458.892786:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712958976 00000100:00100000:0.0:1789997458.892786:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712959104 00000100:00100000:2.0:1789997458.892883:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712958720:0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.892914:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997458.892934:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712959232:0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.892956:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997458.892970:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1789997458.892975:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997458.892983:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712958848:0@lo:400:kworker.0 00000100:00100000:0.0:1789997458.892988:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712959104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.893008:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789997458.893048:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997458.893053:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997458.893060:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712959104:12345-0@lo:400:kworker.0 Request processed in 78us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997458.893070:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:0.0:1789997458.893124:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712959104:0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.893224:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712958720 00000100:00100000:2.0:1789997458.893229:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712958720 00000100:00100000:2.0:1789997458.893261:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712959232 00000100:00100000:2.0:1789997458.893264:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712959232 00000100:00100000:2.0:1789997458.893284:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712958848 00000100:00100000:2.0:1789997458.893287:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712958848 00000100:00100000:2.0:1789997458.893319:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1789997458.893327:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712958720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.893371:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712958720:12345-0@lo:400:kworker.0 Request processed in 46us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997458.893379:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1789997458.893392:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1789997458.893399:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712959232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.893430:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712959232:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997458.893436:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1789997458.893450:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1789997458.893456:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712958848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.893488:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712958848:12345-0@lo:400:kworker.0 Request processed in 32us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997458.893494:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1789997458.893712:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1789997458.893725:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712958976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997458.893786:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712958976:12345-0@lo:400:kworker.0 Request processed in 66us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997458.893794:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1789997458.893804:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712958976:0@lo:400:kworker.0 00000100:00080000:2.0:1789997458.894175:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997458.894213:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712958848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.894226:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712958720:0@lo:400:kworker.0 00000100:00100000:2.0:1789997458.894236:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712959232:0@lo:400:kworker.0 00000020:00000080:0.0:1789997459.048485:0:79672:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc1b6e4370 20000000:00000080:0.0:1789997459.048504:0:79672:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38e0fef400 uarg=0000000000000000 10000000:01000000:0.0:1789997459.048556:0:79672:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997459.048578:0:79672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048594:0:79672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048605:0:79672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048612:0:79672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048619:0:79672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048626:0:79672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048633:0:79672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997459.048637:0:79672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048644:0:79672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048738:0:79672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048757:0:79672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.048764:0:79672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660e200/0x65b43101d592c7bc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997459.211810:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997459.852049:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997459.852056:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997459.852060:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997459.852104:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.852118:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.852130:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997459.852166:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712959360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997459.852258:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997459.852313:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997459.852771:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712959360 00000100:00100000:2.0:1789997459.852779:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712959360 00000100:00100000:2.0:1789997459.852840:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1789997459.852849:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712959360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997459.852862:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997459.852873:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c7c3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997459.852895:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997459.852906:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997459.852915:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997459.852962:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712959360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997459.852968:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1789997459.852998:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712959360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997459.853016:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.853028:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997459.853064:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997459.853070:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997459.853079:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.234969:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997460.609534:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997460.609700:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704450944 00000100:00100000:2.0:1789997460.609712:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704450944 00000100:00100000:2.0:1789997460.609832:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 741 00000100:00100000:2.0:1789997460.609843:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46625:x1876946704450944:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997460.609878:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997460.609946:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec17 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.610012:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c7d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.610027:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.610042:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997460.610077:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789997460.610082:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997460.610115:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.610149:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec17 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.610165:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec17 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.610173:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997460.610175:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997460.610178:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789997460.610240:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46625:x1876946704450944:12345-192.168.204.4@tcp:101:rm.0 Request processed in 398us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997460.610247:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 741 00000100:00080000:0.0:1789997460.610315:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997460.612882:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997460.613061:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704451072 00000100:00100000:0.0:1789997460.613069:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704451072 00000100:00100000:0.0:1789997460.613158:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 742 00000100:00100000:0.0:1789997460.613170:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46625:x1876946704451072:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997460.613189:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997460.613207:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c7df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec1e expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613265:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613279:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613288:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613323:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613329:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613333:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613386:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613391:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613395:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613399:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997460.613402:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613410:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613420:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:0.0:1789997460.613423:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997460.613427:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613433:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c7e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613444:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613449:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613455:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613459:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997460.613462:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613468:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613475:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997460.613478:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997460.613481:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613490:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c7ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613527:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c7df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec1e expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613537:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:0.0:1789997460.613540:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997460.613543:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c7df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec1e expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.613552:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e800, rc 0) 00000100:00100000:0.0:1789997460.613619:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46625:x1876946704451072:12345-192.168.204.4@tcp:101:rm.0 Request processed in 451us (744us total) trans 0 rc 301/301 00000100:00100000:0.0:1789997460.613626:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 742 00000100:00100000:1.0:1789997460.642620:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997460.642705:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704451328 00000100:00100000:2.0:1789997460.642732:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704451328 00000100:00100000:2.0:1789997460.642798:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 743 00000100:00100000:2.0:1789997460.642809:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46629:x1876946704451328:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:2.0:1789997460.642872:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997460.642900:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c7d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec17 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.642926:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997460.642941:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997460.643011:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643024:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643034:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643045:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643052:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643059:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997460.643920:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00010000:2.0:1789997460.643935:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643948:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643954:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643960:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997460.643964:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643970:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643980:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997460.643983:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997460.643987:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.643993:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c7f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997460.644007:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054ec5ccb reply state 0000000043d785ae transno 4294967580 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997460.644015:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997460.644106:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46629:x1876946704451328:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 1297us (1493us total) trans 4294967580 rc 0/0 00000100:00100000:2.0:1789997460.644114:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 743 00010000:00010000:0.0:1789997460.646287:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.646303:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.646311:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.646317:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997460.646322:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.646330:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.646346:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38d0bdf000) 00010000:00010000:0.0:1789997460.646349:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997460.646354:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.646361:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c7fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997460.677211:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997460.677530:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704451456 00000100:00100000:3.0:1789997460.677540:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704451456 00000100:00100000:3.0:1789997460.677619:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 744 00000100:00100000:3.0:1789997460.677630:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46633:x1876946704451456:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:3.0:1789997460.677685:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997460.677710:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec25 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.677793:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.677807:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.677819:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997460.677863:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997460.677868:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997460.677889:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.677915:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec25 expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.677934:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec25 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.677942:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997460.677945:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997460.677948:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997460.678026:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46633:x1876946704451456:12345-192.168.204.4@tcp:101:chown.0 Request processed in 398us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997460.678033:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 744 00000100:00100000:1.0:1789997460.683749:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997460.683977:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704451584 00000100:00100000:2.0:1789997460.683987:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704451584 00000100:00100000:2.0:1789997460.684050:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 745 00000100:00100000:2.0:1789997460.684070:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46633:x1876946704451584:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1789997460.684089:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997460.684108:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec2c expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684169:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684184:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684195:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684208:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684216:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684223:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684352:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684361:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684379:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997460.684414:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789997460.684418:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997460.684437:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684448:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684466:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684473:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684479:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997460.684483:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684490:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684502:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:2.0:1789997460.684505:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997460.684509:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684514:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684525:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684536:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684542:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684546:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997460.684549:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684555:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684562:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997460.684565:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997460.684573:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684590:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c81e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684620:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec2c expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684634:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec2c expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997460.684641:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997460.684643:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997460.684646:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997460.684751:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46633:x1876946704451584:12345-192.168.204.4@tcp:101:chown.0 Request processed in 682us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997460.684760:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 745 00000100:00100000:0.0:1789997460.688036:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997460.688151:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704451840 00000100:00100000:3.0:1789997460.688160:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704451840 00000100:00100000:3.0:1789997460.688211:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 746 00000100:00100000:3.0:1789997460.688223:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46633:x1876946704451840:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:3.0:1789997460.688266:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997460.688290:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592c825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec2c expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.688307:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997460.688318:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997460.688339:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.688351:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997460.688361:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997460.709136:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967580 is committed 00000001:00080000:1.0:1789997460.709158:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967581 is committed 00000004:00010000:3.0:1789997460.709271:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d778c55 reply state 000000002ccdb159 transno 4294967581 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997460.709285:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997460.709303:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00080000:3.0:1789997460.709398:0:5810:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997460.709450:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46633:x1876946704451840:12345-192.168.204.4@tcp:36:chown.0 Request processed in 21225us (21415us total) trans 4294967581 rc 0/0 00000100:00100000:3.0:1789997460.709460:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 746 00010000:00010000:0.0:1789997460.710078:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.710088:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.710097:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.710103:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997460.710109:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.710117:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.710132:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:0.0:1789997460.710135:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997460.710139:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997460.710146:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c82c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997460.758735:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997460.758785:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997460.758823:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997460.758856:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704452096 00000100:00100000:2.0:1789997460.758857:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704451968 00000100:00100000:2.0:1789997460.758867:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704451968 00000100:00100000:0.0:1789997460.758867:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704452096 00000100:00100000:0.0:1789997460.758909:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704452224 00000100:00100000:0.0:1789997460.758912:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704452224 00000100:00100000:2.0:1789997460.758914:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1015 00000100:00100000:2.0:1789997460.758922:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704451968:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997460.758931:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 745 00000100:00100000:0.0:1789997460.758937:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704452096:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997460.758998:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704451968:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997460.759006:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1015 00000100:00100000:2.0:1789997460.759063:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 746 00000100:00100000:2.0:1789997460.759071:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704452224:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1789997460.759228:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997460.759234:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997460.761671:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704452096:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2708us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997460.761686:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 745 00000100:00100000:2.0:1789997460.762237:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704452224:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3164us (3411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997460.762247:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 746 00000100:00100000:3.0:1789997460.938891:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712959488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997460.938976:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997460.939059:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712959488 00000100:00100000:3.0:1789997460.939067:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712959488 00000100:00080000:2.0:1789997460.939131:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997460.939142:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1789997460.939153:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712959488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997460.939209:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997460.939269:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712959488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997460.939276:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:2.0:1789997460.939333:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712959488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997460.939646:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997460.939676:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712959616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997460.939708:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997460.939749:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712959616 00000100:00100000:0.0:1789997460.939754:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712959616 00000100:00100000:0.0:1789997460.939866:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:0.0:1789997460.939874:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712959616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997460.939894:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997460.940053:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712959616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997460.940060:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00080000:0.0:1789997460.940077:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997460.940132:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712959616:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1789997461.117295:0:79870:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe84ee5b0 20000000:00000080:0.0:1789997461.117309:0:79870:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38e0fec800 uarg=0000000000000000 10000000:01000000:0.0:1789997461.117343:0:79870:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997461.117358:0:79870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.117380:0:79870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.117388:0:79870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.117427:0:79870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.117439:0:79870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 18 pid: 5804 timeout: 1799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997461.117450:0:79870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79870:1876946712959744:0@lo:104: 00000100:00100000:0.0:1789997461.117498:0:79870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997461.117547:0:79870:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789997461.117593:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712959744 00000100:00100000:3.0:1789997461.117602:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712959744 00000100:00100000:3.0:1789997461.117905:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789997461.117918:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:79870:x1876946712959744:12345-0@lo:104: 00010000:00010000:3.0:1789997461.117932:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997461.118056:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997461.118062:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:79870:x1876946712959744:12345-0@lo:104: Request processed in 148us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997461.118069:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:2.0:1789997461.118126:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997461.118134:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997461.118147:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997461.118152:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997461.118157:0:79870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:79870:1876946712959744:0@lo:104: 00010000:00010000:2.0:1789997461.118165:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997461.118174:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.118176:0:79870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997461.118186:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997461.118215:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997461.118222:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789997461.118263:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712959872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997461.118289:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997461.118330:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712959872 00000100:00100000:1.0:1789997461.118335:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712959872 00010000:00010000:2.0:1789997461.118345:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997461.118353:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38f660ee00/0x65b43101d592c7c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997461.118370:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997461.118372:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997461.118374:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997461.118421:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 19 pid: 5804 timeout: 1799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997461.118454:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789997461.118462:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712959872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997461.118473:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997461.118478:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 19 pid: 5804 timeout: 1799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118489:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 19 pid: 5804 timeout: 1799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118503:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592c7ca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c7c3 expref: 19 pid: 5804 timeout: 1799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118515:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118523:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118535:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118543:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118550:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118557:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118563:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ec00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997461.118567:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118574:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118599:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.118608:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997461.118647:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712959872:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997461.118672:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789997461.118768:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712959872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997461.118808:0:79870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.118817:0:79870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.118823:0:79870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ec00/0x65b43101d592c833 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997461.258941:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997461.568208:0:79919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc14356620 20000000:00000080:0.0:1789997461.568225:0:79919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38e0fef400 uarg=0000000000000000 10000000:01000000:0.0:1789997461.568273:0:79919:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997461.568293:0:79919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568308:0:79919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568317:0:79919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568323:0:79919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568330:0:79919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568337:0:79919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568343:0:79919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997461.568347:0:79919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568354:0:79919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568365:0:79919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568377:0:79919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997461.568383:0:79919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660f800/0x65b43101d592c83a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 79919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997462.288410:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997462.733534:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997462.733544:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997462.733550:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997462.733620:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997462.733634:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997462.733645:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997462.733705:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712960000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997462.733794:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997462.733856:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd708f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789997462.733870:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712960000 00000100:00100000:3.0:1789997462.733879:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712960000 00000100:00100000:3.0:1789997462.733930:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:3.0:1789997462.733940:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712960000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997462.733953:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997462.733966:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592c841 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997462.733989:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592c841 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997462.734000:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c841 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997462.734009:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:3.0:1789997462.734076:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712960000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997462.734083:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:1.0:1789997462.734303:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712960000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997462.734320:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997462.734335:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997462.734353:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997462.734357:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997462.734364:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997463.306766:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997463.415834:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997463.416035:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704452352 00000100:00100000:0.0:1789997463.416046:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704452352 00000100:00100000:1.0:1789997463.416208:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:1.0:1789997463.416219:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:5580:x1876946704452352:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997463.416237:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1789997463.416247:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789997463.416263:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c809 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec25 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997463.416284:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997463.416296:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997463.416354:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704452352:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 137us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997463.416361:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 12 00000100:00100000:2.0:1789997464.013092:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712960128:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.013161:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997464.013251:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712960128 00000100:00100000:1.0:1789997464.013259:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712960128 00000100:00100000:1.0:1789997464.013307:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1789997464.013317:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712960128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997464.013570:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712960128:12345-0@lo:400:kworker.0 Request processed in 254us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997464.013578:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1789997464.013692:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712960384:0@lo:400:kworker.0 00000100:00100000:1.0:1789997464.013721:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997464.013815:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997464.013821:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712960512:0@lo:400:kworker.0 00000100:00100000:1.0:1789997464.013846:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997464.013876:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712960384 00000100:00100000:1.0:1789997464.013889:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712960384 00000100:00100000:1.0:1789997464.013928:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1789997464.014051:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712960384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997464.014089:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712960384:12345-0@lo:400:kworker.0 Request processed in 155us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997464.014095:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1789997464.014113:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712960512 00000100:00100000:1.0:1789997464.014117:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712960512 00000100:00100000:1.0:1789997464.014143:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1789997464.014150:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712960512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997464.014179:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712960512:12345-0@lo:400:kworker.0 Request processed in 30us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997464.014184:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00080000:1.0:1789997464.014200:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997464.014206:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997464.014240:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712960512:0@lo:400:kworker.0 00000100:00100000:1.0:1789997464.014251:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712960384:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.014345:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712960128:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.014357:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997464.014364:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712960256:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.014392:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997464.014449:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712960256 00000100:00100000:2.0:1789997464.014453:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712960256 00000100:00100000:2.0:1789997464.014478:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1789997464.014486:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712960256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.014523:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712960256:12345-0@lo:400:kworker.0 Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997464.014530:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1789997464.014558:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712960256:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.014781:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712960640:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.014813:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997464.014906:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712960640 00000100:00100000:1.0:1789997464.014911:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712960640 00000100:00100000:1.0:1789997464.014955:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1789997464.014963:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712960640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997464.015103:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712960640:12345-0@lo:400:kworker.0 Request processed in 140us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997464.015110:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00080000:1.0:1789997464.015125:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997464.015163:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712960640:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.015174:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997464.015179:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712960768:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.015203:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997464.015386:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712960768 00000100:00100000:3.0:1789997464.015390:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712960768 00000100:00100000:3.0:1789997464.015505:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1789997464.015513:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712960768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997464.015560:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712960768:12345-0@lo:400:kworker.0 Request processed in 48us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997464.015567:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00080000:1.0:1789997464.015924:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997464.015992:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712960768:0@lo:400:kworker.0 00000100:00100000:2.0:1789997464.044525:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997464.044773:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704452480 00000100:00100000:1.0:1789997464.044784:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704452480 00000100:00100000:1.0:1789997464.044852:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 747 00000100:00100000:1.0:1789997464.044864:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46738:x1876946704452480:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997464.044889:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997464.044910:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c84f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec33 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.044971:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c856 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.044985:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.044997:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997464.045033:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997464.045037:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997464.045057:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.045081:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c84f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec33 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.045099:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec33 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.045109:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997464.045112:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997464.045116:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997464.045226:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46738:x1876946704452480:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 364us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997464.045234:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 747 00000100:00100000:0.0:1789997464.049474:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997464.049917:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704452608 00000100:00100000:2.0:1789997464.049927:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704452608 00000100:00100000:2.0:1789997464.049989:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 748 00000100:00100000:2.0:1789997464.050000:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46738:x1876946704452608:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997464.050021:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997464.050043:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c85d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec3a expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050102:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050116:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050128:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050142:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050150:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050157:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050443:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050453:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050461:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997464.050490:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789997464.050493:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997464.050510:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050521:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050528:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050540:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050546:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997464.050550:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050557:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050568:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:2.0:1789997464.050571:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997464.050575:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050581:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050590:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050596:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050602:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050607:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997464.050610:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050615:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050622:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997464.050625:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997464.050627:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050633:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c86b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050689:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c85d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec3a expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050702:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec3a expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.050709:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997464.050711:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997464.050714:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997464.050769:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46738:x1876946704452608:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 772us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997464.050776:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 748 00000100:00100000:0.0:1789997464.057271:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997464.057915:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704452864 00000100:00100000:3.0:1789997464.057926:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704452864 00000100:00100000:3.0:1789997464.058092:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 749 00000100:00100000:3.0:1789997464.058102:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46738:x1876946704452864:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997464.058160:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997464.058196:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec3a expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.058213:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:3.0:1789997464.058223:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997464.058246:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.058259:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.058269:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997464.083211:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040f3d4ef reply state 00000000f0f71a50 transno 4294967582 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997464.083226:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997464.083241:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000100:00100000:1.0:1789997464.083336:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46738:x1876946704452864:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 25232us (26071us total) trans 4294967582 rc 0/0 00000100:00100000:1.0:1789997464.083346:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 749 00000001:00080000:2.0:1789997464.083990:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967582 is committed 00010000:00010000:0.0:1789997464.084317:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.084327:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.084335:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.084342:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997464.084346:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.084353:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.084368:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:0.0:1789997464.084372:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997464.084377:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.084384:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c879 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997464.121303:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997464.121706:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704452992 00000100:00100000:3.0:1789997464.121717:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704452992 00000100:00100000:3.0:1789997464.121776:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 750 00000100:00100000:3.0:1789997464.121787:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46742:x1876946704452992:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997464.122069:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997464.122090:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec41 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122163:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122186:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122199:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122214:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122222:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122229:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122527:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122537:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122544:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997464.122586:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789997464.122590:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997464.122609:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122621:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122628:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122635:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122641:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997464.122646:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122687:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122700:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:3.0:1789997464.122703:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997464.122708:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122715:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122727:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122733:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122739:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122745:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997464.122748:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122754:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122762:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997464.122764:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997464.122767:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.122773:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c88e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.123307:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec41 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.123325:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec41 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.123333:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:3.0:1789997464.123335:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997464.123338:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997464.123412:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46742:x1876946704452992:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1626us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997464.123420:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 750 00000100:00100000:1.0:1789997464.126740:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997464.126911:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704453248 00000100:00100000:0.0:1789997464.126920:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704453248 00000100:00100000:0.0:1789997464.126984:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 751 00000100:00100000:0.0:1789997464.126994:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46742:x1876946704453248:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997464.127015:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997464.127035:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c89c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec48 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.127356:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.127378:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.127388:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.127404:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.127411:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.127418:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997464.128436:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:0.0:1789997464.128637:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c8b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128689:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128701:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c8b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128866:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128875:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128882:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128888:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997464.128892:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128900:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128912:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:0.0:1789997464.128915:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997464.128919:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.128926:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c8a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997464.128943:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d0d14ff reply state 0000000089bde110 transno 4294967583 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997464.128951:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997464.128985:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c89c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec48 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.129001:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c8b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec48 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.129008:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997464.129010:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997464.129013:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ee00, rc 0) 00000100:00100000:0.0:1789997464.129088:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46742:x1876946704453248:12345-192.168.204.4@tcp:101:touch.0 Request processed in 2095us (2354us total) trans 4294967583 rc 0/0 00000100:00100000:0.0:1789997464.129097:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 751 00010000:00010000:2.0:1789997464.133689:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.133710:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.133720:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.133726:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997464.133732:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.133740:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.133757:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997464.133760:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997464.133765:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.133771:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c8aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997464.137587:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997464.137964:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704453504 00000100:00100000:0.0:1789997464.137977:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704453504 00000100:00100000:0.0:1789997464.138040:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 752 00000100:00100000:0.0:1789997464.138051:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46742:x1876946704453504:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:0.0:1789997464.138113:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997464.138143:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c8b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec48 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.138161:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997464.138173:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997464.138228:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.138244:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.138255:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997464.138397:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048eba97e reply state 00000000814dfc6e transno 4294967584 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997464.138407:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997464.138504:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46742:x1876946704453504:12345-192.168.204.4@tcp:36:touch.0 Request processed in 454us (926us total) trans 4294967584 rc 0/0 00000100:00100000:0.0:1789997464.138511:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 752 00010000:00010000:3.0:1789997464.140127:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.140141:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.140149:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.140154:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ec00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997464.140159:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.140166:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.140180:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:3.0:1789997464.140183:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997464.140188:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.140268:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c8bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997464.142391:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997464.142574:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704453632 00000100:00100000:2.0:1789997464.142585:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704453632 00000100:00100000:2.0:1789997464.142639:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 753 00000100:00100000:2.0:1789997464.142678:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46742:x1876946704453632:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997464.142702:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997464.142723:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c8c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec4f expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.142779:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec4f expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.142794:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c8c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec4f expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.142814:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997464.142818:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997464.142821:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997464.142889:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46742:x1876946704453632:12345-192.168.204.4@tcp:101:touch.0 Request processed in 241us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997464.142896:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 753 00000100:00100000:0.0:1789997464.145463:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997464.145522:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704453760 00000100:00100000:1.0:1789997464.145531:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704453760 00000100:00080000:2.0:1789997464.145608:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997464.145643:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 394 00000100:00100000:1.0:1789997464.145691:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704453760:12345-192.168.204.4@tcp:2:touch.0 00000100:00100000:1.0:1789997464.146052:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704453760:12345-192.168.204.4@tcp:2:touch.0 Request processed in 362us (595us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789997464.146061:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 394 00000100:00100000:0.0:1789997464.148828:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997464.149017:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704454016 00000100:00100000:2.0:1789997464.149026:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704454016 00000100:00100000:2.0:1789997464.149083:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:2.0:1789997464.149094:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46742:x1876946704454016:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:2.0:1789997464.149509:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46742:x1876946704454016:12345-192.168.204.4@tcp:35:touch.0 Request processed in 416us (689us total) trans 4294967585 rc 0/0 00000100:00100000:2.0:1789997464.149517:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 79 00000100:00100000:0.0:1789997464.188897:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997464.188975:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704454144 00000100:00100000:2.0:1789997464.188987:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704454144 00000100:00100000:2.0:1789997464.189056:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 754 00000100:00100000:2.0:1789997464.189067:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46746:x1876946704454144:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997464.189093:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997464.189359:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c8cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec56 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189422:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189436:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189446:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189458:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189465:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189471:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189544:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c8e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189552:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189558:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997464.189594:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 0 00000004:00200000:2.0:1789997464.189598:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997464.189617:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189628:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189635:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189642:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189691:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189697:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997464.189702:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189709:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189720:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:2.0:1789997464.189722:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997464.189727:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189733:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592c8d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189747:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189753:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189760:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189765:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997464.189768:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189774:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189783:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997464.189786:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997464.189789:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189794:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592c8db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189823:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592c8cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec56 expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189836:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec56 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.189842:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997464.189844:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997464.189847:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997464.189910:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46746:x1876946704454144:12345-192.168.204.4@tcp:101:rm.0 Request processed in 845us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997464.189920:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 754 00000100:00100000:0.0:1789997464.192836:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997464.192965:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704454272 00000100:00100000:1.0:1789997464.192975:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704454272 00000100:00100000:2.0:1789997464.193064:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 395 00000100:00100000:2.0:1789997464.193075:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704454272:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997464.193098:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997464.193119:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec5d expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997464.193145:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x6ab13198, atime: 0x6ab13198, ctime: 0x6ab13198, blocks: 0x1 00010000:00010000:2.0:1789997464.193176:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=1652s v=(0 0) 00010000:00010000:2.0:1789997464.193189:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997464.193197:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.193215:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.193229:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997464.193333:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704454272:12345-192.168.204.4@tcp:101:rm.0 Request processed in 260us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997464.193348:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 395 00000100:00100000:0.0:1789997464.195787:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997464.195936:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704454528 00000100:00100000:1.0:1789997464.195944:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704454528 00000100:00100000:1.0:1789997464.195994:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 755 00000100:00100000:1.0:1789997464.196004:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46746:x1876946704454528:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997464.196048:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997464.196072:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c8e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec56 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196093:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c8c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec4f expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196104:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:1.0:1789997464.196114:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997464.196134:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196148:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196159:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196173:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196180:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196187:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196278:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196286:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196293:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997464.196878:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 64 off9664 00000004:00080000:1.0:1789997464.196889:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1652889234434ns, next at 1653889232661ns, rc = 0 00010000:00010000:1.0:1789997464.196937:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196947:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196954:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196962:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196969:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.196979:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.198388:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997464.198400:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.198411:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997464.198415:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.198424:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198430:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789997464.198442:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:0.0:1789997464.198444:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997464.198449:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.198454:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592c905 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198456:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198463:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198469:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198474:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997464.198478:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198484:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198492:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997464.198494:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997464.198497:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198502:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592c8fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198519:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198525:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198532:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198537:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997464.198539:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198545:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198553:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:1.0:1789997464.198555:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997464.198559:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.198564:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592c8f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997464.198573:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062c48a08 reply state 00000000490b607c transno 4294967586 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.198574:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997464.198577:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997464.198578:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997464.198582:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997464.199373:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46746:x1876946704454528:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3363us (3585us total) trans 4294967586 rc 0/0 00000100:00100000:1.0:1789997464.199383:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 755 00010000:00010000:2.0:1789997464.201463:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.201480:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.201492:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.201497:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997464.201501:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.201508:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.201524:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38e062d800) 00010000:00010000:2.0:1789997464.201527:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997464.201537:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.201543:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592c8f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.333262:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997464.834496:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997464.835774:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704454656 00000100:00100000:2.0:1789997464.835787:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704454656 00000100:00100000:2.0:1789997464.835908:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 756 00000100:00100000:2.0:1789997464.835920:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46761:x1876946704454656:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997464.835946:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997464.835968:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c90c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec64 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.836066:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.836087:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.836101:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997464.836144:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789997464.836148:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997464.836166:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.836193:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c90c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec64 expref: 13 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.836210:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec64 expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.836218:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:2.0:1789997464.836221:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997464.836225:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997464.836448:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46761:x1876946704454656:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 529us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997464.836455:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 756 00000100:00100000:0.0:1789997464.839935:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997464.840017:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704454912 00000100:00100000:2.0:1789997464.840027:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704454912 00000100:00100000:2.0:1789997464.840083:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 757 00000100:00100000:2.0:1789997464.840096:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46761:x1876946704454912:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997464.840145:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997464.840174:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec64 expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.840193:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592c895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec41 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.840205:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:2.0:1789997464.840216:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997464.840243:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.840258:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.840269:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997464.866779:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967584 is committed 00000001:00080000:2.0:1789997464.866812:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967586 is committed 00000004:00080000:2.0:1789997464.866817:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 65 committed 00000001:00080000:2.0:1789997464.866841:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967587 is committed 00000100:00100000:0.0:1789997464.867029:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997464.867053:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712960896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997464.867132:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997464.867263:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712960896 00000100:00100000:1.0:1789997464.867273:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712960896 00000100:00100000:1.0:1789997464.867324:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789997464.867333:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712960896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789997464.867362:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:23 count 1 00010000:00010000:1.0:1789997464.867389:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.867412:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.867421:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789997464.867426:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997464.867431:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.867460:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.867476:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 6 pid: 6659 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997464.867488:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712961024:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997464.867556:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0a77e40 going to sleep for 11 seconds 00000004:00010000:3.0:1789997464.868489:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002843d3f9 reply state 00000000fee3c1f2 transno 4294967587 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997464.868595:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997464.868610:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00080000:3.0:1789997464.868750:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997464.868778:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46761:x1876946704454912:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 28683us (28846us total) trans 4294967587 rc 0/0 00000100:00100000:3.0:1789997464.868787:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 757 00010000:00010000:1.0:1789997464.868809:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.868821:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.868830:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.868838:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997464.868844:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.868852:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.868927:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:1.0:1789997464.868931:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997464.868937:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.868944:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592c91a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997464.876233:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997464.876296:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704455040 00000100:00100000:3.0:1789997464.876305:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704455040 00010000:00010000:3.0:1789997464.876385:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 7 pid: 6659 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997464.876431:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 356 00000100:00100000:3.0:1789997464.876439:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704455040:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997464.876455:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997464.876461:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 7 pid: 6659 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.876474:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 7 pid: 6659 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.876499:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997464.876504:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997464.876511:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.876521:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.876543:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997464.876598:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704455040:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 159us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997464.876605:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 356 00010000:00010000:1.0:1789997464.877811:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a189263/0x65b43101d592c8e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec5d expref: 6 pid: 6659 timeout: 1753 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997464.877831:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712961024:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997464.877854:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.877867:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.877875:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.877892:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.877901:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.877923:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789997464.878646:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712960896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11303us (11503us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789997464.878684:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:3.0:1789997464.880209:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997464.880221:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.880236:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997464.880241:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.880254:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.880275:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.880283:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592c921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.880306:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997464.880308:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997464.880310:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789997464.880402:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38d00f4000/2, rc 0, transno 4294967343 00000100:00100000:2.0:1789997464.880411:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712960896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789997464.923221:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997464.923305:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704455168 00000100:00100000:0.0:1789997464.923316:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704455168 00000100:00100000:0.0:1789997464.923379:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 758 00000100:00100000:0.0:1789997464.923393:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46765:x1876946704455168:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997464.923419:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997464.923439:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c928 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec6b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923504:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923519:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923532:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923546:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923554:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923560:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923909:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c93d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923919:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923928:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997464.923955:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:0.0:1789997464.923959:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997464.923980:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923991:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.923997:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924008:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924014:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997464.924018:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924026:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924037:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997464.924041:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997464.924046:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924053:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592c92f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924063:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924070:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924076:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924080:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997464.924084:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924094:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924101:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38c28e9200) 00010000:00010000:0.0:1789997464.924103:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997464.924389:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924398:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592c936 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924433:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592c928 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec6b expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924448:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c93d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec6b expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997464.924455:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997464.924458:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997464.924460:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e200, rc 0) 00000100:00100000:0.0:1789997464.924529:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46765:x1876946704455168:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1139us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997464.924537:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 758 00000100:00100000:0.0:1789997464.929859:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997464.929929:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704455424 00000100:00100000:3.0:1789997464.929938:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704455424 00000100:00100000:2.0:1789997464.930009:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 759 00000100:00100000:2.0:1789997464.930023:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:46765:x1876946704455424:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997464.930055:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997464.930080:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c944 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec72 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.930495:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.930511:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.930522:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.930536:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.930542:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.930549:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997464.931219:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:2.0:1789997464.931560:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931575:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931584:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931775:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931788:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931793:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931797:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997464.931800:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931805:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931814:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:2.0:1789997464.931816:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997464.931819:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931823:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c94b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997464.931832:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa37a01f reply state 000000004e8ddfdb transno 4294967588 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997464.931838:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997464.931876:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592c944 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec72 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931887:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec72 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.931895:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997464.931896:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997464.931898:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997464.931956:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46765:x1876946704455424:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1938us (2108us total) trans 4294967588 rc 0/0 00000100:00100000:2.0:1789997464.931963:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 759 00010000:00010000:3.0:1789997464.934332:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.934349:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.934358:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.934369:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997464.934373:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.934381:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.934395:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38d0bdf800) 00010000:00010000:3.0:1789997464.934398:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997464.934402:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.934468:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592c952 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997464.934898:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997464.934951:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704455680 00000100:00100000:3.0:1789997464.934961:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704455680 00000100:00100000:3.0:1789997464.935080:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 760 00000100:00100000:3.0:1789997464.935091:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46765:x1876946704455680:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:3.0:1789997464.935156:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997464.935175:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592c959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec72 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.935187:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:3.0:1789997464.935195:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997464.935232:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.935246:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997464.935257:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997464.935399:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3c383b1 reply state 00000000baa4c319 transno 4294967589 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997464.935417:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997464.935511:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46765:x1876946704455680:12345-192.168.204.4@tcp:36:touch.0 Request processed in 422us (617us total) trans 4294967589 rc 0/0 00000100:00100000:3.0:1789997464.935518:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 760 00010000:00010000:2.0:1789997464.936965:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.936980:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.936987:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.936994:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997464.936998:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.937006:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.937018:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:2.0:1789997464.937021:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997464.937026:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997464.937032:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592c967 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997464.938266:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997464.939232:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704455808 00000100:00100000:1.0:1789997464.939243:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704455808 00000100:00100000:1.0:1789997464.939340:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 761 00000100:00100000:1.0:1789997464.939353:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46765:x1876946704455808:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997464.939391:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997464.939418:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c96e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec79 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.939476:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c96e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec79 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.939493:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c96e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec79 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997464.939530:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997464.939534:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789997464.939538:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997464.939608:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46765:x1876946704455808:12345-192.168.204.4@tcp:101:touch.0 Request processed in 257us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997464.939615:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 761 00000100:00100000:1.0:1789997464.945902:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997464.945983:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704455936 00000100:00100000:0.0:1789997464.945994:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704455936 00000100:00100000:0.0:1789997464.946103:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 397 00000100:00100000:0.0:1789997464.946115:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704455936:12345-192.168.204.4@tcp:2:touch.0 00000100:00100000:0.0:1789997464.946463:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704455936:12345-192.168.204.4@tcp:2:touch.0 Request processed in 350us (571us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789997464.946470:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 397 00000100:00080000:2.0:1789997464.946671:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997464.951290:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997464.953510:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704456192 00000100:00100000:1.0:1789997464.953523:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704456192 00000100:00100000:1.0:1789997464.953693:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:1.0:1789997464.953706:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:46765:x1876946704456192:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:1.0:1789997464.954089:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46765:x1876946704456192:12345-192.168.204.4@tcp:35:touch.0 Request processed in 385us (2807us total) trans 4294967590 rc 0/0 00000100:00100000:1.0:1789997464.954097:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 80 00000100:00100000:3.0:1789997465.004946:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997465.005013:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704456320 00000100:00100000:2.0:1789997465.005036:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704456320 00000100:00100000:2.0:1789997465.005119:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 762 00000100:00100000:2.0:1789997465.005131:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46769:x1876946704456320:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997465.005262:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997465.005284:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c975 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec80 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005345:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005360:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005370:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005386:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005393:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005399:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005486:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c98a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005496:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005503:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997465.005534:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3f:0x0]: returning size 0 00000004:00200000:2.0:1789997465.005538:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997465.005556:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005567:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c98a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005576:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005583:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005589:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005595:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997465.005599:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005607:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005619:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:2.0:1789997465.005623:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997465.005628:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005647:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592c97c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789997465.005723:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789997465.005818:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005824:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005830:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005835:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997465.005838:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005845:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005853:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997465.005855:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997465.005859:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005865:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005894:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592c975 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec80 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005909:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c98a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec80 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.005916:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:2.0:1789997465.005918:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997465.005921:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2000, rc 0) 00000100:00100000:3.0:1789997465.006075:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46769:x1876946704456320:12345-192.168.204.4@tcp:101:rm.0 Request processed in 945us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997465.006083:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 762 00000100:00100000:0.0:1789997465.008993:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997465.009092:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704456448 00000100:00100000:1.0:1789997465.009103:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704456448 00000100:00100000:1.0:1789997465.009231:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 398 00000100:00100000:1.0:1789997465.009242:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704456448:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997465.009259:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997465.009279:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec87 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997465.009306:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x6ab13198, atime: 0x6ab13198, ctime: 0x6ab13198, blocks: 0x1 00010000:00010000:1.0:1789997465.009325:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=1653s v=(0 0) 00010000:00010000:1.0:1789997465.009332:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997465.009342:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.009361:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.009374:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997465.009477:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704456448:12345-192.168.204.4@tcp:101:rm.0 Request processed in 237us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997465.009484:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 398 00000100:00100000:2.0:1789997465.015476:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997465.015543:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704456704 00000100:00100000:3.0:1789997465.015551:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704456704 00000100:00100000:3.0:1789997465.015601:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 763 00000100:00100000:3.0:1789997465.015611:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46769:x1876946704456704:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997465.015694:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997465.015719:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592c98a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec80 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015738:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592c96e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec79 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015749:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:3.0:1789997465.015759:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997465.015780:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015793:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015802:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015815:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015821:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015827:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015922:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015929:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.015936:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997465.016814:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 64 off9728 00000004:00080000:3.0:1789997465.016825:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1653709170346ns, next at 1654709168236ns, rc = 0 00010000:00010000:3.0:1789997465.016890:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016901:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016910:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016917:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016923:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016929:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016951:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997465.016967:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016973:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016979:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016984:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997465.016989:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.016996:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017004:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997465.017007:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997465.017010:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017016:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017031:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017037:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017042:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017048:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997465.017051:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017056:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017062:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:3.0:1789997465.017064:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997465.017067:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.017073:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c998 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997465.017081:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebb94d78 reply state 0000000038d63f65 transno 4294967591 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997465.017093:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997465.017171:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46769:x1876946704456704:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1559us (1702us total) trans 4294967591 rc 0/0 00000100:00100000:3.0:1789997465.017179:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 763 00010000:00010000:1.0:1789997465.017425:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997465.017431:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.017438:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997465.017441:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.017447:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.017456:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:1.0:1789997465.017458:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997465.017461:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.017467:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592c9ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.017484:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997465.017486:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997465.017488:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997465.018812:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.018824:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.018830:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.018834:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997465.018838:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.018844:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.018855:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997465.018858:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997465.018926:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.018933:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c99f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.354803:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997465.512300:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997465.512507:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704456832 00000100:00100000:0.0:1789997465.512519:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704456832 00000100:00100000:0.0:1789997465.512605:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 764 00000100:00100000:0.0:1789997465.512616:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46783:x1876946704456832:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997465.512689:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997465.512723:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c9b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec8e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.512794:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.512810:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.512823:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997465.512871:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:0.0:1789997465.512875:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997465.512895:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.512920:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c9b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec8e expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.512938:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec8e expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.512947:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997465.512951:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997465.512954:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ee00, rc 0) 00000100:00100000:0.0:1789997465.513021:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46783:x1876946704456832:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 407us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997465.513029:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 764 00000100:00100000:3.0:1789997465.516232:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997465.516314:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704457088 00000100:00100000:2.0:1789997465.516324:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704457088 00000100:00100000:2.0:1789997465.516381:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 765 00000100:00100000:2.0:1789997465.516390:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46783:x1876946704457088:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997465.516442:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997465.516468:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec8e expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.516488:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c93d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec6b expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.516500:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:2.0:1789997465.516511:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997465.516535:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.516548:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.516560:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997465.516848:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000086b180a reply state 000000006701c613 transno 4294967592 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997465.516857:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997465.516866:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000100:00100000:2.0:1789997465.516946:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46783:x1876946704457088:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 556us (783us total) trans 4294967592 rc 0/0 00000100:00100000:2.0:1789997465.516954:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 765 00010000:00010000:2.0:1789997465.518103:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.518115:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.518123:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.518137:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997465.518142:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.518150:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.518162:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997465.518165:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997465.518170:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.518176:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592c9c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997465.599331:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000001:00080000:1.0:1789997465.599457:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00000001:00080000:1.0:1789997465.599466:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00000100:00100000:1.0:1789997465.602470:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997465.604031:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704457216 00000100:00100000:2.0:1789997465.604045:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704457216 00000100:00100000:2.0:1789997465.604110:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 766 00000100:00100000:2.0:1789997465.604121:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46795:x1876946704457216:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997465.604228:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46795:x1876946704457216:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 104us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997465.604235:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 766 00000100:00100000:2.0:1789997465.606756:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997465.607263:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704457344 00000100:00100000:1.0:1789997465.607284:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704457344 00000100:00100000:1.0:1789997465.607353:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 399 00000100:00100000:1.0:1789997465.607377:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46795:x1876946704457344:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997465.608324:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46795:x1876946704457344:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 958us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997465.608336:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 399 00000100:00100000:2.0:1789997465.612183:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997465.612239:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704457472 00000100:00100000:1.0:1789997465.612296:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704457472 00000100:00100000:1.0:1789997465.612403:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 400 00000100:00100000:1.0:1789997465.612414:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46795:x1876946704457472:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997465.612835:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46795:x1876946704457472:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 422us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997465.612842:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 400 00000100:00100000:2.0:1789997465.615055:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997465.615171:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704457600 00000100:00100000:1.0:1789997465.615181:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704457600 00000100:00100000:1.0:1789997465.615240:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 767 00000100:00100000:1.0:1789997465.615252:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46795:x1876946704457600:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997465.616027:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46795:x1876946704457600:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 774us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997465.616037:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 767 00000100:00100000:2.0:1789997465.619774:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997465.619993:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704457728 00000100:00100000:0.0:1789997465.620003:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704457728 00000100:00100000:0.0:1789997465.620068:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 768 00000100:00100000:0.0:1789997465.620079:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46795:x1876946704457728:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997465.620233:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46795:x1876946704457728:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 103us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997465.620241:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 768 00000100:00100000:2.0:1789997465.626038:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997465.626148:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704457856 00000100:00100000:0.0:1789997465.626162:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704457856 00000100:00100000:0.0:1789997465.626233:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 401 00000100:00100000:0.0:1789997465.626244:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46795:x1876946704457856:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997465.627006:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46795:x1876946704457856:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 761us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997465.627015:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 401 00000100:00100000:2.0:1789997465.628918:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997465.629134:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704457984 00000100:00100000:1.0:1789997465.629142:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704457984 00000100:00100000:1.0:1789997465.629268:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 402 00000100:00100000:1.0:1789997465.629278:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46795:x1876946704457984:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997465.630026:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46795:x1876946704457984:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 745us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997465.630034:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 402 00000100:00100000:2.0:1789997465.632026:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997465.632203:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704458112 00000100:00100000:3.0:1789997465.632227:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704458112 00000100:00100000:3.0:1789997465.632280:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 769 00000100:00100000:3.0:1789997465.632289:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46795:x1876946704458112:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997465.632752:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46795:x1876946704458112:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 441us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997465.632762:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 769 00000100:00100000:2.0:1789997465.676452:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997465.676530:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704458240 00000100:00100000:0.0:1789997465.676541:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704458240 00000100:00100000:0.0:1789997465.676601:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 770 00000100:00100000:0.0:1789997465.676612:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:46799:x1876946704458240:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997465.676650:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997465.676720:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c9c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec95 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.676784:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.676800:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.676813:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.676828:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.676836:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.676842:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677088:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677097:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677105:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997465.677135:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:0.0:1789997465.677139:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997465.677157:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677169:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677176:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677183:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677189:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997465.677194:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677201:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677214:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997465.677217:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997465.677222:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677229:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592c9d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677242:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677248:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677259:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677264:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997465.677267:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677273:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677281:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997465.677284:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997465.677287:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677293:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592c9d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677324:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592c9c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec95 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677337:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec95 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997465.677345:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:0.0:1789997465.677354:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997465.677357:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ee00, rc 0) 00000100:00100000:0.0:1789997465.677417:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46799:x1876946704458240:12345-192.168.204.4@tcp:101:dd.0 Request processed in 806us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997465.677427:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 770 00000100:00100000:2.0:1789997465.680860:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997465.680953:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704458496 00000100:00100000:3.0:1789997465.680963:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704458496 00000100:00100000:3.0:1789997465.681016:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 771 00000100:00100000:3.0:1789997465.681026:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:46799:x1876946704458496:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:3.0:1789997465.681050:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997465.681067:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c9e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaec9c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.681170:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.681181:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.681190:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.681199:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.681204:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.681211:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997465.682882:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:3.0:1789997465.683083:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c9fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683099:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683110:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c9fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683147:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683155:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683163:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683168:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997465.683173:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683181:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683192:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:3.0:1789997465.683195:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997465.683201:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683208:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592c9ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997465.683221:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4ef1c40 reply state 00000000e8bd8f0c transno 4294967593 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997465.683230:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997465.683262:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592c9e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec9c expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683287:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c9fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec9c expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.683295:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997465.683298:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997465.683300:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997465.683387:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+15:46799:x1876946704458496:12345-192.168.204.4@tcp:101:dd.0 Request processed in 2361us (2534us total) trans 4294967593 rc 0/0 00000100:00100000:3.0:1789997465.683395:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 771 00010000:00010000:3.0:1789997465.685910:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.685927:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.685935:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.685946:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997465.685950:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.685958:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.685972:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997465.685975:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997465.685980:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.685986:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592c9f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997465.688559:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997465.689108:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704458624 00000100:00100000:1.0:1789997465.689119:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704458624 00000100:00100000:1.0:1789997465.689216:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 403 00000100:00100000:1.0:1789997465.689228:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46799:x1876946704458624:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997465.689246:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997465.689268:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeca3 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997465.689296:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789997465.689318:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=1654s v=(0 0) 00010000:00010000:1.0:1789997465.689322:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997465.689332:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.689350:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997465.689364:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997465.689443:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46799:x1876946704458624:12345-192.168.204.4@tcp:101:dd.0 Request processed in 217us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997465.689450:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 403 00000100:00100000:0.0:1789997465.706601:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997465.709524:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704458752 00000100:00100000:2.0:1789997465.709540:0:6662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704458752 00002000:00100000:2.0:1789997465.709605:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x18:0x0] (0->1048575) req@ffff8a37c774c000 x1876946704458752/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:441/0 lens 488/0 e 0 to 0 dl 1789997476 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997465.709626:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c774c000 with x1876946704458752 ext(0->1048575) 00002000:00010000:2.0:1789997465.709633:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c774c000 00000100:00100000:2.0:1789997465.709715:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:2.0:1789997465.709726:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704458752:12345-192.168.204.4@tcp:4:dd.0 00000100:00100000:2.0:1789997465.728671:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704458752:12345-192.168.204.4@tcp:4:dd.0 Request processed in 18910us (22042us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789997465.728690:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00002000:00100000:2.0:1789997465.728707:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x18:0x0] (0->1048575) req@ffff8a37c774c000 x1876946704458752/t4294967344(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:441/0 lens 488/448 e 0 to 0 dl 1789997476 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997465.728722:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c774c000 with x1876946704458752 ext(0->1048575) 00002000:00010000:2.0:1789997465.728730:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c774c000 00000100:00100000:0.0:1789997465.735418:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997465.736018:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704458880 00000100:00100000:1.0:1789997465.736029:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704458880 00000100:00100000:1.0:1789997465.736105:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 772 00000100:00100000:1.0:1789997465.736118:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:46799:x1876946704458880:12345-192.168.204.4@tcp:44:dd.0 00000001:00080000:2.0:1789997465.780279:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967590 is committed 00000001:00080000:2.0:1789997465.780295:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967592 is committed 00000001:00080000:2.0:1789997465.780304:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967593 is committed 00000004:00080000:2.0:1789997465.780309:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 68 committed 00000100:00100000:3.0:1789997465.780426:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46799:x1876946704458880:12345-192.168.204.4@tcp:44:dd.0 Request processed in 44305us (45012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997465.780439:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 772 00000100:00100000:1.0:1789997465.780598:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712961152:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997465.780745:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997465.781005:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712961152 00000100:00100000:3.0:1789997465.781014:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712961152 00000100:00100000:3.0:1789997465.781096:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1789997465.781107:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712961152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789997465.781132:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00010000:00010000:3.0:1789997465.781157:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.781177:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.781192:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789997465.781196:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997465.781201:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.781227:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.781242:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 5 pid: 6658 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997465.781254:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712961280:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997465.781309:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997465.783528:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997465.783819:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704459008 00000100:00100000:2.0:1789997465.783828:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704459008 00000100:00100000:2.0:1789997465.783883:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 405 00000100:00100000:2.0:1789997465.783893:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704459008:12345-192.168.204.4@tcp:16:dd.0 00000100:00100000:3.0:1789997465.786525:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712961280:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997465.786554:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997465.790454:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997465.790494:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704459136 00000100:00100000:2.0:1789997465.790507:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704459136 00010000:00010000:2.0:1789997465.790554:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 6 pid: 6658 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997465.790592:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 357 00000100:00100000:2.0:1789997465.790602:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704459136:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997465.790635:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997465.790642:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 6 pid: 6658 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.790676:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 6 pid: 6658 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.790701:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592c991 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec87 expref: 6 pid: 6658 timeout: 1754 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.790719:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997465.790724:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997465.790730:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.790741:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792142:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792165:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792179:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792190:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792212:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997465.792304:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997465.792312:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792321:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997465.792326:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792336:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792357:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997465.792367:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997465.792369:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997465.792370:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997465.792493:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915dbfe5/0x65b43101d592ca0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997465.792528:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997465.792676:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704459136:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 2052us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997465.792686:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 357 00000100:00100000:3.0:1789997465.794201:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712961152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13091us (13450us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789997465.794213:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000004:00080000:3.0:1789997465.795760:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c774c380/2, rc 0, transno 4294967345 00000100:00100000:3.0:1789997465.795775:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712961152:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789997465.804379:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00000100:00100000:1.0:1789997465.804417:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704459008:12345-192.168.204.4@tcp:16:dd.0 Request processed in 20518us (20892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997465.804429:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 405 00000100:00100000:2.0:1789997465.807138:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997465.807187:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704459392 00000100:00100000:0.0:1789997465.807196:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704459392 00000100:00100000:0.0:1789997465.807260:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:0.0:1789997465.807271:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de234050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46799:x1876946704459392:12345-192.168.204.4@tcp:35:dd.0 00000100:00100000:0.0:1789997465.808057:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de234050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46799:x1876946704459392:12345-192.168.204.4@tcp:35:dd.0 Request processed in 776us (914us total) trans 4294967594 rc 0/0 00000100:00100000:0.0:1789997465.808066:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 81 00000100:00100000:0.0:1789997465.877965:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997465.879075:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704459520 00000100:00100000:2.0:1789997465.879088:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704459520 00000100:00100000:2.0:1789997465.879159:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1018 00000100:00100000:2.0:1789997465.879170:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704459520:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997465.879247:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704459520:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997465.879256:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1018 00000100:00100000:2.0:1789997466.059136:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712961408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997466.059207:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997466.059333:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712961408 00000100:00100000:3.0:1789997466.059343:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712961408 00000100:00080000:0.0:1789997466.059459:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997466.059700:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1789997466.059712:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712961408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997466.059748:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997466.059812:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712961408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997466.059820:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1789997466.059921:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712961408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997466.060212:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712961536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997466.060245:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997466.060469:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712961536 00000100:00100000:2.0:1789997466.060475:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712961536 00000100:00100000:2.0:1789997466.060523:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:2.0:1789997466.060533:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712961536:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997466.060533:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789997466.060548:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789997466.060587:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712961536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997466.060594:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1789997466.060695:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:0.0:1789997466.060701:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38d00f4000, transno 4294967343 00000100:00100000:0.0:1789997466.060717:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712961536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997466.379168:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997466.518644:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967594 is committed 00000004:00080000:3.0:1789997467.260230:0:80310:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1655952573132ns, next at 1653889232661ns, rc = 0 00000004:00080000:3.0:1789997467.260334:0:80310:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1655952679563ns, next at 1654709168236ns, rc = 0 00000004:00080000:2.0:1789997467.263992:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 66 committed 00000004:00080000:1.0:1789997467.266052:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 69 committed 00010000:00010000:3.0:1789997467.403438:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997468.153335:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00000100:00100000:2.0:1789997468.219700:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997468.219736:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704459648 00000100:00100000:1.0:1789997468.219746:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704459648 00000100:00080000:0.0:1789997468.219810:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997468.219817:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 773 00000100:00100000:1.0:1789997468.219831:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46991:x1876946704459648:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997468.219921:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46991:x1876946704459648:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997468.219927:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 773 00000100:00100000:1.0:1789997468.223547:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997468.223615:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704459776 00000100:00100000:0.0:1789997468.223624:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704459776 00000100:00080000:1.0:1789997468.223696:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997468.223715:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 406 00000100:00100000:0.0:1789997468.223727:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46991:x1876946704459776:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997468.224327:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46991:x1876946704459776:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 602us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997468.224336:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 406 00000100:00100000:0.0:1789997468.226012:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997468.226077:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704459904 00000100:00100000:3.0:1789997468.226084:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704459904 00000100:00100000:3.0:1789997468.226145:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 407 00000100:00100000:3.0:1789997468.226154:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46991:x1876946704459904:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:0.0:1789997468.226158:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997468.226449:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46991:x1876946704459904:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 295us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997468.226456:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 407 00000100:00100000:3.0:1789997468.228858:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997468.230008:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704460032 00000100:00100000:0.0:1789997468.230017:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704460032 00000100:00100000:0.0:1789997468.230063:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 774 00000100:00100000:0.0:1789997468.230073:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46991:x1876946704460032:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997468.230506:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46991:x1876946704460032:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 433us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997468.230513:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 774 00000100:00100000:0.0:1789997468.236400:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997468.236462:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704460160 00000100:00100000:3.0:1789997468.236472:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704460160 00000100:00100000:3.0:1789997468.236526:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 775 00000100:00100000:3.0:1789997468.236536:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46991:x1876946704460160:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997468.236643:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46991:x1876946704460160:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 108us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997468.236681:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 775 00000100:00100000:0.0:1789997468.241077:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997468.241174:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704460288 00000100:00100000:3.0:1789997468.241186:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704460288 00000100:00100000:3.0:1789997468.241275:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 408 00000100:00100000:3.0:1789997468.241286:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46991:x1876946704460288:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997468.241814:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:46991:x1876946704460288:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 528us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997468.241822:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 408 00000100:00100000:3.0:1789997468.243642:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997468.243691:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704460416 00000100:00100000:1.0:1789997468.243699:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704460416 00000100:00100000:1.0:1789997468.243748:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 409 00000100:00100000:1.0:1789997468.243759:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46991:x1876946704460416:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997468.244048:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:46991:x1876946704460416:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 291us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997468.244056:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 409 00000100:00100000:1.0:1789997468.246063:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997468.246175:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704460544 00000100:00100000:2.0:1789997468.246181:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704460544 00000100:00100000:2.0:1789997468.246229:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 776 00000100:00100000:2.0:1789997468.246245:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46991:x1876946704460544:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997468.246720:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46991:x1876946704460544:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 477us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997468.246727:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 776 00000100:00100000:2.0:1789997468.281937:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997468.282018:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704460800 00000100:00100000:3.0:1789997468.282033:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704460800 00000100:00100000:3.0:1789997468.282093:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 777 00000100:00100000:3.0:1789997468.282103:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:46995:x1876946704460800:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997468.282152:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997468.282179:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592c9fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec9c expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282197:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997468.282208:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997468.282230:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282244:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282253:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282269:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282276:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282282:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282590:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282599:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.282606:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997468.283507:0:12471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 64 off9728 00000004:00080000:3.0:1789997468.283518:0:12471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1656975864216ns, next at 1657975861556ns, rc = 0 00010000:00010000:3.0:1789997468.283618:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.283630:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.283639:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.283646:0:12471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.283691:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.283697:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.283714:0:12471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997468.283734:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.283741:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997468.283905:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997468.283913:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997468.283920:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997468.283924:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997468.283932:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997468.283943:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:1.0:1789997468.283946:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997468.283950:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997468.283956:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ca2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997468.283967:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997468.283968:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997468.283970:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997468.286285:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286294:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997468.286298:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286305:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286319:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997468.286322:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997468.286325:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286330:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286357:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286362:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286366:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286369:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997468.286371:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286375:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286381:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:3.0:1789997468.286382:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997468.286384:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997468.286387:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997468.286395:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000210586ad reply state 0000000074992f21 transno 4294967595 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997468.286401:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997468.286496:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:46995:x1876946704460800:12345-192.168.204.4@tcp:36:rm.0 Request processed in 4390us (4565us total) trans 4294967595 rc 0/0 00000100:00100000:3.0:1789997468.286506:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 777 00010000:00010000:2.0:1789997468.288047:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997468.288063:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997468.288071:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997468.288076:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997468.288080:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997468.288088:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997468.288100:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38ee49ea00) 00010000:00010000:2.0:1789997468.288103:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997468.288107:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997468.288113:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ca1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997468.428232:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997469.131077:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712961664:0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.131167:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997469.131224:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712961664 00000100:00100000:1.0:1789997469.131232:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712961664 00000100:00100000:3.0:1789997469.131237:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712962176:0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.131266:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997469.131276:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1789997469.131284:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712961664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.131289:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789997469.131296:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712961792:0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.131323:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997469.131343:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712961664:12345-0@lo:400:kworker.0 Request processed in 58us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997469.131347:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712962304:0@lo:400:kworker.0 00000100:00100000:1.0:1789997469.131359:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1789997469.131384:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997469.131423:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712961792 00000100:00100000:3.0:1789997469.131427:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712961664:0@lo:400:kworker.0 00000100:00100000:1.0:1789997469.131429:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712961792 00000100:00100000:3.0:1789997469.131461:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712962304 00000100:00100000:3.0:1789997469.131465:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712962304 00000100:00100000:1.0:1789997469.131486:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1789997469.131496:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712961792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.131506:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1789997469.131515:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712962304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.131569:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712962304:12345-0@lo:400:kworker.0 Request processed in 56us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997469.131576:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00080000:3.0:1789997469.131594:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997469.131809:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712961920:0@lo:400:kworker.0 00000100:00100000:0.0:1789997469.131842:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997469.131867:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997469.131873:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712962048:0@lo:400:kworker.0 00000100:00100000:0.0:1789997469.131893:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997469.131922:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712961920 00000100:00100000:0.0:1789997469.131926:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712961920 00000100:00100000:0.0:1789997469.131958:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1789997469.131964:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712961920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997469.131999:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712961920:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997469.132005:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1789997469.132036:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712961920:0@lo:400:kworker.0 00000100:00100000:0.0:1789997469.132062:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712962176 00000100:00100000:0.0:1789997469.132065:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712962176 00000100:00100000:0.0:1789997469.132090:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712962048 00000100:00100000:0.0:1789997469.132093:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712962048 00000100:00100000:0.0:1789997469.132112:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1789997469.132120:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712962176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997469.132163:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712962176:12345-0@lo:400:kworker.0 Request processed in 44us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997469.132174:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1789997469.132186:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1789997469.132192:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712962048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997469.132231:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712962048:12345-0@lo:400:kworker.0 Request processed in 39us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997469.132237:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1789997469.132263:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712962048:0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.132471:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712961792:0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.132531:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712962304:0@lo:400:kworker.0 00000100:00100000:3.0:1789997469.132541:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:3.0:1789997469.132546:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c774c380, transno 4294967345 00000100:00100000:3.0:1789997469.132750:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712962176:0@lo:400:kworker.0 00000100:00080000:3.0:1789997469.132774:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997469.132834:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997469.132837:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997469.132996:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712961792:12345-0@lo:400:kworker.0 Request processed in 1036us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997469.133005:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00010000:00010000:3.0:1789997469.450762:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789997469.546477:0:80455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1658238820484ns, next at 1657975861556ns, rc = 0 00000004:00080000:3.0:1789997469.578095:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 68 committed 00000001:00080000:3.0:1789997469.578132:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967595 is committed 00000004:00080000:3.0:1789997469.578138:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 67 committed 00000100:00100000:0.0:1789997469.578324:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712962432:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997469.578398:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997469.578745:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712962432 00000100:00100000:2.0:1789997469.578753:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712962432 00000100:00100000:2.0:1789997469.578817:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1789997469.578827:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712962432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789997469.578857:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00010000:00010000:2.0:1789997469.578883:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997469.578908:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997469.578914:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x18:0x0].0x0 since=4s v=(0 0) 00010000:00010000:2.0:1789997469.578917:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997469.578921:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997469.578960:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997469.578971:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 5 pid: 6659 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997469.578979:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712962560:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997469.579031:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789997469.581292:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997469.581472:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712962560:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997469.581488:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704460928 00000100:00100000:0.0:1789997469.581495:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704460928 00010000:00010000:2.0:1789997469.581499:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997469.581582:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 6 pid: 6659 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997469.581691:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 358 00000100:00100000:0.0:1789997469.581701:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704460928:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789997469.581716:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997469.581740:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 6 pid: 6659 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997469.581758:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 6 pid: 6659 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997469.581885:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592ca08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeca3 expref: 6 pid: 6659 timeout: 1758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997469.581907:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997469.581910:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997469.581914:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997469.581921:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997469.581962:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997469.581985:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997469.581995:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997469.582005:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997469.582011:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997469.582036:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997469.582129:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704460928:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 428us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997469.582137:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 358 00010000:00010000:3.0:1789997469.582138:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997469.582144:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997469.582152:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997469.582156:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997469.582165:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997469.582189:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997469.582197:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592ca32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997469.582218:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997469.582220:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997469.582221:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997469.583049:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712962432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4220us (4647us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789997469.583059:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000004:00080000:1.0:1789997469.583310:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c571d500/2, rc 0, transno 4294967345 00000100:00100000:1.0:1789997469.583332:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712962432:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789997469.584015:0:80455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1658276360687ns, next at 1654709168236ns, rc = 0 00000004:00080000:2.0:1789997469.588362:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 70 committed 00010000:00010000:1.0:1789997470.474887:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997470.998851:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997470.998965:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704461056 00000100:00100000:0.0:1789997470.998976:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704461056 00000100:00100000:3.0:1789997470.998998:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997470.999031:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1020 00000100:00100000:3.0:1789997470.999041:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997470.999045:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704461056:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997470.999080:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704461184 00000100:00100000:1.0:1789997470.999086:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704461184 00000100:00100000:3.0:1789997470.999123:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997470.999131:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704461056:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 89us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997470.999143:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1204 00000100:00100000:0.0:1789997470.999143:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1020 00000100:00080000:2.0:1789997470.999152:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997470.999162:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704461184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997470.999178:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704461312 00000100:00100000:2.0:1789997470.999184:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704461312 00000100:00100000:2.0:1789997470.999231:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704461440 00000100:00100000:1.0:1789997470.999235:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704461184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997470.999243:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704461440 00000100:00100000:3.0:1789997470.999247:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 751 00000100:00100000:1.0:1789997470.999247:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1204 00000100:00100000:3.0:1789997470.999264:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704461312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997470.999388:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704461312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 118us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997470.999396:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 751 00000100:00080000:3.0:1789997470.999461:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997470.999784:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 752 00000100:00100000:2.0:1789997470.999794:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704461440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997470.999842:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704461440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 51us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997470.999848:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 752 00000100:00080000:3.0:1789997471.000477:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997471.178874:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997471.178882:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997471.178897:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712962816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997471.178924:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712962688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997471.178978:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997471.179074:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997471.179250:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712962688 00000100:00100000:0.0:1789997471.179258:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712962688 00000100:00100000:3.0:1789997471.179269:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712962816 00000100:00100000:3.0:1789997471.179273:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712962816 00000100:00100000:0.0:1789997471.179357:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1789997471.179366:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712962688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997471.179398:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997471.179443:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712962688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997471.179450:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1789997471.179494:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712962688:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997471.180318:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997471.180323:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997471.180451:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1789997471.180461:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712962816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997471.180489:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997471.180548:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712962816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997471.180554:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:1.0:1789997471.180611:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712962816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789997471.498820:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997472.522888:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997473.281955:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00010000:00010000:1.0:1789997473.547698:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997474.251076:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712963200:0@lo:400:kworker.0 00000100:00100000:3.0:1789997474.251152:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997474.251200:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712962944:0@lo:400:kworker.0 00000100:00100000:1.0:1789997474.251215:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712963328:0@lo:400:kworker.0 00000100:00100000:3.0:1789997474.251225:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789997474.251235:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712963072:0@lo:400:kworker.0 00000100:00100000:2.0:1789997474.251319:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712963200 00000100:00100000:2.0:1789997474.251329:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712963200 00000100:00100000:2.0:1789997474.251402:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1789997474.251412:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712963200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997474.252089:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997474.252134:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712963328 00000100:00100000:1.0:1789997474.252138:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712963328 00000100:00100000:1.0:1789997474.252173:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1789997474.252180:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712963328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997474.252577:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997474.252619:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712963584:0@lo:400:kworker.0 00000100:00100000:1.0:1789997474.252623:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712963328:12345-0@lo:400:kworker.0 Request processed in 441us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997474.252638:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1789997474.252674:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997474.252700:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:1.0:1789997474.252706:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c571d500, transno 4294967345 00000100:00100000:1.0:1789997474.252721:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712963328:0@lo:400:kworker.0 00000100:00080000:3.0:1789997474.252740:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997474.252747:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997474.252750:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712963072 00000100:00100000:1.0:1789997474.252755:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712963072 00000100:00100000:3.0:1789997474.252772:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712963584 00000100:00100000:3.0:1789997474.252778:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712963584 00000100:00100000:1.0:1789997474.252785:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:1.0:1789997474.252793:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712963072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997474.252819:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1789997474.252827:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712963584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997474.252837:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712963072:12345-0@lo:400:kworker.0 Request processed in 45us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997474.252845:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1789997474.252882:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712963584:12345-0@lo:400:kworker.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997474.252888:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00080000:3.0:1789997474.252924:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997474.252938:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997474.252965:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712962944 00000100:00100000:3.0:1789997474.252970:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712962944 00000100:00100000:0.0:1789997474.252986:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712963456:0@lo:400:kworker.0 00000100:00100000:3.0:1789997474.253004:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:3.0:1789997474.253015:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712962944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997474.253023:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997474.253239:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712963072:0@lo:400:kworker.0 00000100:00100000:1.0:1789997474.253249:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712963584:0@lo:400:kworker.0 00000100:00100000:1.0:1789997474.253276:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712963456 00000100:00100000:1.0:1789997474.253280:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712963456 00000100:00100000:1.0:1789997474.253312:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1789997474.253318:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712963456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997474.253567:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712963456:12345-0@lo:400:kworker.0 Request processed in 248us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997474.253574:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:2.0:1789997474.253584:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712963200:12345-0@lo:400:kworker.0 Request processed in 2171us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997474.253593:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00080000:2.0:1789997474.253624:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997474.253699:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712963200:0@lo:400:kworker.0 00000100:00100000:0.0:1789997474.253724:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712963456:0@lo:400:kworker.0 00000100:00100000:3.0:1789997474.254109:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712962944:12345-0@lo:400:kworker.0 Request processed in 1096us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997474.254117:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1789997474.254294:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712962944:0@lo:400:kworker.0 00010000:00010000:3.0:1789997474.570899:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997475.595488:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997476.118156:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997476.118215:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997476.118240:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704461696 00000100:00100000:1.0:1789997476.118251:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704461696 00000100:00100000:0.0:1789997476.118266:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997476.118309:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997476.118334:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1208 00000100:00100000:0.0:1789997476.118341:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704461952 00000100:00100000:1.0:1789997476.118348:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704461696:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997476.118348:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704461952 00000100:00100000:0.0:1789997476.118386:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704461824 00000100:00100000:0.0:1789997476.118390:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704461824 00000100:00100000:3.0:1789997476.118396:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704461568 00000100:00100000:3.0:1789997476.118403:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704461568 00000100:00100000:0.0:1789997476.118438:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 755 00000100:00100000:0.0:1789997476.118450:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704461952:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997476.118457:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704461696:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997476.118458:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1022 00000100:00100000:1.0:1789997476.118472:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1208 00000100:00100000:3.0:1789997476.118474:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704461568:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997476.118491:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704461952:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997476.118499:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 755 00000100:00100000:3.0:1789997476.118511:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704461568:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997476.118519:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 756 00000100:00100000:3.0:1789997476.118522:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1022 00000100:00100000:0.0:1789997476.118532:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704461824:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997476.118562:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704461824:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997476.118570:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 756 00000100:00080000:2.0:1789997476.118711:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997476.118717:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997476.118720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997476.299375:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997476.299398:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712963712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997476.299558:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712963840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997476.299567:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997476.299601:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997476.299821:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712963712 00000100:00100000:3.0:1789997476.299830:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712963712 00000100:00100000:3.0:1789997476.299884:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712963840 00000100:00100000:3.0:1789997476.299888:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712963840 00000100:00100000:3.0:1789997476.299908:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:3.0:1789997476.299918:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712963712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997476.299953:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997476.299976:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997476.299982:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997476.300006:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1789997476.300018:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712963712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997476.300019:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712963840:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997476.300033:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00002000:00000024:2.0:1789997476.300047:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997476.300235:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712963712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997476.301472:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712963840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997476.301585:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712963840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1440us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997476.301594:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00010000:00010000:1.0:1789997476.618878:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997477.643339:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997478.667069:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997479.371037:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997479.371055:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712964096:0@lo:400:kworker.0 00000100:00100000:1.0:1789997479.371055:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712963968:0@lo:400:kworker.0 00000100:00100000:0.0:1789997479.371138:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712964224:0@lo:400:kworker.0 00000100:00100000:2.0:1789997479.371162:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712964480:0@lo:400:kworker.0 00000100:00100000:1.0:1789997479.372055:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997479.372069:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997479.372111:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997479.372114:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712964608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997479.372117:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712964352:0@lo:400:kworker.0 00000100:00100000:3.0:1789997479.372154:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997479.372162:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997479.372171:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712963968 00000100:00100000:0.0:1789997479.372180:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712963968 00000100:00100000:3.0:1789997479.372197:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712964096 00000100:00100000:3.0:1789997479.372202:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712964096 00000100:00100000:1.0:1789997479.372210:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712964352 00000100:00100000:1.0:1789997479.372217:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712964352 00000100:00100000:0.0:1789997479.372229:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:3.0:1789997479.372236:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712964224 00000100:00100000:3.0:1789997479.372241:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712964224 00000100:00100000:0.0:1789997479.372241:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712963968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997479.372273:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712964608 00000100:00100000:3.0:1789997479.372277:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712964608 00000100:00100000:1.0:1789997479.372284:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1789997479.372296:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712964352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997479.372302:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712963968:12345-0@lo:400:kworker.0 Request processed in 63us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997479.372307:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1789997479.372316:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:3.0:1789997479.372320:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712964096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997479.372378:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712964352:12345-0@lo:400:kworker.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997479.372386:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712964096:12345-0@lo:400:kworker.0 Request processed in 68us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997479.372390:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:3.0:1789997479.372398:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1789997479.372415:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1789997479.372420:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712964224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997479.372450:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712964352:0@lo:400:kworker.0 00000100:00100000:1.0:1789997479.372462:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712963968:0@lo:400:kworker.0 00000100:00100000:2.0:1789997479.372474:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997479.372495:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712964480 00000100:00100000:0.0:1789997479.372501:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712964480 00000100:00100000:1.0:1789997479.372516:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1789997479.372527:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712964608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997479.372553:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712964224:12345-0@lo:400:kworker.0 Request processed in 132us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997479.372584:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1789997479.372590:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712964608:12345-0@lo:400:kworker.0 Request processed in 54us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997479.372597:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712964480:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789997479.372600:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997479.372605:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00080000:2.0:1789997479.372607:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997479.372612:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997479.372701:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712964224:0@lo:400:kworker.0 00000100:00100000:2.0:1789997479.372708:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712964608:0@lo:400:kworker.0 00000100:00100000:2.0:1789997479.372724:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712964096:0@lo:400:kworker.0 00000100:00100000:0.0:1789997479.372731:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712964480:12345-0@lo:400:kworker.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997479.372739:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1789997479.372763:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712964480:0@lo:400:kworker.0 00000100:00100000:3.0:1789997479.372811:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00010000:00010000:1.0:1789997479.691980:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997480.715029:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997481.239147:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997481.239197:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997481.239235:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997481.239288:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997481.239390:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704462080 00000100:00100000:0.0:1789997481.239401:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704462080 00000100:00100000:0.0:1789997481.239474:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1024 00000100:00100000:0.0:1789997481.239486:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704462080:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997481.239571:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704462080:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 88us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997481.239579:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1024 00000100:00100000:3.0:1789997481.239981:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704462208 00000100:00100000:3.0:1789997481.239987:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704462208 00000100:00100000:3.0:1789997481.240034:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1212 00000100:00100000:3.0:1789997481.240040:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704462208:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997481.240080:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704462208:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997481.240087:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1212 00000100:00080000:0.0:1789997481.240242:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997481.240443:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704462336 00000100:00100000:2.0:1789997481.240449:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704462336 00000100:00100000:2.0:1789997481.240618:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704462464 00000100:00100000:2.0:1789997481.240622:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704462464 00000100:00080000:0.0:1789997481.240706:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997481.240709:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997481.240800:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 759 00000100:00100000:2.0:1789997481.240810:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704462336:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997481.240848:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704462336:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997481.240855:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 759 00000100:00100000:2.0:1789997481.240868:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 760 00000100:00100000:2.0:1789997481.240875:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704462464:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997481.240898:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704462464:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997481.240903:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 760 00000100:00100000:0.0:1789997481.418870:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712964736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997481.418891:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712964864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997481.419338:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997481.419389:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712964864 00000100:00100000:3.0:1789997481.419399:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712964864 00000100:00100000:0.0:1789997481.419406:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789997481.419451:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997481.419460:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712964736 00000100:00100000:3.0:1789997481.419464:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712964736 00000100:00100000:2.0:1789997481.419474:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1789997481.419485:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712964864:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997481.419492:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997481.419504:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1789997481.419511:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712964736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997481.419523:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00002000:00000024:3.0:1789997481.419529:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997481.419576:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712964864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997481.419578:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712964736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997481.419584:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1789997481.419586:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:2.0:1789997481.419727:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712964864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997481.419753:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712964736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997481.738815:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997482.762935:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997483.786876:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997484.490909:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712964992:0@lo:400:kworker.0 00000100:00100000:3.0:1789997484.491010:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997484.491149:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712964992 00000100:00100000:0.0:1789997484.491160:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712964992 00000100:00100000:3.0:1789997484.491183:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997484.491193:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712965376:0@lo:400:kworker.0 00000100:00100000:0.0:1789997484.491217:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1789997484.491228:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712965248:0@lo:400:kworker.0 00000100:00100000:3.0:1789997484.491234:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997484.491234:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712964992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997484.491289:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997484.491315:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712965120:0@lo:400:kworker.0 00000100:00100000:0.0:1789997484.491323:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712964992:12345-0@lo:400:kworker.0 Request processed in 95us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997484.491332:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1789997484.491354:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997484.491360:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712964992:0@lo:400:kworker.0 00000100:00100000:0.0:1789997484.491396:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712965248 00000100:00100000:0.0:1789997484.491402:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712965248 00000100:00100000:2.0:1789997484.491406:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712965376 00000100:00100000:2.0:1789997484.491412:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712965376 00000100:00100000:3.0:1789997484.491424:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712965120 00000100:00100000:3.0:1789997484.491430:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712965120 00000100:00100000:0.0:1789997484.491447:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1789997484.491456:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1789997484.491461:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712965248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997484.491469:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712965376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997484.491508:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712965248:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997484.491515:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1789997484.491532:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1789997484.491541:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712965120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997484.491572:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712965120:12345-0@lo:400:kworker.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997484.491812:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712965632:0@lo:400:kworker.0 00000100:00100000:1.0:1789997484.491840:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997484.491867:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712965120:0@lo:400:kworker.0 00000100:00100000:1.0:1789997484.491888:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712965632 00000100:00100000:1.0:1789997484.491891:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712965632 00000100:00100000:2.0:1789997484.491977:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712965376:12345-0@lo:400:kworker.0 Request processed in 511us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997484.491984:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1789997484.492133:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712965248:0@lo:400:kworker.0 00000100:00100000:2.0:1789997484.492179:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712965504:0@lo:400:kworker.0 00000100:00100000:2.0:1789997484.492203:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997484.492228:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712965376:0@lo:400:kworker.0 00000100:00100000:2.0:1789997484.492248:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712965504 00000100:00100000:2.0:1789997484.492263:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712965504 00000100:00100000:2.0:1789997484.492289:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1789997484.492296:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712965504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997484.492333:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712965504:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997484.492343:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:2.0:1789997484.492372:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712965504:0@lo:400:kworker.0 00000100:00080000:2.0:1789997484.492398:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997484.492402:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997484.492405:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997484.492514:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1789997484.492736:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:1.0:1789997484.492744:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712965632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997484.492789:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712965632:12345-0@lo:400:kworker.0 Request processed in 47us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997484.492795:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1789997484.493673:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712965632:0@lo:400:kworker.0 00010000:00010000:3.0:1789997484.812640:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997485.201627:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997485.201795:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704462592 00000100:00100000:1.0:1789997485.201806:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704462592 00000100:00100000:1.0:1789997485.201896:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 778 00000100:00100000:1.0:1789997485.201909:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47253:x1876946704462592:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997485.202055:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47253:x1876946704462592:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 149us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997485.202062:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 778 00000100:00080000:2.0:1789997485.202144:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997485.208498:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997485.208625:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704462720 00000100:00100000:2.0:1789997485.208635:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704462720 00000100:00100000:2.0:1789997485.208786:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 411 00000100:00100000:2.0:1789997485.208798:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47253:x1876946704462720:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997485.209192:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47253:x1876946704462720:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 395us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997485.209200:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 411 00000100:00080000:0.0:1789997485.210760:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997485.211360:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997485.213268:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704462848 00000100:00100000:2.0:1789997485.213282:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704462848 00000100:00100000:2.0:1789997485.213431:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 412 00000100:00100000:2.0:1789997485.213441:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47253:x1876946704462848:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997485.213841:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47253:x1876946704462848:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 400us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997485.213850:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 412 00000100:00080000:0.0:1789997485.214516:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997485.216154:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997485.216264:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704462976 00000100:00100000:0.0:1789997485.216272:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704462976 00000100:00100000:0.0:1789997485.216364:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 779 00000100:00100000:0.0:1789997485.216374:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47253:x1876946704462976:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997485.216856:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47253:x1876946704462976:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 482us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997485.216865:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 779 00000100:00100000:1.0:1789997485.219112:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997485.219218:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704463104 00000100:00100000:3.0:1789997485.219227:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704463104 00000100:00100000:3.0:1789997485.219541:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 780 00000100:00100000:3.0:1789997485.219553:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47253:x1876946704463104:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997485.219648:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47253:x1876946704463104:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 98us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997485.219673:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 780 00000100:00100000:1.0:1789997485.221072:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997485.221394:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704463232 00000100:00100000:3.0:1789997485.221401:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704463232 00000100:00100000:3.0:1789997485.221505:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 413 00000100:00100000:3.0:1789997485.221514:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47253:x1876946704463232:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997485.221922:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47253:x1876946704463232:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 408us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997485.221934:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 413 00000100:00100000:0.0:1789997485.223888:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997485.223980:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704463360 00000100:00100000:2.0:1789997485.223989:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704463360 00000100:00100000:2.0:1789997485.224094:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 414 00000100:00100000:2.0:1789997485.224104:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47253:x1876946704463360:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997485.224479:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47253:x1876946704463360:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 375us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997485.224488:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 414 00000100:00100000:1.0:1789997485.227994:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997485.228125:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704463488 00000100:00100000:2.0:1789997485.228134:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704463488 00000100:00100000:2.0:1789997485.228272:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 781 00000100:00100000:2.0:1789997485.228283:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47253:x1876946704463488:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997485.228791:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47253:x1876946704463488:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 498us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997485.228801:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 781 00010000:00010000:1.0:1789997485.834807:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997486.072425:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997486.073025:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704463616 00000100:00100000:3.0:1789997486.073036:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704463616 00000100:00100000:3.0:1789997486.073314:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 782 00000100:00100000:3.0:1789997486.073330:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47267:x1876946704463616:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997486.073468:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997486.073490:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecaa expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.073547:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.073562:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.073575:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997486.073611:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789997486.073616:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997486.073636:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.073680:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecaa expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.073696:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecaa expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.073709:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:3.0:1789997486.073713:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997486.073717:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997486.073778:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47267:x1876946704463616:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 453us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997486.073787:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 782 00000100:00100000:1.0:1789997486.076814:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997486.076895:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704463872 00000100:00100000:3.0:1789997486.076904:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704463872 00000100:00100000:3.0:1789997486.077103:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 783 00000100:00100000:3.0:1789997486.077115:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47267:x1876946704463872:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997486.077158:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997486.077181:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecaa expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.077200:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592c9de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec95 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.077211:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:3.0:1789997486.077313:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997486.077338:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.077350:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.077360:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997486.104970:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967596 is committed 00000004:00010000:1.0:1789997486.105010:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d306d28 reply state 0000000042b7fe61 transno 4294967596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997486.105024:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997486.105039:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00080000:1.0:1789997486.105360:0:5812:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789997486.105383:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47267:x1876946704463872:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 28266us (28570us total) trans 4294967596 rc 0/0 00000100:00100000:1.0:1789997486.105393:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 783 00010000:00010000:3.0:1789997486.105577:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.105589:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.105597:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.105604:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.105609:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.105618:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.105633:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997486.105637:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997486.105642:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.105649:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997486.144642:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997486.144741:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704464000 00000100:00100000:3.0:1789997486.144751:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704464000 00000100:00100000:3.0:1789997486.144807:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 784 00000100:00100000:3.0:1789997486.144817:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47271:x1876946704464000:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997486.144840:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997486.144861:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecb1 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.144920:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.144935:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.144946:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.144959:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.144965:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.144970:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145289:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592ca63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145299:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592ca63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145307:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592ca63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997486.145327:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789997486.145332:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997486.145353:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592ca63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145370:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145377:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145383:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145390:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.145394:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145402:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145414:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:3.0:1789997486.145417:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997486.145422:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145429:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ca55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145441:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145448:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145454:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145465:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.145468:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145473:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145481:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997486.145483:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997486.145486:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145492:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592ca5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145521:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecb1 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145541:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592ca63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecb1 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.145548:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997486.145550:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997486.145553:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ac00, rc 0) 00000100:00100000:3.0:1789997486.145623:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47271:x1876946704464000:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 807us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997486.145630:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 784 00000100:00100000:1.0:1789997486.147619:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997486.147707:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704464256 00000100:00100000:0.0:1789997486.147714:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704464256 00000100:00100000:0.0:1789997486.147750:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 785 00000100:00100000:0.0:1789997486.147759:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47271:x1876946704464256:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:0.0:1789997486.147773:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997486.147786:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592ca6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecb8 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.147973:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.147984:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148002:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148013:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148017:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148021:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997486.148698:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:0.0:1789997486.148880:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592ca7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148888:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148894:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592ca7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148916:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148924:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148928:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148931:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997486.148934:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148939:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148946:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:0.0:1789997486.148947:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997486.148950:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148954:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592ca71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997486.148962:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010b89ceb reply state 00000000e5f41fc6 transno 4294967597 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997486.148967:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997486.148986:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592ca6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecb8 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.148997:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592ca7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecb8 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.149009:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997486.149012:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997486.149014:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660f200, rc 0) 00000100:00100000:0.0:1789997486.149079:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:47271:x1876946704464256:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1321us (1465us total) trans 4294967597 rc 0/0 00000100:00100000:0.0:1789997486.149087:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 785 00010000:00010000:3.0:1789997486.150565:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.150580:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.150588:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.150594:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ec00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.150598:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.150606:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.150619:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38c28e9500) 00010000:00010000:3.0:1789997486.150621:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997486.150626:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.150632:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592ca78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997486.151082:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997486.151124:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704464512 00000100:00100000:2.0:1789997486.151133:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704464512 00000100:00100000:2.0:1789997486.151175:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 786 00000100:00100000:2.0:1789997486.151187:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47271:x1876946704464512:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:2.0:1789997486.151245:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997486.151261:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f200/0x65b43101d592ca7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecb8 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.151273:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997486.151342:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997486.151379:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.151436:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.151447:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997486.151571:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9f96a1c reply state 00000000177caefc transno 4294967598 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997486.151577:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997486.151640:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:47271:x1876946704464512:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 457us (562us total) trans 4294967598 rc 0/0 00000100:00100000:2.0:1789997486.151645:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 786 00010000:00010000:3.0:1789997486.152697:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.152707:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.152715:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.152721:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.152725:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.152732:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.152743:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:3.0:1789997486.152746:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997486.152750:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.152756:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ca8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997486.153341:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997486.153622:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704464640 00000100:00100000:2.0:1789997486.153629:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704464640 00000100:00100000:2.0:1789997486.153866:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 787 00000100:00100000:2.0:1789997486.153876:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47271:x1876946704464640:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997486.153895:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997486.153911:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592ca94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecbf expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.153962:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592ca94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecbf expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.153976:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592ca94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecbf expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.153995:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997486.153998:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997486.154001:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2400, rc 0) 00000100:00100000:2.0:1789997486.154042:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:47271:x1876946704464640:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 168us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997486.154053:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 787 00000100:00100000:0.0:1789997486.156912:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997486.157208:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704464768 00000100:00100000:2.0:1789997486.157228:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704464768 00000100:00100000:2.0:1789997486.157282:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 415 00000100:00100000:2.0:1789997486.157292:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704464768:12345-192.168.204.4@tcp:2:touch.60003 00000100:00100000:2.0:1789997486.157648:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704464768:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 356us (744us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789997486.157687:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 415 00000100:00100000:1.0:1789997486.162094:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997486.162234:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704465024 00000100:00100000:0.0:1789997486.162245:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704465024 00000100:00100000:0.0:1789997486.162301:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:0.0:1789997486.162311:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:47271:x1876946704465024:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:0.0:1789997486.162979:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:47271:x1876946704465024:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 667us (892us total) trans 4294967599 rc 0/0 00000100:00100000:0.0:1789997486.162988:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 82 00000100:00100000:1.0:1789997486.206821:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997486.207024:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704465152 00000100:00100000:3.0:1789997486.207036:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704465152 00000100:00100000:3.0:1789997486.207096:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 788 00000100:00100000:3.0:1789997486.207109:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:47275:x1876946704465152:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:3.0:1789997486.207133:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997486.207154:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecc6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.207415:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.207433:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.207446:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.207603:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.207613:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.207620:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.207954:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208032:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208041:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997486.208077:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x41:0x0]: returning size 0 00000004:00200000:3.0:1789997486.208082:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997486.208101:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208114:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208122:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208129:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208136:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208214:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.208231:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208239:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208252:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997486.208255:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997486.208260:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208267:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592caa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208283:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208289:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208295:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208301:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.208304:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208310:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208322:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997486.208325:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997486.208328:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208334:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592caa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208368:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592ca9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecc6 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208383:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecc6 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.208390:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:3.0:1789997486.208393:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997486.208395:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997486.208699:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:47275:x1876946704465152:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 1591us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997486.208708:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 788 00000100:00100000:1.0:1789997486.211984:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997486.212069:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704465280 00000100:00100000:3.0:1789997486.212078:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704465280 00000100:00100000:3.0:1789997486.212194:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 416 00000100:00100000:3.0:1789997486.212206:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704465280:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:3.0:1789997486.212234:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997486.212254:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeccd expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997486.212284:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x6ab131ae, atime: 0x6ab131ae, ctime: 0x6ab131ae, blocks: 0x1 00010000:00010000:3.0:1789997486.212309:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=1674s v=(0 0) 00010000:00010000:3.0:1789997486.212314:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997486.212322:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.212340:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.212353:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b600, rc 0) 00000100:00100000:3.0:1789997486.212409:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704465280:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 206us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997486.212417:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 416 00000100:00100000:1.0:1789997486.215981:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997486.216195:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704465536 00000100:00100000:3.0:1789997486.216206:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704465536 00000100:00100000:3.0:1789997486.216328:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 789 00000100:00100000:3.0:1789997486.216340:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:47275:x1876946704465536:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997486.216416:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997486.216442:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cab0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecc6 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216464:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592ca94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x41:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecbf expref: 11 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216480:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:3.0:1789997486.216490:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997486.216509:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216522:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216532:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216545:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216552:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216558:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216698:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216708:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.216715:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997486.217351:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 64 off9792 00000004:00080000:3.0:1789997486.217362:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1674909707048ns, next at 1675909704840ns, rc = 0 00010000:00010000:3.0:1789997486.217420:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217431:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217439:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217447:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217455:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217462:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217488:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997486.217509:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217515:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217520:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217526:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.217530:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217537:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217547:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997486.217550:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997486.217552:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997486.217554:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.217562:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217563:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cacc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.217583:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997486.217589:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217590:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217607:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.217609:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217619:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.217626:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997486.217627:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997486.217633:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997486.217634:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.217640:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217645:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.217684:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cad3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217685:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997486.217691:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997486.217695:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.217703:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cabe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.217706:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997486.217709:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997486.217712:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1789997486.217721:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b905baf reply state 00000000bff379ca transno 4294967600 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997486.217730:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997486.217811:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:47275:x1876946704465536:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1471us (1838us total) trans 4294967600 rc 0/0 00000100:00100000:3.0:1789997486.217819:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 789 00010000:00010000:3.0:1789997486.223231:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.223250:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.223258:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.223264:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.223269:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.223277:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.223294:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997486.223297:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997486.223301:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.223307:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cac5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997486.358784:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997486.358817:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704465664 00000100:00100000:1.0:1789997486.358820:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997486.358827:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704465664 00000100:00100000:0.0:1789997486.358880:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1026 00000100:00100000:3.0:1789997486.358881:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704465792 00000100:00100000:3.0:1789997486.358888:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704465792 00000100:00100000:0.0:1789997486.358893:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704465664:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997486.358928:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 763 00000100:00100000:3.0:1789997486.358940:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704465792:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997486.358965:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704465664:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997486.358973:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1026 00000100:00100000:3.0:1789997486.358979:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704465792:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997486.358995:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 763 00000100:00100000:0.0:1789997486.539863:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997486.539887:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712965760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997486.539955:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997486.540576:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712965760 00000100:00100000:1.0:1789997486.540587:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712965760 00000100:00100000:1.0:1789997486.540649:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1789997486.540682:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712965760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997486.540719:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997486.540780:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712965760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997486.540788:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00080000:1.0:1789997486.540812:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997486.540848:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712965760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997486.544936:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712965888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997486.545013:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997486.545116:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712965888 00000100:00100000:0.0:1789997486.545126:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712965888 00000100:00100000:0.0:1789997486.545203:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:0.0:1789997486.545224:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712965888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997486.545263:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997486.545310:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712965888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997486.545317:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00080000:2.0:1789997486.545463:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997486.545506:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712965888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997486.790636:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997486.790758:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704465920 00000100:00100000:3.0:1789997486.790768:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704465920 00000100:00100000:3.0:1789997486.790816:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 790 00000100:00100000:3.0:1789997486.790947:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:47290:x1876946704465920:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997486.791036:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997486.791057:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cada lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecd4 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.791120:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cae1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.791135:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.791150:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997486.791185:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789997486.791190:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997486.791222:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cae1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.791248:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cada lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecd4 expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.791266:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cae1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecd4 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.791274:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997486.791278:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997486.791281:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997486.791733:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:47290:x1876946704465920:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 788us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997486.791741:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 790 00000100:00100000:0.0:1789997486.796267:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997486.796424:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704466176 00000100:00100000:1.0:1789997486.796435:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704466176 00000100:00100000:1.0:1789997486.796497:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 791 00000100:00100000:1.0:1789997486.796509:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:47290:x1876946704466176:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997486.796558:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997486.796585:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cae1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecd4 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.796607:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592ca63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecb1 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.796619:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:1.0:1789997486.796630:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997486.796684:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.796697:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.796707:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997486.828323:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967599 is committed 00000004:00010000:1.0:1789997486.828335:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5001609 reply state 00000000f1164e90 transno 4294967601 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997486.828342:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967601 is committed 00000100:00100000:1.0:1789997486.828348:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00080000:0.0:1789997486.828354:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 71 committed 00000004:00200000:1.0:1789997486.828362:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00080000:1.0:1789997486.828459:0:12471:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789997486.828478:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47290:x1876946704466176:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 31969us (32213us total) trans 4294967601 rc 0/0 00000100:00100000:1.0:1789997486.828488:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 791 00010000:00010000:3.0:1789997486.828504:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.828515:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.828523:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.828530:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997486.828535:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.828543:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997486.828580:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712966016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997486.828823:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789997486.828839:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:3.0:1789997486.828846:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997486.828852:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997486.828859:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cae8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997486.828878:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712966016 00000100:00100000:0.0:1789997486.828886:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712966016 00000100:00100000:0.0:1789997486.828928:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:0.0:1789997486.828936:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712966016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789997486.828959:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:25 count 1 00010000:00010000:0.0:1789997486.828981:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.828999:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.829008:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789997486.829013:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997486.829018:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.829051:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.829066:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 6 pid: 6656 timeout: 1775 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997486.829080:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1876946712966144:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997486.829176:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997486.830889:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1876946712966144:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997486.830913:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997486.831271:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997486.831459:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704466304 00000100:00100000:1.0:1789997486.831465:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704466304 00010000:00010000:1.0:1789997486.831490:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 7 pid: 6656 timeout: 1775 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997486.831518:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 359 00000100:00100000:1.0:1789997486.831527:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704466304:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997486.831541:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997486.831547:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 7 pid: 6656 timeout: 1775 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.831565:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 7 pid: 6656 timeout: 1775 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.831588:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000505ae5cf/0x65b43101d592cab7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeccd expref: 7 pid: 6656 timeout: 1775 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.831607:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997486.831611:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997486.831617:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.831627:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.831682:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997486.831730:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704466304:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 203us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997486.831737:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 359 00010000:00010000:2.0:1789997486.831957:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.831968:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.832048:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.832056:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.832145:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997486.832165:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997486.832172:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.832181:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997486.832185:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.832194:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.832218:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.832232:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade01279/0x65b43101d592caef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997486.832249:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997486.832251:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997486.832252:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997486.832957:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712966016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4019us (4132us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789997486.832967:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000004:00080000:0.0:1789997486.833566:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3b8a80/2, rc 0, transno 4294967347 00000100:00100000:0.0:1789997486.833576:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712966016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997486.858591:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997486.858755:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704466432 00000100:00100000:2.0:1789997486.858766:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704466432 00000100:00100000:2.0:1789997486.858820:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 792 00000100:00100000:2.0:1789997486.858830:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47294:x1876946704466432:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997486.858856:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997486.858877:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592caf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecdb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.858938:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.858954:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.858963:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.858983:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.858990:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.858996:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997486.859116:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997486.859411:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859422:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859429:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997486.859450:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789997486.859454:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997486.859473:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859496:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859503:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859510:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859528:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997486.859536:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859543:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859555:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:2.0:1789997486.859558:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997486.859563:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859570:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cafd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859581:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859587:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859592:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859597:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997486.859599:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859605:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859616:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997486.859618:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997486.859621:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859627:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859688:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592caf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecdb expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859703:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecdb expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997486.859711:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997486.859712:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997486.859714:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997486.859772:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47294:x1876946704466432:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 943us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997486.859780:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 792 00000100:00100000:2.0:1789997487.397008:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997487.397043:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704466560 00000100:00100000:2.0:1789997487.397052:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704466560 00000100:00100000:2.0:1789997487.397113:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 793 00000100:00100000:2.0:1789997487.397124:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47308:x1876946704466560:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997487.397145:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997487.397164:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaece2 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.397244:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592cb19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.397260:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.397274:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997487.397310:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789997487.397314:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997487.397332:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.397356:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaece2 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.397372:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaece2 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.397379:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997487.397381:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997487.397385:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997487.397571:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47308:x1876946704466560:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 448us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997487.397579:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 793 00000100:00080000:2.0:1789997487.397601:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997487.401632:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.401720:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704466816 00000100:00100000:3.0:1789997487.401731:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704466816 00000100:00100000:3.0:1789997487.401781:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 794 00000100:00100000:3.0:1789997487.401793:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47308:x1876946704466816:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997487.401852:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997487.401881:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592cb19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaece2 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.401903:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecdb expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.401914:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997487.401924:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997487.401949:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.401962:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.401973:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997487.402580:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000626c3593 reply state 00000000726a90f7 transno 4294967602 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997487.402592:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997487.402601:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000100:00100000:3.0:1789997487.402863:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47308:x1876946704466816:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 1071us (1239us total) trans 4294967602 rc 0/0 00000100:00100000:3.0:1789997487.402880:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 794 00010000:00010000:2.0:1789997487.405462:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.405478:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.405486:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.405492:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997487.405497:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.405505:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.405521:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:2.0:1789997487.405524:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997487.405529:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.405535:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cb20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997487.475640:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997487.477757:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704466944 00000100:00100000:1.0:1789997487.477772:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704466944 00000100:00100000:1.0:1789997487.477835:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 795 00000100:00100000:1.0:1789997487.477849:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47320:x1876946704466944:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997487.478013:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47320:x1876946704466944:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 168us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997487.478022:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 795 00000100:00100000:3.0:1789997487.481800:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.481851:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704467072 00000100:00100000:3.0:1789997487.481861:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704467072 00000100:00100000:3.0:1789997487.481928:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 418 00000100:00100000:3.0:1789997487.481940:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47320:x1876946704467072:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:1.0:1789997487.482939:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997487.483268:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47320:x1876946704467072:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1322us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997487.483280:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 418 00000100:00100000:2.0:1789997487.487279:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.487396:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704467200 00000100:00100000:3.0:1789997487.487407:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704467200 00000100:00080000:1.0:1789997487.487462:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997487.487486:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 419 00000100:00100000:3.0:1789997487.487497:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47320:x1876946704467200:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997487.487909:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47320:x1876946704467200:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 413us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997487.487917:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 419 00000100:00100000:3.0:1789997487.490236:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997487.490331:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704467328 00000100:00100000:1.0:1789997487.490339:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704467328 00000100:00100000:1.0:1789997487.490734:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 796 00000100:00100000:1.0:1789997487.490744:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47320:x1876946704467328:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997487.491696:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47320:x1876946704467328:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 951us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997487.491706:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 796 00000100:00100000:1.0:1789997487.494808:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.495148:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704467456 00000100:00100000:3.0:1789997487.495158:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704467456 00000100:00100000:3.0:1789997487.495223:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 797 00000100:00100000:3.0:1789997487.495233:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47320:x1876946704467456:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997487.495329:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47320:x1876946704467456:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 97us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997487.495336:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 797 00000100:00100000:0.0:1789997487.497001:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997487.497134:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704467584 00000100:00100000:1.0:1789997487.497141:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704467584 00000100:00100000:1.0:1789997487.497187:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 420 00000100:00100000:1.0:1789997487.497208:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47320:x1876946704467584:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997487.497594:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47320:x1876946704467584:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 388us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997487.497602:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 420 00000100:00100000:1.0:1789997487.499982:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997487.500022:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704467712 00000100:00100000:1.0:1789997487.500031:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704467712 00000100:00100000:1.0:1789997487.500083:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 421 00000100:00100000:1.0:1789997487.500094:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47320:x1876946704467712:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997487.500526:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47320:x1876946704467712:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 434us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997487.500534:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 421 00000100:00100000:0.0:1789997487.503552:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997487.503713:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704467840 00000100:00100000:2.0:1789997487.503723:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704467840 00000100:00100000:2.0:1789997487.503776:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 798 00000100:00100000:2.0:1789997487.503788:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47320:x1876946704467840:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997487.504309:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47320:x1876946704467840:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 521us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997487.504318:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 798 00000100:00100000:1.0:1789997487.545904:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.546244:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704467968 00000100:00100000:3.0:1789997487.546257:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704467968 00000100:00100000:3.0:1789997487.546322:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 799 00000100:00100000:3.0:1789997487.546337:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47324:x1876946704467968:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997487.546526:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997487.546559:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cb27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaece9 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.546648:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.546701:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.546713:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.546732:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.546739:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.546747:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547106:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cb3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547116:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547123:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997487.547144:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:3.0:1789997487.547148:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997487.547167:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cb3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547178:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547185:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547203:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547209:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997487.547213:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547220:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547231:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:3.0:1789997487.547234:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997487.547239:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547249:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547263:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547269:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547275:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547280:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997487.547283:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547289:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547296:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997487.547299:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997487.547301:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547307:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cb35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547337:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cb27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaece9 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.547356:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaece9 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.548231:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997487.548235:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997487.548238:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ba00, rc 0) 00000100:00100000:3.0:1789997487.548412:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47324:x1876946704467968:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 2075us (2519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997487.548424:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 799 00000100:00100000:0.0:1789997487.554297:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.554408:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704468224 00000100:00100000:3.0:1789997487.554419:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704468224 00000100:00100000:3.0:1789997487.554482:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 800 00000100:00100000:3.0:1789997487.554491:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47324:x1876946704468224:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997487.554514:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997487.554535:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cb43 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecf0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.555082:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.555098:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.555110:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.555205:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.555214:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.555221:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997487.556874:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:2.0:1789997487.557292:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557308:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557319:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557358:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557370:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557378:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557384:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997487.557388:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557395:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557407:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:2.0:1789997487.557411:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997487.557416:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557421:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cb4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997487.557434:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4ce635a reply state 00000000194f5326 transno 4294967603 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997487.557443:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997487.557478:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592cb43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf0 expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557494:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf0 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997487.557506:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997487.557508:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997487.557511:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997487.557697:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:47324:x1876946704468224:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 3205us (3409us total) trans 4294967603 rc 0/0 00000100:00100000:2.0:1789997487.557707:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 800 00010000:00010000:3.0:1789997487.559233:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.559249:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.559256:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.559262:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997487.559268:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.559276:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.559287:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38d0bdf000) 00010000:00010000:3.0:1789997487.559289:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997487.559293:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.559297:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cb51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997487.562579:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.563372:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704468352 00000100:00100000:3.0:1789997487.563384:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704468352 00000100:00100000:3.0:1789997487.563474:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 422 00000100:00100000:3.0:1789997487.563486:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47324:x1876946704468352:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997487.563505:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997487.563526:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecf7 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997487.563558:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789997487.563580:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=1676s v=(0 0) 00010000:00010000:3.0:1789997487.563585:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997487.563595:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 6 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.563614:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 6 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997487.563627:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:1.0:1789997487.564988:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47324:x1876946704468352:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 1496us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997487.564999:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 422 00000100:00100000:1.0:1789997487.589165:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.589270:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704468480 00000100:00100000:3.0:1789997487.589281:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704468480 00002000:00100000:3.0:1789997487.589335:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8a37c571c700 x1876946704468480/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:463/0 lens 488/0 e 0 to 0 dl 1789997498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1789997487.589347:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c571c700 with x1876946704468480 ext(0->1048575) 00002000:00010000:3.0:1789997487.589354:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c571c700 00000100:00100000:3.0:1789997487.589387:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:3.0:1789997487.589397:0:6663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704468480:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:2.0:1789997487.607058:0:6663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704468480:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 17651us (17890us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789997487.607072:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00002000:00100000:2.0:1789997487.607085:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x19:0x0] (0->1048575) req@ffff8a37c571c700 x1876946704468480/t4294967346(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:463/0 lens 488/448 e 0 to 0 dl 1789997498 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789997487.607096:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c571c700 with x1876946704468480 ext(0->1048575) 00002000:00010000:2.0:1789997487.607102:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c571c700 00000100:00100000:1.0:1789997487.611636:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997487.611961:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704468608 00000100:00100000:3.0:1789997487.611970:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704468608 00000100:00100000:3.0:1789997487.612025:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 801 00000100:00100000:3.0:1789997487.612035:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:47324:x1876946704468608:12345-192.168.204.4@tcp:44:dd.60003 00000001:00080000:1.0:1789997487.630714:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967603 is committed 00000100:00100000:3.0:1789997487.631008:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47324:x1876946704468608:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 18968us (19375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997487.631019:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 801 00000100:00100000:0.0:1789997487.634874:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997487.635047:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704468736 00000100:00100000:1.0:1789997487.635058:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704468736 00000100:00100000:1.0:1789997487.635146:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 423 00000100:00100000:1.0:1789997487.635154:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704468736:12345-192.168.204.4@tcp:16:dd.60003 00000100:00100000:1.0:1789997487.651965:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704468736:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 16799us (17087us total) trans 0 rc 0/0 00000001:00080000:0.0:1789997487.651978:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000100:00100000:1.0:1789997487.651984:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 423 00000100:00100000:0.0:1789997487.654565:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997487.654708:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704468992 00000100:00100000:1.0:1789997487.654719:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704468992 00000100:00100000:1.0:1789997487.654768:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 83 00000100:00100000:1.0:1789997487.654778:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47324:x1876946704468992:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:1.0:1789997487.655215:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47324:x1876946704468992:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 437us (656us total) trans 4294967604 rc 0/0 00000100:00100000:1.0:1789997487.655226:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 83 00010000:00010000:1.0:1789997487.883031:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997488.346090:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967604 is committed 00000001:00080000:0.0:1789997488.614764:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00000001:00080000:0.0:1789997488.614778:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00010000:00010000:1.0:1789997488.907573:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997489.014287:0:80917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1677706629963ns, next at 1657975861556ns, rc = 0 00000004:00080000:0.0:1789997489.014446:0:80917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1677706791310ns, next at 1675909704840ns, rc = 0 00000004:00080000:2.0:1789997489.018875:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 72 committed 00000004:00080000:2.0:1789997489.018907:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 69 committed 00000100:00100000:2.0:1789997489.612913:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712966272:0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.612949:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712966656:0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.613032:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997489.613089:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997489.613096:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712966528:0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.613133:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997489.613182:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712966656 00000100:00100000:3.0:1789997489.613190:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712966656 00000100:00100000:2.0:1789997489.613209:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997489.613244:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712966784:0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.613265:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1789997489.613272:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997489.613278:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712966656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997489.613292:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789997489.613300:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712966400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997489.613322:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997489.613343:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712966912:0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.613368:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712966656:12345-0@lo:400:kworker.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997489.613375:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997489.613382:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1789997489.613409:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712966784 00000100:00100000:3.0:1789997489.613412:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712966784 00000100:00100000:3.0:1789997489.613884:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1789997489.613904:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712966784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.613968:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712966784:12345-0@lo:400:kworker.0 Request processed in 77us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997489.613975:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1789997489.613994:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712966528 00000100:00100000:3.0:1789997489.613998:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712966528 00000100:00100000:3.0:1789997489.614025:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712966400 00000100:00100000:3.0:1789997489.614028:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712966400 00000100:00100000:3.0:1789997489.614043:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712966912 00000100:00100000:3.0:1789997489.614046:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712966912 00000100:00100000:3.0:1789997489.614064:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1789997489.614071:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712966528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997489.614189:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1789997489.614195:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3b8a80, transno 4294967347 00000100:00100000:2.0:1789997489.614214:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712966784:0@lo:400:kworker.0 00000100:00080000:1.0:1789997489.614313:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997489.614320:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997489.614323:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997489.614337:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1789997489.614347:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712966400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.614639:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712966528:12345-0@lo:400:kworker.0 Request processed in 567us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997489.615389:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712966400:12345-0@lo:400:kworker.0 Request processed in 305us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997489.615392:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1789997489.615404:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1789997489.615425:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1789997489.615428:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712966400:0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.615438:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712966912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997489.615491:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712966912:12345-0@lo:400:kworker.0 Request processed in 57us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997489.615501:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1789997489.615510:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712966272 00000100:00100000:1.0:1789997489.615516:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712966272 00000100:00100000:2.0:1789997489.616134:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712966912:0@lo:400:kworker.0 00000100:00100000:1.0:1789997489.616480:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1789997489.616488:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712966272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997489.616547:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712966272:12345-0@lo:400:kworker.0 Request processed in 60us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997489.616553:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1789997489.616602:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712966528:0@lo:400:kworker.0 00000100:00100000:1.0:1789997489.616615:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712966656:0@lo:400:kworker.0 00000100:00100000:2.0:1789997489.616759:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712966272:0@lo:400:kworker.0 00000100:00100000:2.0:1789997489.925215:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997489.926079:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704469120 00000100:00100000:1.0:1789997489.926093:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704469120 00000100:00100000:1.0:1789997489.926179:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 802 00000100:00100000:1.0:1789997489.926191:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47516:x1876946704469120:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997489.926305:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47516:x1876946704469120:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 116us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997489.926314:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 802 00000100:00080000:2.0:1789997489.927463:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997489.931548:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997489.931624:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704469248 00000100:00100000:3.0:1789997489.931636:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704469248 00000100:00100000:3.0:1789997489.931727:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 424 00000100:00100000:3.0:1789997489.931739:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47516:x1876946704469248:12345-192.168.204.4@tcp:19:lfs.60003 00010000:00010000:0.0:1789997489.931952:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997489.932155:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47516:x1876946704469248:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 407us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997489.932163:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 424 00000100:00080000:1.0:1789997489.932238:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997489.935486:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997489.935559:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704469376 00000100:00100000:3.0:1789997489.935571:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704469376 00000100:00080000:1.0:1789997489.935622:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997489.935648:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 425 00000100:00100000:3.0:1789997489.935676:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47516:x1876946704469376:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997489.936041:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47516:x1876946704469376:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 367us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997489.936048:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 425 00000100:00100000:0.0:1789997489.938234:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997489.938320:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704469504 00000100:00100000:1.0:1789997489.938329:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704469504 00000100:00100000:1.0:1789997489.938478:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 803 00000100:00100000:1.0:1789997489.938491:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47516:x1876946704469504:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997489.939494:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47516:x1876946704469504:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 1003us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997489.939503:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 803 00000100:00100000:1.0:1789997489.948336:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997489.948383:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704469632 00000100:00100000:1.0:1789997489.948392:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704469632 00000100:00100000:1.0:1789997489.948450:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 804 00000100:00100000:1.0:1789997489.948463:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47516:x1876946704469632:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997489.948786:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47516:x1876946704469632:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 325us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997489.948794:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 804 00000100:00100000:2.0:1789997489.952520:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997489.952771:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704469760 00000100:00100000:3.0:1789997489.952782:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704469760 00000100:00100000:3.0:1789997489.952835:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 426 00000100:00100000:3.0:1789997489.952846:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47516:x1876946704469760:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997489.953270:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:47516:x1876946704469760:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 424us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997489.953279:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 426 00000100:00100000:0.0:1789997489.957837:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997489.957875:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704469888 00000100:00100000:0.0:1789997489.957884:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704469888 00000100:00100000:0.0:1789997489.957932:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 427 00000100:00100000:0.0:1789997489.957943:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47516:x1876946704469888:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997489.958480:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47516:x1876946704469888:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 536us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997489.958489:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 427 00000100:00100000:2.0:1789997489.961132:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997489.961438:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704470016 00000100:00100000:0.0:1789997489.961448:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704470016 00000100:00100000:0.0:1789997489.961509:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 805 00000100:00100000:0.0:1789997489.961520:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47516:x1876946704470016:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997489.962156:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47516:x1876946704470016:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 625us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997489.962165:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 805 00000100:00100000:3.0:1789997490.009755:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997490.009848:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704470272 00000100:00100000:2.0:1789997490.009859:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704470272 00000100:00100000:2.0:1789997490.009938:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 806 00000100:00100000:2.0:1789997490.010456:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47521:x1876946704470272:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:2.0:1789997490.010511:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997490.010538:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592cb58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf0 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.010558:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997490.010570:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997490.010592:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.010606:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.010621:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.010637:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.010644:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.010693:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.011010:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.011020:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.011027:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997490.011927:0:12471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].25, 64 off9792 00000004:00080000:2.0:1789997490.011938:0:12471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1678704283323ns, next at 1679704281026ns, rc = 0 00010000:00010000:2.0:1789997490.012027:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012039:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012048:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012060:0:12471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012067:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012074:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012104:0:12471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997490.012126:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012133:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012139:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012158:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997490.012163:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012170:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012180:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997490.012183:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997490.012188:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012198:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb7b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012214:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012221:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012226:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012232:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997490.012235:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012241:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012247:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:2.0:1789997490.012250:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997490.012252:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997490.012258:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997490.012267:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000251a35e3 reply state 00000000ea2cc960 transno 4294967605 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997490.012275:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997490.012362:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47521:x1876946704470272:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1911us (2616us total) trans 4294967605 rc 0/0 00000100:00100000:2.0:1789997490.012371:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 806 00010000:00010000:1.0:1789997490.013041:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997490.013049:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997490.013057:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997490.013060:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997490.013068:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997490.013080:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:1.0:1789997490.013083:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997490.013086:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997490.013092:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cb82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997490.013108:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997490.013110:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997490.013112:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997490.014997:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997490.015031:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997490.015040:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997490.015046:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997490.015051:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997490.015059:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997490.015073:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0xf9c7deb2 (ffff8a38d0bdf000) 00010000:00010000:3.0:1789997490.015077:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997490.015082:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997490.015089:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cb74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997490.955760:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997491.383057:0:81063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1680075400294ns, next at 1679704281026ns, rc = 0 00000004:00080000:1.0:1789997491.408630:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 71 committed 00000001:00080000:1.0:1789997491.408696:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967605 is committed 00000004:00080000:1.0:1789997491.408700:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 70 committed 00000100:00100000:2.0:1789997491.408898:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712967040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789997491.408965:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997491.409080:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712967040 00000100:00100000:3.0:1789997491.409089:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712967040 00000100:00100000:3.0:1789997491.409169:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00080000:1.0:1789997491.409268:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997491.409421:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712967040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789997491.409449:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:25 count 1 00010000:00010000:3.0:1789997491.409473:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997491.409500:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 5 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997491.409509:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x19:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1789997491.409513:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997491.409518:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997491.409546:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 5 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997491.409560:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 5 pid: 8169 timeout: 1780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997491.409572:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712967168:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997491.409925:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa55a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789997491.414295:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997491.414376:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704470400 00000100:00100000:1.0:1789997491.414384:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704470400 00010000:00010000:1.0:1789997491.414441:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 6 pid: 8169 timeout: 1780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997491.414483:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 360 00000100:00100000:1.0:1789997491.414492:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704470400:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997491.414506:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997491.414512:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 6 pid: 8169 timeout: 1780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997491.414526:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 6 pid: 8169 timeout: 1780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997491.414551:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997491.414556:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997491.414562:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997491.414572:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997491.414596:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997491.414644:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704470400:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 152us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997491.414698:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 360 00000100:00080000:2.0:1789997491.414773:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997491.414890:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb59f214/0x65b43101d592cb66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecf7 expref: 5 pid: 8169 timeout: 1780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997491.414906:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712967168:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997491.414928:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997491.414940:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997491.414952:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997491.414963:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997491.414971:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997491.414994:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997491.415055:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997491.415062:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997491.415077:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997491.415081:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997491.415091:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997491.415103:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997491.415111:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592cb89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997491.416147:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712967040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6967us (7180us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789997491.416158:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00010000:00010000:1.0:1789997491.416227:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997491.416229:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997491.416231:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997491.417108:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38f9fdf100/2, rc 0, transno 4294967347 00000100:00100000:3.0:1789997491.417136:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712967040:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789997491.417338:0:81063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1680109683584ns, next at 1675909704840ns, rc = 0 00000004:00080000:1.0:1789997491.419598:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 73 committed 00000100:00100000:2.0:1789997491.482592:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997491.482630:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997491.484861:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704470528 00000100:00100000:1.0:1789997491.484878:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704470528 00000100:00100000:1.0:1789997491.484944:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1028 00000100:00100000:1.0:1789997491.484956:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704470528:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997491.485037:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704470528:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 83us (2453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997491.485045:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1028 00000100:00100000:2.0:1789997491.485671:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997491.485779:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704470656 00000100:00100000:1.0:1789997491.485785:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704470656 00000100:00100000:3.0:1789997491.485830:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704470784 00000100:00100000:3.0:1789997491.485836:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704470784 00000100:00100000:1.0:1789997491.485842:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1219 00000100:00100000:1.0:1789997491.485852:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704470656:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997491.485877:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 766 00000100:00100000:3.0:1789997491.485887:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704470784:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997491.485901:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704470656:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997491.485908:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1219 00000100:00100000:3.0:1789997491.485923:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704470784:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997491.485932:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 766 00000100:00080000:2.0:1789997491.486003:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997491.486007:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997491.658963:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712967296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997491.659072:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997491.659164:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712967296 00000100:00100000:3.0:1789997491.659172:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712967296 00000100:00100000:3.0:1789997491.659248:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1789997491.659259:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712967296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997491.659302:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997491.659334:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997491.659350:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712967296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997491.659389:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712967296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997491.659485:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997491.659496:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712967424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997491.659514:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1789997491.659529:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997491.659563:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712967424 00000100:00100000:3.0:1789997491.659567:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712967424 00000100:00100000:3.0:1789997491.659601:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1789997491.659608:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb2a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712967424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997491.659628:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997491.659685:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb2a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712967424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997491.659692:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1789997491.659743:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712967424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997491.979180:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997493.003524:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997494.026932:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997494.733395:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712967680:0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.733465:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997494.733521:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712968192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.733540:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997494.733561:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997494.733566:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712967808:0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.733587:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997494.733622:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712967680 00000100:00100000:3.0:1789997494.733631:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712967680 00000100:00100000:3.0:1789997494.733691:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712968192 00000100:00100000:3.0:1789997494.733694:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712968192 00000100:00100000:3.0:1789997494.733734:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712967808 00000100:00100000:3.0:1789997494.733737:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712967808 00000100:00100000:3.0:1789997494.733758:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1789997494.733765:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712967680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.733817:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712967680:12345-0@lo:400:kworker.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997494.733824:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1789997494.733843:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:3.0:1789997494.733849:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712968192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.733875:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712968192:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997494.733882:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:3.0:1789997494.733895:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1789997494.733903:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712967808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.733942:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712967808:12345-0@lo:400:kworker.0 Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997494.733961:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00080000:3.0:1789997494.733978:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997494.734005:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712967808:0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.734014:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712967680:0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.734023:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712968192:0@lo:400:kworker.0 00000100:00100000:2.0:1789997494.734133:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712967552:0@lo:400:kworker.0 00000100:00100000:2.0:1789997494.734168:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997494.734200:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712968064:0@lo:400:kworker.0 00000100:00100000:2.0:1789997494.734224:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997494.734242:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997494.734248:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712967936:0@lo:400:kworker.0 00000100:00100000:2.0:1789997494.734266:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997494.734292:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712968064 00000100:00100000:2.0:1789997494.734296:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712968064 00000100:00100000:2.0:1789997494.734326:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712967936 00000100:00100000:2.0:1789997494.734328:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712967936 00000100:00100000:2.0:1789997494.734346:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1789997494.734352:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712968064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997494.734386:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712968064:12345-0@lo:400:kworker.0 Request processed in 35us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997494.734392:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1789997494.734404:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1789997494.734410:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712967936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997494.734451:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712967936:12345-0@lo:400:kworker.0 Request processed in 42us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997494.734457:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00080000:2.0:1789997494.734476:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997494.734478:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997494.734500:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712967936:0@lo:400:kworker.0 00000100:00100000:2.0:1789997494.734509:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712968064:0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.735064:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712967552 00000100:00100000:3.0:1789997494.735070:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712967552 00000100:00100000:3.0:1789997494.735241:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1789997494.735250:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712967552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997494.735610:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712967552:0@lo:400:kworker.0 00000100:00100000:3.0:1789997494.735827:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712967552:12345-0@lo:400:kworker.0 Request processed in 361us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997494.735914:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00010000:00010000:1.0:1789997495.051217:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997495.299914:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00010000:00010000:1.0:1789997496.075154:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997496.602102:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997496.602139:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997496.602168:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997496.602213:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997496.602297:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704471168 00000100:00100000:2.0:1789997496.602307:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704471168 00000100:00100000:2.0:1789997496.602372:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 769 00000100:00100000:2.0:1789997496.602381:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704471168:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997496.602448:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704471168:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997496.602455:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 769 00000100:00100000:2.0:1789997496.602472:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704471296 00000100:00100000:2.0:1789997496.602474:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704471296 00000100:00100000:2.0:1789997496.602493:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 770 00000100:00100000:2.0:1789997496.602499:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704471296:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997496.602520:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704471296:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 22us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997496.602526:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 770 00000100:00100000:0.0:1789997496.602695:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704471040 00000100:00100000:0.0:1789997496.602699:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704471040 00000100:00100000:0.0:1789997496.602733:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1223 00000100:00100000:0.0:1789997496.602740:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704471040:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997496.602773:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704471040:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997496.602779:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1223 00000100:00100000:3.0:1789997496.602947:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704470912 00000100:00100000:3.0:1789997496.602951:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704470912 00000100:00100000:3.0:1789997496.602986:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1030 00000100:00100000:3.0:1789997496.602993:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704470912:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997496.603038:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704470912:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997496.603044:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1030 00000100:00080000:1.0:1789997496.603152:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997496.603157:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997496.603159:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997496.778965:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997496.778986:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712968320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997496.779065:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997496.779140:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712968320 00000100:00100000:1.0:1789997496.779148:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712968320 00000100:00100000:1.0:1789997496.779213:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1789997496.779223:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712968320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997496.779255:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997496.779299:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712968320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997496.779310:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00080000:1.0:1789997496.779336:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997496.779571:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712968448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997496.779602:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997496.779627:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:1.0:1789997496.779632:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38f9fdf100, transno 4294967347 00000100:00100000:1.0:1789997496.779673:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712968320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997496.779972:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712968448 00000100:00100000:3.0:1789997496.779976:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712968448 00000100:00100000:3.0:1789997496.780031:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1789997496.780039:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712968448:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997496.780059:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789997496.780063:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997496.780107:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712968448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997496.780115:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1789997496.780248:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712968448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997497.099095:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997498.122965:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997499.147176:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997499.851293:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712968576:0@lo:400:kworker.0 00000100:00100000:2.0:1789997499.851379:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997499.851796:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712968576 00000100:00100000:1.0:1789997499.851806:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712968576 00000100:00100000:1.0:1789997499.851862:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1789997499.851873:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712968576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997499.851929:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712968704:0@lo:400:kworker.0 00000100:00100000:1.0:1789997499.851977:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712968576:12345-0@lo:400:kworker.0 Request processed in 103us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997499.851986:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712969088:0@lo:400:kworker.0 00000100:00100000:1.0:1789997499.851991:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1789997499.851992:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997499.852006:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712968832:0@lo:400:kworker.0 00000100:00100000:2.0:1789997499.852041:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997499.852044:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712969216:0@lo:400:kworker.0 00000100:00100000:1.0:1789997499.852047:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712968704 00000100:00100000:1.0:1789997499.852053:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712968704 00000100:00100000:0.0:1789997499.852054:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997499.852086:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712968576:0@lo:400:kworker.0 00000100:00100000:1.0:1789997499.852091:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712968832 00000100:00100000:3.0:1789997499.852097:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997499.852097:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712968832 00000100:00100000:2.0:1789997499.852105:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997499.852114:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712968960:0@lo:400:kworker.0 00000100:00100000:0.0:1789997499.852135:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712969216 00000100:00100000:0.0:1789997499.852140:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712969216 00000100:00100000:2.0:1789997499.852145:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997499.852167:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712969088 00000100:00100000:1.0:1789997499.852167:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1789997499.852179:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712968704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997499.852182:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712968960 00000100:00100000:3.0:1789997499.852183:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712969088 00000100:00100000:2.0:1789997499.852190:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712968960 00000100:00100000:3.0:1789997499.852229:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:1.0:1789997499.852239:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712968704:12345-0@lo:400:kworker.0 Request processed in 62us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997499.852240:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1789997499.852242:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712969088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997499.852254:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712968960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997499.852259:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1789997499.852281:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1789997499.852301:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712968832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997499.852306:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712968960:12345-0@lo:400:kworker.0 Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997499.852317:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1789997499.852356:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712968960:0@lo:400:kworker.0 00000100:00100000:2.0:1789997499.852366:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712969088:0@lo:400:kworker.0 00000100:00080000:2.0:1789997499.852395:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997499.852398:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997499.852401:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997499.852452:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712969088:12345-0@lo:400:kworker.0 Request processed in 60us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997499.852460:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1789997499.852484:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:2.0:1789997499.852495:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712969216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997499.852504:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712968704:0@lo:400:kworker.0 00000100:00100000:2.0:1789997499.852549:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712969216:12345-0@lo:400:kworker.0 Request processed in 57us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997499.852556:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:1.0:1789997499.853340:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712968832:12345-0@lo:400:kworker.0 Request processed in 1049us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997499.853347:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:1.0:1789997499.853410:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712968832:0@lo:400:kworker.0 00000100:00100000:3.0:1789997499.854149:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712969216:0@lo:400:kworker.0 00010000:00010000:3.0:1789997500.170866:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997501.195526:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997501.719307:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997501.719346:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997501.719388:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997501.719430:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997501.719459:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704471680 00000100:00100000:2.0:1789997501.719469:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704471680 00000100:00100000:2.0:1789997501.719523:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704471808 00000100:00100000:2.0:1789997501.719527:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704471808 00000100:00100000:2.0:1789997501.719555:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 773 00000100:00100000:3.0:1789997501.719557:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704471424 00000100:00100000:3.0:1789997501.719564:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704471424 00000100:00100000:2.0:1789997501.719568:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704471680:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997501.719598:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1032 00000100:00100000:3.0:1789997501.719608:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704471424:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997501.719680:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704471680:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997501.719687:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704471552 00000100:00100000:2.0:1789997501.719693:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 773 00000100:00100000:1.0:1789997501.719694:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704471552 00000100:00100000:2.0:1789997501.719719:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 774 00000100:00100000:2.0:1789997501.719728:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704471808:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997501.719739:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1227 00000100:00100000:1.0:1789997501.719751:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704471552:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997501.720060:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704471424:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 453us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997501.720068:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1032 00000100:00080000:3.0:1789997501.720109:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997501.720114:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997501.720116:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997501.720188:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704471808:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 459us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997501.720354:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 774 00000100:00100000:1.0:1789997501.720379:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704471552:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 629us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997501.720389:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1227 00000100:00100000:2.0:1789997501.898981:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997501.899003:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712969472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997501.899078:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997501.900003:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712969344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997501.900064:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997501.900120:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712969472 00000100:00100000:1.0:1789997501.900128:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712969472 00000100:00100000:1.0:1789997501.900183:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712969344 00000100:00100000:1.0:1789997501.900187:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712969344 00000100:00100000:1.0:1789997501.900206:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1789997501.900215:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712969472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997501.900248:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997501.900290:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712969472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997501.900297:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1789997501.900355:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1789997501.900366:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712969344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997501.900392:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997501.900451:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712969344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997501.900459:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:3.0:1789997501.900482:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712969472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997501.900503:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712969344:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997501.900532:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997501.900537:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997502.218992:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997503.244524:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997504.267062:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997504.970880:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712969600:0@lo:400:kworker.0 00000100:00100000:3.0:1789997504.970895:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712969728:0@lo:400:kworker.0 00000100:00100000:0.0:1789997504.970923:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712969984:0@lo:400:kworker.0 00000100:00100000:1.0:1789997504.970939:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712969856:0@lo:400:kworker.0 00000100:00100000:2.0:1789997504.970970:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997504.970971:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997504.971632:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997504.971641:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997504.971676:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712970240:0@lo:400:kworker.0 00000100:00100000:2.0:1789997504.971678:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712970112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997504.971711:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712969984 00000100:00100000:0.0:1789997504.971720:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712969984 00000100:00100000:2.0:1789997504.971728:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997504.971755:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997504.971780:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712970112 00000100:00100000:2.0:1789997504.971786:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712970112 00000100:00100000:0.0:1789997504.971787:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:0.0:1789997504.971800:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712969984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997504.971823:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712969600 00000100:00100000:3.0:1789997504.971824:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712969728 00000100:00100000:2.0:1789997504.971826:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1789997504.971830:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712969600 00000100:00100000:3.0:1789997504.971832:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712969728 00000100:00100000:2.0:1789997504.971838:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712970112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997504.971872:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712969984:12345-0@lo:400:kworker.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997504.971879:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712969856 00000100:00100000:0.0:1789997504.971882:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:3.0:1789997504.971885:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712969856 00000100:00100000:2.0:1789997504.971906:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712970112:12345-0@lo:400:kworker.0 Request processed in 69us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997504.971914:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00080000:0.0:1789997504.971915:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997504.971918:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:3.0:1789997504.971919:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712970240 00000100:00080000:0.0:1789997504.971923:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997504.971924:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712970240 00000100:00080000:0.0:1789997504.971929:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997504.971936:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997504.971950:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:1.0:1789997504.971952:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712969600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997504.971964:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1789997504.971965:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712969728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997504.971980:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712969856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997504.971981:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712969984:0@lo:400:kworker.0 00000100:00100000:2.0:1789997504.972027:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712969728:12345-0@lo:400:kworker.0 Request processed in 67us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997504.972033:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:2.0:1789997504.972040:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1789997504.972045:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712970240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997504.972065:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712969856:12345-0@lo:400:kworker.0 Request processed in 89us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997504.972073:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1789997504.972091:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712970112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997504.972099:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712970240:12345-0@lo:400:kworker.0 Request processed in 56us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997504.972107:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712969600:0@lo:400:kworker.0 00000100:00100000:0.0:1789997504.972109:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1789997504.972122:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712970240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997504.972138:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712969728:0@lo:400:kworker.0 00000100:00100000:0.0:1789997504.972169:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712969856:0@lo:400:kworker.0 00000100:00100000:1.0:1789997504.972200:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712969600:12345-0@lo:400:kworker.0 Request processed in 115us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997504.972219:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00010000:00010000:1.0:1789997505.290917:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997506.314791:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997506.839554:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997506.839681:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997506.839926:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704472064 00000100:00100000:0.0:1789997506.839936:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704472064 00000100:00100000:0.0:1789997506.840002:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1231 00000100:00100000:0.0:1789997506.840014:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704472064:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997506.840088:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704472064:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997506.840096:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1231 00000100:00080000:1.0:1789997506.840642:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997506.841195:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997506.841261:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997506.841409:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704472320 00000100:00100000:0.0:1789997506.841416:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704472320 00000100:00100000:0.0:1789997506.841468:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704472192 00000100:00100000:0.0:1789997506.841471:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704472192 00000100:00100000:0.0:1789997506.841493:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 777 00000100:00100000:0.0:1789997506.841501:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704472320:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997506.841548:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704472320:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997506.841554:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 777 00000100:00100000:0.0:1789997506.841569:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 778 00000100:00100000:0.0:1789997506.841575:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704472192:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997506.841599:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704472192:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997506.841604:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 778 00000100:00100000:1.0:1789997506.841638:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704471936 00000100:00100000:1.0:1789997506.841645:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704471936 00000100:00100000:1.0:1789997506.841709:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1034 00000100:00100000:1.0:1789997506.841718:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704471936:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997506.841751:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704471936:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997506.841758:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1034 00000100:00080000:2.0:1789997506.841780:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997506.841785:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997507.018856:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712970368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997507.018864:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997507.018882:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712970496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997507.019085:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997507.019157:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712970368 00000100:00100000:0.0:1789997507.019166:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712970368 00000100:00100000:1.0:1789997507.019211:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789997507.019229:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997507.019244:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712970496 00000100:00100000:0.0:1789997507.019249:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712970496 00000100:00100000:0.0:1789997507.019288:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1789997507.019298:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712970368:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997507.019316:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1789997507.019330:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997507.019383:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712970368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997507.019392:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1789997507.019419:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1789997507.019426:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712970496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997507.019445:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997507.019457:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712970368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997507.019486:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712970496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997507.019496:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1789997507.019569:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712970496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997507.325034:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997507.325264:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704472448 00000100:00100000:3.0:1789997507.325275:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704472448 00000100:00100000:3.0:1789997507.325380:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 807 00000100:00100000:3.0:1789997507.325392:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47779:x1876946704472448:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997507.325526:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47779:x1876946704472448:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 136us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997507.325534:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 807 00000100:00100000:2.0:1789997507.327918:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997507.328271:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704472576 00000100:00100000:0.0:1789997507.328281:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704472576 00000100:00100000:0.0:1789997507.328333:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 429 00000100:00100000:0.0:1789997507.328344:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47779:x1876946704472576:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997507.328726:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47779:x1876946704472576:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 383us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997507.328733:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 429 00000100:00100000:0.0:1789997507.332350:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997507.332453:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704472704 00000100:00100000:1.0:1789997507.332462:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704472704 00000100:00100000:1.0:1789997507.332556:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 430 00000100:00100000:1.0:1789997507.332568:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47779:x1876946704472704:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997507.332989:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47779:x1876946704472704:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 422us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997507.332996:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 430 00000100:00100000:2.0:1789997507.335492:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997507.335625:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704472832 00000100:00100000:0.0:1789997507.335633:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704472832 00000100:00100000:0.0:1789997507.335853:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 808 00000100:00100000:0.0:1789997507.335863:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47779:x1876946704472832:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997507.336826:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47779:x1876946704472832:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 963us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997507.336835:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 808 00010000:00010000:1.0:1789997507.338856:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997507.339119:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997507.339209:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704472960 00000100:00100000:0.0:1789997507.339218:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704472960 00000100:00100000:0.0:1789997507.339269:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 809 00000100:00100000:0.0:1789997507.339279:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47779:x1876946704472960:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997507.339501:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47779:x1876946704472960:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 222us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997507.339509:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 809 00000100:00100000:1.0:1789997507.341273:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997507.341368:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704473088 00000100:00100000:2.0:1789997507.341376:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704473088 00000100:00100000:2.0:1789997507.341484:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 431 00000100:00100000:2.0:1789997507.341494:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47779:x1876946704473088:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997507.341905:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47779:x1876946704473088:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 412us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997507.341912:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 431 00000100:00100000:2.0:1789997507.343724:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997507.343852:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704473216 00000100:00100000:3.0:1789997507.343861:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704473216 00000100:00100000:3.0:1789997507.343913:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 432 00000100:00100000:3.0:1789997507.343923:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47779:x1876946704473216:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997507.344237:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:47779:x1876946704473216:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 314us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997507.344246:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 432 00000100:00100000:3.0:1789997507.345573:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997507.345680:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704473344 00000100:00100000:1.0:1789997507.345687:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704473344 00000100:00100000:1.0:1789997507.345735:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 810 00000100:00100000:1.0:1789997507.345749:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47779:x1876946704473344:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997507.346197:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47779:x1876946704473344:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 453us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997507.346205:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 810 00000100:00100000:1.0:1789997507.359612:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997507.359745:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704473472 00000100:00100000:2.0:1789997507.359757:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704473472 00000100:00100000:2.0:1789997507.359879:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 811 00000100:00100000:2.0:1789997507.359892:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:47780:x1876946704473472:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997507.359914:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997507.359936:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaecfe expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.360004:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.360020:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.360037:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997507.360071:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00000004:00200000:2.0:1789997507.360076:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997507.360095:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.360122:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cb90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecfe expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.360142:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecfe expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.360152:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:2.0:1789997507.360155:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997507.360159:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2400, rc 0) 00000100:00100000:2.0:1789997507.360224:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47780:x1876946704473472:12345-192.168.204.4@tcp:101:rm.0 Request processed in 335us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997507.360231:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 811 00000100:00100000:2.0:1789997507.362271:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997507.362349:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704473728 00000100:00100000:3.0:1789997507.362357:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704473728 00000100:00100000:3.0:1789997507.362418:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 812 00000100:00100000:3.0:1789997507.362438:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:47780:x1876946704473728:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997507.362453:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997507.362470:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed05 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997507.362562:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00010000:3.0:1789997507.362887:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed05 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.362916:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:3.0:1789997507.362920:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789997507.362927:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cb9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed05 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.362940:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997507.363013:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47780:x1876946704473728:12345-192.168.204.4@tcp:101:rm.0 Request processed in 583us (745us total) trans 4294967606 rc 301/301 00000100:00100000:3.0:1789997507.363020:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 812 00000100:00100000:3.0:1789997507.366245:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997507.366306:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704473856 00000100:00100000:2.0:1789997507.366315:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704473856 00000100:00100000:2.0:1789997507.366370:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:2.0:1789997507.366380:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47780:x1876946704473856:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:3.0:1789997507.372234:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47780:x1876946704473856:12345-192.168.204.4@tcp:37:rm.0 Request processed in 5846us (5988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997507.372246:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 84 00000100:00100000:3.0:1789997507.379115:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997507.379161:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704474112 00000100:00100000:3.0:1789997507.379171:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704474112 00000100:00100000:3.0:1789997507.379215:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:3.0:1789997507.379225:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47780:x1876946704474112:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:3.0:1789997507.379434:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:47780:x1876946704474112:12345-192.168.204.4@tcp:35:rm.0 Request processed in 210us (326us total) trans 4294967607 rc 0/0 00000100:00100000:3.0:1789997507.379442:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 85 00000100:00100000:3.0:1789997507.381970:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997507.381999:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704474368 00000100:00100000:3.0:1789997507.382006:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704474368 00000100:00100000:3.0:1789997507.382049:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 813 00000100:00100000:3.0:1789997507.382059:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:47780:x1876946704474368:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997507.382102:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789997507.382127:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cb97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaecfe expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382152:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cb3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaece9 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382164:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997507.382178:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592c856 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaec33 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382187:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:3.0:1789997507.382193:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997507.382214:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382227:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382237:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382248:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382256:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382262:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382597:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382611:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.382619:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997507.383449:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 16384 00010000:00010000:3.0:1789997507.383469:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383477:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383484:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383490:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997507.383495:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383502:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383514:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff8a38ee49e700) 00010000:00010000:3.0:1789997507.383518:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997507.383521:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383527:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cbba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383553:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383558:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383563:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383569:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997507.383572:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383577:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383584:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:3.0:1789997507.383587:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997507.383590:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997507.383595:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cbac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997507.383613:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024462ca8 reply state 00000000f69dac43 transno 4294967608 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997507.383622:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997507.383725:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:47780:x1876946704474368:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1665us (1759us total) trans 4294967608 rc 0/0 00000100:00100000:3.0:1789997507.383734:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 813 00010000:00010000:2.0:1789997507.385370:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.385390:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.385398:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.385405:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997507.385409:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.385418:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.385432:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff8a38ee49e000) 00010000:00010000:2.0:1789997507.385435:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997507.385440:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997507.385447:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592cbb3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789997508.095125:0:81331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd59bbbc0 20000000:00000080:3.0:1789997508.095142:0:81331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb313000 uarg=0000000000000000 00010000:00010000:3.0:1789997508.097955:0:81331:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997508.097977:0:81331:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997508.098026:0:81331:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997508.098046:0:81331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997508.098062:0:81331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592c841 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997508.098070:0:81331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997508.098109:0:81331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592c841 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997508.098125:0:81331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592c841 expref: 18 pid: 5805 timeout: 1846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997508.098140:0:81331:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81331:1876946712970624:0@lo:104: 00000100:00100000:3.0:1789997508.098204:0:81331:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997508.098317:0:81331:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997508.098407:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789997508.098420:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712970624 00000100:00100000:1.0:1789997508.098426:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712970624 00000100:00100000:1.0:1789997508.098507:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789997508.098518:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb312850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:81331:x1876946712970624:12345-0@lo:104: 00010000:00010000:1.0:1789997508.098531:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997508.098602:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997508.098609:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb312850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:81331:x1876946712970624:12345-0@lo:104: Request processed in 93us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997508.098615:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:2.0:1789997508.098638:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997508.098646:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.098681:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997508.098685:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.098693:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997508.098701:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997508.098707:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:0.0:1789997508.098737:0:81331:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81331:1876946712970624:0@lo:104: 00010000:00010000:2.0:1789997508.098738:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.098749:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997508.098761:0:81331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.098770:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.098779:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592c841 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592c848 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.098807:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997508.098809:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997508.098811:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997508.098831:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712970752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997508.098877:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997508.098927:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712970752 00000100:00100000:0.0:1789997508.098933:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712970752 00010000:00010000:0.0:1789997508.098954:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c841 expref: 19 pid: 5805 timeout: 1846 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997508.098980:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1789997508.098988:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712970752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997508.098997:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997508.099002:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592c841 expref: 19 pid: 5805 timeout: 1846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099012:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592c841 expref: 19 pid: 5805 timeout: 1846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099024:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b800/0x65b43101d592c848 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592c841 expref: 19 pid: 5805 timeout: 1846 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099037:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099045:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099059:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099066:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099073:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099080:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099085:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997508.099090:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099098:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099121:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.099130:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997508.099163:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712970752:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997508.099169:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789997508.099569:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712970752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997508.099593:0:81331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.099600:0:81331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.099606:0:81331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a400/0x65b43101d592cbc1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997508.362752:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997508.532700:0:81379:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff572dca40 20000000:00000080:0.0:1789997508.532719:0:81379:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e0c00 uarg=0000000000000000 00010000:00010000:0.0:1789997508.532977:0:81379:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997508.532994:0:81379:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997508.533014:0:81379:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997508.533034:0:81379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533049:0:81379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533059:0:81379:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533066:0:81379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533073:0:81379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533080:0:81379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533085:0:81379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997508.533089:0:81379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533096:0:81379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533109:0:81379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533121:0:81379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997508.533128:0:81379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cbc8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789997508.954005:0:81427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdbf4f92a0 20000000:00000080:2.0:1789997508.954022:0:81427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e8bc00 uarg=0000000000000000 00010000:00010000:2.0:1789997508.954410:0:81427:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997508.954423:0:81427:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997508.954451:0:81427:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997508.954469:0:81427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954482:0:81427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954507:0:81427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954514:0:81427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954521:0:81427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954529:0:81427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954535:0:81427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997508.954539:0:81427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954553:0:81427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954572:0:81427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954586:0:81427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997508.954591:0:81427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cbcf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997509.387447:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997509.898723:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997509.898731:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997509.898737:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997509.898796:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997509.898809:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997509.898820:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997509.898918:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712970880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997509.899050:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997509.899127:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d399dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997509.899868:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712970880 00000100:00100000:0.0:1789997509.899877:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712970880 00000100:00100000:0.0:1789997509.899972:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1789997509.899982:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712970880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997509.899996:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997509.900017:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cbd6 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997509.900041:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997509.900052:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997509.900061:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e200, rc 0) 00000100:00100000:0.0:1789997509.900123:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712970880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997509.900137:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1789997509.900225:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712970880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997509.900426:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997509.900437:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997509.900463:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997509.900468:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997509.900475:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997510.090947:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712971008:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.091089:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997510.091214:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997510.091222:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712971136:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.091247:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997510.091279:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712971008 00000100:00100000:0.0:1789997510.091287:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712971008 00000100:00100000:0.0:1789997510.091328:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712971136 00000100:00100000:0.0:1789997510.091331:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712971136 00000100:00100000:0.0:1789997510.091375:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1789997510.091383:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712971008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.091435:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712971008:12345-0@lo:400:kworker.0 Request processed in 52us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997510.091442:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:0.0:1789997510.091460:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1789997510.091466:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712971136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.091493:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712971136:12345-0@lo:400:kworker.0 Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997510.091499:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00080000:0.0:1789997510.091523:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997510.091556:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712971136:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.091567:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712971008:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.092286:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712971264:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.092325:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997510.092465:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997510.092472:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712971392:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.092497:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997510.092527:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712971264 00000100:00100000:0.0:1789997510.092532:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712971264 00000100:00100000:0.0:1789997510.092568:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712971392 00000100:00100000:0.0:1789997510.092571:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712971392 00000100:00100000:0.0:1789997510.092591:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1789997510.092597:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712971264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.092636:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712971264:12345-0@lo:400:kworker.0 Request processed in 40us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997510.092643:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1789997510.092674:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1789997510.092680:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712971392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.092709:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712971392:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997510.092715:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00080000:0.0:1789997510.092736:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997510.092740:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997510.092774:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712971392:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.092785:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712971264:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.092925:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712971520:0@lo:400:kworker.0 00000100:00100000:0.0:1789997510.092952:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997510.093038:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712971520 00000100:00100000:1.0:1789997510.093043:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712971520 00000100:00100000:1.0:1789997510.093080:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1789997510.093087:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712971520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997510.093284:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712971520:12345-0@lo:400:kworker.0 Request processed in 198us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997510.093291:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00080000:1.0:1789997510.093310:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997510.093430:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712971520:0@lo:400:kworker.0 00010000:00010000:2.0:1789997510.411206:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997511.056105:0:81622:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd60940bf0 20000000:00000080:2.0:1789997511.056122:0:81622:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e88c00 uarg=0000000000000000 00010000:00010000:2.0:1789997511.056432:0:81622:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997511.056452:0:81622:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997511.056473:0:81622:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997511.056492:0:81622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997511.056511:0:81622:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997511.056519:0:81622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997511.056560:0:81622:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997511.056576:0:81622:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 18 pid: 7594 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997511.056590:0:81622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81622:1876946712971648:0@lo:104: 00000100:00100000:2.0:1789997511.057096:0:81622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997511.057158:0:81622:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789997511.057334:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712971648 00000100:00100000:3.0:1789997511.057344:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712971648 00000100:00100000:3.0:1789997511.057411:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789997511.057423:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:81622:x1876946712971648:12345-0@lo:104: 00010000:00010000:3.0:1789997511.057436:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997511.057561:0:81622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81622:1876946712971648:0@lo:104: 00010000:00010000:2.0:1789997511.057581:0:81622:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.057582:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789997511.057649:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997511.057684:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997511.057692:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997511.057696:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997511.057703:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997511.057711:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997511.057716:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1789997511.057727:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:81622:x1876946712971648:12345-0@lo:104: Request processed in 306us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997511.057750:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:1.0:1789997511.057763:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997511.057770:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789997511.057841:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712971776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997511.057883:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997511.057941:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712971776 00000100:00100000:3.0:1789997511.057946:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712971776 00010000:00010000:3.0:1789997511.057967:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 19 pid: 7594 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997511.057998:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789997511.058007:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712971776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997511.058020:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997511.058026:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 19 pid: 7594 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058038:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 19 pid: 7594 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058053:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660e200/0x65b43101d592cbdd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cbd6 expref: 19 pid: 7594 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058069:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058078:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058091:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058103:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058111:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058118:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058123:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997511.058127:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058135:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058159:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997511.058169:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997511.058183:0:81622:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997511.058192:0:81622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997511.058200:0:81622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592cbe4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997511.058211:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712971776:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997511.058219:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789997511.058776:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712971776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997511.059067:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997511.059080:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2c00/0x65b43101d592cbd6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cbdd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997511.059099:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997511.059102:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997511.059105:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997511.435297:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997511.958513:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997511.958588:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704474496 00000100:00100000:1.0:1789997511.958609:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704474496 00000100:00100000:1.0:1789997511.958726:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1036 00000100:00100000:1.0:1789997511.958740:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704474496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997511.959118:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997511.959168:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704474624 00000100:00100000:0.0:1789997511.959174:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704474624 00000100:00100000:0.0:1789997511.959232:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1235 00000100:00100000:0.0:1789997511.959242:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704474624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997511.959315:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704474624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997511.959323:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1235 00000100:00080000:1.0:1789997511.959386:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997511.959710:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704474496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 971us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997511.959731:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1036 00000100:00100000:3.0:1789997511.960336:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997511.960676:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704474880 00000100:00100000:0.0:1789997511.960683:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704474880 00000100:00080000:1.0:1789997511.960810:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997511.961036:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 781 00000100:00100000:0.0:1789997511.961047:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704474880:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997511.963819:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704474880:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2764us (3474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997511.963834:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 781 00000100:00100000:1.0:1789997511.963881:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997511.963913:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704474752 00000100:00100000:0.0:1789997511.963921:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704474752 00000100:00100000:0.0:1789997511.963971:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 782 00000100:00100000:0.0:1789997511.963981:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704474752:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997511.964052:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704474752:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997511.964059:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 782 00000100:00080000:2.0:1789997511.964122:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997512.138986:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997512.139931:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712972032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997512.140069:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997512.140195:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712971904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997512.140229:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997512.140273:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712972032 00000100:00100000:3.0:1789997512.140281:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712972032 00000100:00100000:3.0:1789997512.140349:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712971904 00000100:00100000:3.0:1789997512.140353:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712971904 00000100:00100000:3.0:1789997512.140385:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1789997512.140394:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712972032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997512.140433:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997512.140479:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712972032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997512.140486:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1789997512.140501:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1789997512.140507:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712971904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997512.140533:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997512.140547:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712972032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997512.140561:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712971904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997512.140567:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:0.0:1789997512.140571:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712971904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997512.140600:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997512.140605:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789997512.170436:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967608 is committed 00010000:00010000:2.0:1789997512.458923:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997513.098810:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997513.098819:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997513.098825:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997513.098883:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997513.098898:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997513.098912:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997513.098940:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712972160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997513.099015:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997513.099089:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789997513.099313:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712972160 00000100:00100000:1.0:1789997513.099322:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712972160 00000100:00100000:1.0:1789997513.099381:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1789997513.099391:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712972160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997513.099406:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997513.099420:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cbeb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997513.099443:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cbeb expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997513.099455:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cbeb expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997513.099462:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997513.099509:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712972160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997513.099516:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1789997513.099997:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd70a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712972160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997513.100014:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997513.100023:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997513.100049:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997513.100054:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997513.100061:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997513.484305:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997514.506878:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997515.210919:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712972288:0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.210923:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712972544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997515.211050:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712972416:0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.211124:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997515.211199:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997515.211214:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712972672:0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.211250:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997515.211295:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712972544 00000100:00100000:1.0:1789997515.211309:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712972544 00000100:00100000:1.0:1789997515.211384:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1789997515.211394:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712972544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.211465:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712972544:12345-0@lo:400:kworker.0 Request processed in 72us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997515.211473:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1789997515.211498:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712972672 00000100:00100000:1.0:1789997515.211501:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712972672 00000100:00100000:1.0:1789997515.211528:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1789997515.211534:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712972672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.211563:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712972672:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997515.211570:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1789997515.211609:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712972672:0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.211620:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712972544:0@lo:400:kworker.0 00000100:00080000:1.0:1789997515.211720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997515.211725:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997515.213814:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997515.213851:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997515.213886:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712972928:0@lo:400:kworker.0 00000100:00100000:3.0:1789997515.213957:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712972800:0@lo:400:kworker.0 00000100:00100000:3.0:1789997515.213995:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997515.214018:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712972288 00000100:00100000:1.0:1789997515.214026:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712972288 00000100:00100000:3.0:1789997515.214044:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712972800 00000100:00100000:3.0:1789997515.214050:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712972800 00000100:00100000:1.0:1789997515.214076:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1789997515.214087:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712972288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997515.214099:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1789997515.214109:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712972800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.214148:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712972288:12345-0@lo:400:kworker.0 Request processed in 62us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997515.214156:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1789997515.214190:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712972416 00000100:00100000:1.0:1789997515.214193:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712972416 00000100:00100000:3.0:1789997515.214224:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712972800:12345-0@lo:400:kworker.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997515.214233:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00080000:3.0:1789997515.214252:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997515.214276:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712972288:0@lo:400:kworker.0 00000100:00100000:3.0:1789997515.214293:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712972800:0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.214308:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1789997515.214317:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712972416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997515.214351:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712972416:12345-0@lo:400:kworker.0 Request processed in 36us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997515.214356:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:2.0:1789997515.214422:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997515.214470:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712972416:0@lo:400:kworker.0 00000100:00100000:3.0:1789997515.214533:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712972928 00000100:00100000:3.0:1789997515.214623:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712972928 00000100:00100000:3.0:1789997515.214703:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1789997515.214711:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712972928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997515.214751:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712972928:12345-0@lo:400:kworker.0 Request processed in 40us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997515.214757:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1789997515.214784:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712972928:0@lo:400:kworker.0 00000100:00080000:1.0:1789997515.214853:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997515.531767:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997516.554838:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789997516.765315:0:81965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 20: test nodemap mapped_admin fileops ========================================================== 09:31:55 (1789997515) 00000100:00100000:1.0:1789997517.078767:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997517.078820:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997517.078841:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704475008 00000100:00100000:2.0:1789997517.078853:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704475008 00000100:00100000:1.0:1789997517.078853:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997517.078858:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704475264 00000100:00100000:3.0:1789997517.078865:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704475264 00000100:00100000:1.0:1789997517.078896:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997517.078910:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1039 00000100:00100000:2.0:1789997517.078922:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704475008:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997517.078957:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704475136 00000100:00100000:0.0:1789997517.078963:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704475136 00000100:00100000:0.0:1789997517.079002:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1239 00000100:00100000:0.0:1789997517.079012:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704475136:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997517.079019:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704475008:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 95us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997517.079029:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1039 00000100:00100000:0.0:1789997517.079058:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704475136:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997517.079066:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1239 00000100:00080000:2.0:1789997517.079087:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997517.079093:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997517.083384:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704475392 00000100:00100000:0.0:1789997517.083412:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704475392 00000100:00100000:0.0:1789997517.083495:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 785 00000100:00100000:0.0:1789997517.083509:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704475264:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997517.083541:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 786 00000100:00100000:3.0:1789997517.083553:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704475392:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997517.083599:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704475264:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 90us (4776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997517.083600:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704475392:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (4700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997517.083639:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 785 00000100:00080000:0.0:1789997517.083713:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997517.086409:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 786 00000100:00100000:3.0:1789997517.260462:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712973056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997517.260531:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997517.260592:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712973184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997517.260629:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997517.260859:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712973056 00000100:00100000:3.0:1789997517.260867:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712973056 00000100:00100000:3.0:1789997517.260929:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712973184 00000100:00100000:3.0:1789997517.260933:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712973184 00000100:00100000:3.0:1789997517.260953:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1789997517.260963:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712973056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997517.260998:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997517.261043:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712973056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997517.261051:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1789997517.261068:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1789997517.261075:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712973184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997517.261093:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997517.261122:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712973184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997517.261128:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1789997517.261341:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712973056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997517.261355:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712973184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997517.261561:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997517.261566:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789997517.578843:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1789997517.607493:0:82013:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1789997517.615618:0:82013:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000020:00000080:1.0:1789997518.374104:0:82061:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc58e95500 20000000:00000080:1.0:1789997518.374123:0:82061:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38e03a8c00 uarg=0000000000000000 10000000:01000000:1.0:1789997518.377870:0:82061:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997518.377897:0:82061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.377917:0:82061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cbeb expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.377925:0:82061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.377966:0:82061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cbeb expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.377981:0:82061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cbeb expref: 18 pid: 5803 timeout: 1857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997518.377994:0:82061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82061:1876946712973312:0@lo:104: 00000100:00100000:1.0:1789997518.378059:0:82061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997518.378118:0:82061:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d31f86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997518.378245:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712973312 00000100:00100000:3.0:1789997518.378254:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712973312 00000100:00100000:3.0:1789997518.378305:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789997518.378314:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82061:x1876946712973312:12345-0@lo:104: 00010000:00010000:3.0:1789997518.378329:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997518.378398:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997518.378404:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82061:x1876946712973312:12345-0@lo:104: Request processed in 92us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997518.378411:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:2.0:1789997518.378466:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997518.378474:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997518.378482:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997518.378486:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997518.378505:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997518.378512:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997518.378517:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997518.378554:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997518.378561:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997518.378584:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997518.378606:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3c00/0x65b43101d592cbeb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cbf2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997518.378622:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997518.378625:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997518.378627:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997518.378641:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712973440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997518.378680:0:82061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82061:1876946712973312:0@lo:104: 00000100:00100000:2.0:1789997518.378700:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789997518.378702:0:82061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997518.378741:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712973440 00000100:00100000:1.0:1789997518.378746:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712973440 00010000:00010000:1.0:1789997518.378766:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cbeb expref: 19 pid: 5803 timeout: 1857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997518.378843:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1789997518.378854:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712973440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997518.378865:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997518.378870:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cbeb expref: 19 pid: 5803 timeout: 1857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378880:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cbeb expref: 19 pid: 5803 timeout: 1857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378895:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592cbf2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cbeb expref: 19 pid: 5803 timeout: 1857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378909:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378917:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378929:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378937:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378944:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378950:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378960:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997518.378964:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378972:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.378993:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997518.379002:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997518.379042:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712973440:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997518.379049:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789997518.379128:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712973440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997518.379195:0:82061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997518.379205:0:82061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997518.379211:0:82061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592cbf9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997518.603957:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997519.054382:0:82110:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd095041a0 20000000:00000080:0.0:1789997519.054401:0:82110:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c7d1ec00 uarg=0000000000000000 10000000:01000000:0.0:1789997519.054918:0:82110:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997519.054937:0:82110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.054952:0:82110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.054963:0:82110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.054969:0:82110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.054977:0:82110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.054985:0:82110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.055059:0:82110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ec00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997519.055064:0:82110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.055072:0:82110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.055086:0:82110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.055160:0:82110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997519.055167:0:82110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ec00/0x65b43101d592cc00 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997519.435772:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997519.435782:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997519.435786:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997519.435831:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997519.435843:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997519.435856:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997519.435882:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712973568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997519.435949:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997519.436042:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3f84c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997519.436866:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712973568 00000100:00100000:1.0:1789997519.436875:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712973568 00000100:00100000:1.0:1789997519.436926:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1789997519.436936:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712973568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997519.436950:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997519.436967:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cc07 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.436996:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cc07 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.437007:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc07 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.437016:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:3.0:1789997519.437114:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712973568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997519.437132:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997519.437142:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997519.437145:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712973568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997519.437152:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 10000000:01000000:3.0:1789997519.437168:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997519.437173:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997519.437181:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.628132:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997519.665473:0:82158:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc476d500 20000000:00000080:1.0:1789997519.665489:0:82158:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38e03a8c00 uarg=0000000000000000 10000000:01000000:1.0:1789997519.665775:0:82158:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997519.665795:0:82158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.665812:0:82158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc07 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.665820:0:82158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.665855:0:82158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cc07 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.665869:0:82158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cc07 expref: 18 pid: 5805 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997519.665883:0:82158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82158:1876946712973696:0@lo:104: 00000100:00100000:1.0:1789997519.665944:0:82158:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997519.666047:0:82158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32cb000 going to sleep for 11 seconds 00000100:00100000:3.0:1789997519.666092:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712973696 00000100:00100000:3.0:1789997519.666100:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712973696 00000100:00100000:3.0:1789997519.666190:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789997519.666199:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82158:x1876946712973696:12345-0@lo:104: 00010000:00010000:3.0:1789997519.666211:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997519.666283:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997519.666290:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82158:x1876946712973696:12345-0@lo:104: Request processed in 92us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997519.666296:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00010000:2.0:1789997519.666345:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997519.666352:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997519.666360:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997519.666364:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997519.666372:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997519.666379:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997519.666384:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997519.666417:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997519.666423:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997519.666441:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997519.666447:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc07 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc0e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997519.666461:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997519.666463:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997519.666465:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997519.666489:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712973824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997519.666522:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997519.666633:0:82158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82158:1876946712973696:0@lo:104: 00010000:00010000:1.0:1789997519.666650:0:82158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997519.666710:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712973824 00000100:00100000:1.0:1789997519.666715:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712973824 00010000:00010000:1.0:1789997519.666733:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc07 expref: 19 pid: 5805 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997519.666752:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789997519.666758:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4a79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712973824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997519.666767:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997519.666773:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc07 expref: 19 pid: 5805 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666782:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cc07 expref: 19 pid: 5805 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666794:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cc0e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cc07 expref: 19 pid: 5805 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666807:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666814:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666826:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666832:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666839:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666845:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666851:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997519.666856:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666863:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666877:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.666884:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997519.666912:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4a79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712973824:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997519.666919:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00010000:1.0:1789997519.667001:0:82158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.667009:0:82158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997519.667014:0:82158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc15 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997519.667888:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712973824:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789997520.195413:0:82206:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc0dc65de0 20000000:00000080:0.0:1789997520.195597:0:82206:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c7d1dc00 uarg=0000000000000000 10000000:01000000:0.0:1789997520.195851:0:82206:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997520.195873:0:82206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195889:0:82206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195900:0:82206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195918:0:82206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195925:0:82206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195930:0:82206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195934:0:82206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997520.195937:0:82206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195942:0:82206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195952:0:82206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195957:0:82206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997520.195965:0:82206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc1c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997520.337138:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712973952:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337217:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997520.337261:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712974464:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337287:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997520.337312:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997520.337318:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712974336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337339:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997520.337343:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712974208:0@lo:400:kworker.0 00000100:00100000:2.0:1789997520.337371:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997520.337371:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712973952 00000100:00100000:1.0:1789997520.337378:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712973952 00000100:00100000:2.0:1789997520.337390:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997520.337396:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712974080:0@lo:400:kworker.0 00000100:00100000:2.0:1789997520.337414:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997520.337420:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1789997520.337429:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712973952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337472:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712973952:12345-0@lo:400:kworker.0 Request processed in 44us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997520.337479:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1789997520.337512:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712974464 00000100:00100000:1.0:1789997520.337516:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712974464 00000100:00100000:1.0:1789997520.337546:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712974336 00000100:00100000:1.0:1789997520.337560:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712974336 00000100:00100000:1.0:1789997520.337582:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1789997520.337589:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712974464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337620:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712974464:12345-0@lo:400:kworker.0 Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997520.337626:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1789997520.337638:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1789997520.337644:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712974336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337686:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712974336:12345-0@lo:400:kworker.0 Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997520.337692:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1789997520.337711:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712974208 00000100:00100000:1.0:1789997520.337714:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712974208 00000100:00100000:1.0:1789997520.337739:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712974080 00000100:00100000:1.0:1789997520.337742:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712974080 00000100:00100000:1.0:1789997520.337760:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1789997520.337766:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712974208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337813:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712974208:12345-0@lo:400:kworker.0 Request processed in 46us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997520.337819:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1789997520.337831:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:1.0:1789997520.337838:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712974080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337864:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712974080:12345-0@lo:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997520.337870:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00080000:1.0:1789997520.337891:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997520.337895:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997520.337897:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997520.337939:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712974080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337950:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712974208:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337976:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712974336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337983:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712973952:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.337991:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712974464:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.338204:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712974592:0@lo:400:kworker.0 00000100:00100000:1.0:1789997520.338233:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997520.341427:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712974592 00000100:00100000:0.0:1789997520.341443:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712974592 00000100:00100000:0.0:1789997520.342445:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:0.0:1789997520.342459:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712974592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997520.342572:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712974592:12345-0@lo:400:kworker.0 Request processed in 118us (4338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997520.342579:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00080000:1.0:1789997520.345895:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997520.346213:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712974592:0@lo:400:kworker.0 00010000:00010000:0.0:1789997520.651586:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997520.783966:0:82254:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbef63cb0 20000000:00000080:3.0:1789997520.783982:0:82254:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb1be800 uarg=0000000000000000 10000000:01000000:3.0:1789997520.784251:0:82254:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997520.784273:0:82254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784290:0:82254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784302:0:82254:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784309:0:82254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784317:0:82254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784337:0:82254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784345:0:82254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997520.784349:0:82254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784358:0:82254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784373:0:82254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784381:0:82254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997520.784388:0:82254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc23 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997521.290866:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997521.290874:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997521.290879:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997521.290966:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997521.290978:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997521.290989:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997521.291013:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712974720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997521.291271:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997521.291386:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c35fb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789997521.291528:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712974720 00000100:00100000:1.0:1789997521.291545:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712974720 00000100:00100000:1.0:1789997521.291642:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1789997521.291686:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712974720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997521.291700:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997521.291714:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cc2a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997521.291737:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cc2a expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997521.291748:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc2a expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997521.291771:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:1.0:1789997521.291822:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712974720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997521.291829:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1789997521.291926:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712974720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997521.291942:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.291951:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997521.291977:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997521.291983:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.291995:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789997521.465287:0:82302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd943859e0 20000000:00000080:3.0:1789997521.465303:0:82302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb1bd000 uarg=0000000000000000 10000000:01000000:3.0:1789997521.465557:0:82302:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997521.465578:0:82302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.465600:0:82302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc2a expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.465609:0:82302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.465649:0:82302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cc2a expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.465689:0:82302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cc2a expref: 18 pid: 5805 timeout: 1860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997521.465704:0:82302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82302:1876946712974848:0@lo:104: 00000100:00100000:3.0:1789997521.465772:0:82302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997521.465886:0:82302:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997521.465953:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712974848 00000100:00100000:1.0:1789997521.465960:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712974848 00000100:00100000:1.0:1789997521.466015:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789997521.466027:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82302:x1876946712974848:12345-0@lo:104: 00010000:00010000:1.0:1789997521.466041:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997521.466182:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997521.466190:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82302:x1876946712974848:12345-0@lo:104: Request processed in 165us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997521.466198:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789997521.466257:0:82302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82302:1876946712974848:0@lo:104: 00010000:00010000:3.0:1789997521.466278:0:82302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997521.467360:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997521.467370:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997521.467380:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997521.467384:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997521.467394:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997521.467401:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997521.467411:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997521.467498:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997521.467505:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997521.467551:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997521.467558:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592cc2a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc31 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997521.467574:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997521.467575:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997521.467577:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997521.467634:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997521.467912:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712974976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997521.468040:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997521.468364:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712974976 00000100:00100000:2.0:1789997521.468372:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712974976 00010000:00010000:3.0:1789997521.468510:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc2a expref: 19 pid: 5805 timeout: 1860 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997521.468584:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789997521.468593:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712974976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997521.468607:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997521.468613:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc2a expref: 19 pid: 5805 timeout: 1860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.468644:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cc2a expref: 19 pid: 5805 timeout: 1860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.468685:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592cc31 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cc2a expref: 19 pid: 5805 timeout: 1860 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469080:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469090:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469107:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469114:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469121:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469127:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469133:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997521.469138:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469144:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469167:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997521.469177:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997521.469234:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712974976:12345-0@lo:103:ldlm_bl.0 Request processed in 642us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997521.469242:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00010000:0.0:1789997521.469326:0:82302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997521.469335:0:82302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997521.469342:0:82302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ba00/0x65b43101d592cc38 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997521.469853:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712974976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997521.674939:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997522.203816:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997522.203864:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997522.203928:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704475520 00000100:00100000:2.0:1789997522.203939:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704475520 00000100:00100000:1.0:1789997522.203952:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997522.204001:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1043 00000100:00100000:3.0:1789997522.204010:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704475648 00000100:00100000:3.0:1789997522.204017:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704475648 00000100:00100000:2.0:1789997522.204018:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704475520:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997522.204018:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997522.204069:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1243 00000100:00100000:2.0:1789997522.204088:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704475520:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997522.204094:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1043 00000100:00100000:3.0:1789997522.204132:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704475648:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:1.0:1789997522.204616:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997522.204647:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704475776 00000100:00100000:0.0:1789997522.204680:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704475776 00000100:00080000:2.0:1789997522.204720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997522.204726:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704475904 00000100:00100000:0.0:1789997522.204731:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704475904 00000100:00100000:2.0:1789997522.204761:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 789 00000100:00100000:2.0:1789997522.204771:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704475776:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997522.204823:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704475776:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 53us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997522.204830:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 789 00000100:00100000:0.0:1789997522.204849:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 790 00000100:00100000:0.0:1789997522.204859:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704475904:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1789997522.204871:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997522.204890:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704475904:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997522.204897:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 790 00000100:00100000:3.0:1789997522.205601:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704475648:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1522us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997522.205611:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1243 00000100:00100000:3.0:1789997522.378997:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997522.379023:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712975104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997522.379102:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997522.379173:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712975104 00000100:00100000:3.0:1789997522.379181:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712975104 00000100:00100000:3.0:1789997522.379232:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1789997522.379241:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712975104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997522.379277:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997522.379315:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712975104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997522.379322:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1789997522.379365:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712975104:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997522.381146:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997522.381326:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997522.381390:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712975232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997522.381452:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997522.381533:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712975232 00000100:00100000:0.0:1789997522.381540:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712975232 00000100:00100000:0.0:1789997522.381590:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1789997522.381598:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712975232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997522.381630:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997522.381690:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712975232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997522.381696:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1789997522.381735:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712975232:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997522.381849:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997522.699650:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997523.020271:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997523.020279:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997523.020284:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997523.020793:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.020807:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.020824:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997523.020849:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712975360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997523.020917:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997523.020972:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd708f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789997523.023817:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712975360 00000100:00100000:3.0:1789997523.023831:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712975360 00000100:00100000:3.0:1789997523.023899:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1789997523.023910:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712975360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997523.023926:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997523.023945:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cc3f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997523.023972:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cc3f expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997523.023983:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc3f expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997523.023992:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997523.024069:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712975360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997523.024075:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1789997523.024165:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712975360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997523.024187:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.024199:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997523.024226:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997523.024232:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.024240:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789997523.449163:0:82451:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4ef20670 20000000:00000080:3.0:1789997523.449182:0:82451:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb1bf000 uarg=0000000000000000 10000000:01000000:3.0:1789997523.450424:0:82451:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997523.450447:0:82451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997523.450466:0:82451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc3f expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997523.450475:0:82451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997523.450532:0:82451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cc3f expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997523.450548:0:82451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cc3f expref: 18 pid: 5804 timeout: 1862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997523.450562:0:82451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82451:1876946712975488:0@lo:104: 00000100:00100000:3.0:1789997523.450930:0:82451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997523.451045:0:82451:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c603c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997523.451130:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712975488 00000100:00100000:0.0:1789997523.451138:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712975488 00000100:00100000:0.0:1789997523.451221:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789997523.451231:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82451:x1876946712975488:12345-0@lo:104: 00010000:00010000:0.0:1789997523.451245:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997523.451321:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997523.451327:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82451:x1876946712975488:12345-0@lo:104: Request processed in 99us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997523.451335:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789997523.451421:0:82451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82451:1876946712975488:0@lo:104: 00010000:00010000:1.0:1789997523.451441:0:82451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451510:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997523.451518:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451526:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997523.451530:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451539:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997523.451547:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997523.451554:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997523.451602:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451609:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997523.451633:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451671:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592cc3f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc46 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451693:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997523.451695:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997523.451697:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997523.451709:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712975616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997523.451752:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997523.451791:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712975616 00000100:00100000:2.0:1789997523.451795:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712975616 00010000:00010000:2.0:1789997523.451814:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc3f expref: 19 pid: 5804 timeout: 1862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997523.451833:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789997523.451838:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712975616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997523.451848:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997523.451852:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc3f expref: 19 pid: 5804 timeout: 1862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451861:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cc3f expref: 19 pid: 5804 timeout: 1862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451875:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592cc46 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cc3f expref: 19 pid: 5804 timeout: 1862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451889:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451897:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451911:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451919:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451926:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451933:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451938:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997523.451942:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451950:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451961:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997523.451969:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997523.451996:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946712975616:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997523.452002:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789997523.452038:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712975616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997523.452273:0:82451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997523.452282:0:82451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997523.452288:0:82451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592cc4d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997523.722728:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997524.043824:0:82499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffecaacaf80 20000000:00000080:0.0:1789997524.043842:0:82499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa7c00 uarg=0000000000000000 10000000:01000000:0.0:1789997524.044045:0:82499:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997524.044067:0:82499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044083:0:82499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044093:0:82499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044100:0:82499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044106:0:82499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044115:0:82499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044120:0:82499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ee00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997524.044124:0:82499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044132:0:82499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044143:0:82499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044154:0:82499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.044159:0:82499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660ee00/0x65b43101d592cc54 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.747122:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997524.950406:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997524.950415:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997524.950420:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997524.950479:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997524.950496:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997524.950508:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997524.950535:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712975744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997524.950606:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997524.950687:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c54b5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789997524.950791:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712975744 00000100:00100000:0.0:1789997524.950800:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712975744 00000100:00100000:0.0:1789997524.950859:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1789997524.950869:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712975744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997524.950886:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997524.950901:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cc5b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.950924:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cc5b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.950934:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc5b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997524.950943:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660fe00, rc 0) 00000100:00100000:0.0:1789997524.950984:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712975744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997524.950991:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1789997524.951195:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712975744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997524.951209:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997524.951218:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997524.951239:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997524.951244:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997524.951251:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997525.451292:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997525.451322:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712976256:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.451326:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712976000:0@lo:400:kworker.0 00000100:00100000:2.0:1789997525.451565:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712976384:0@lo:400:kworker.0 00000100:00100000:3.0:1789997525.453260:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997525.453829:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997525.453829:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997525.453866:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712975872:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.453867:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712976512:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.453907:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997525.453923:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997525.453925:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712976256 00000100:00100000:2.0:1789997525.453933:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712976256 00000100:00100000:1.0:1789997525.453933:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997525.453942:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712976128:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.453970:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997525.453988:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712975872 00000100:00100000:2.0:1789997525.453989:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712976384 00000100:00100000:2.0:1789997525.453994:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712976384 00000100:00100000:3.0:1789997525.453996:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712975872 00000100:00100000:1.0:1789997525.454012:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1789997525.454019:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1789997525.454023:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712976256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997525.454024:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712976384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997525.454038:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1789997525.454048:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712975872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.454078:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712976256:12345-0@lo:400:kworker.0 Request processed in 56us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997525.454079:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712976384:12345-0@lo:400:kworker.0 Request processed in 52us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997525.454087:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1789997525.454091:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1789997525.454096:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712975872:12345-0@lo:400:kworker.0 Request processed in 49us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997525.454104:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00080000:2.0:1789997525.454110:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997525.454112:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712976000 00000100:00080000:2.0:1789997525.454115:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997525.454116:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712976000 00000100:00100000:1.0:1789997525.454146:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712976512 00000100:00100000:1.0:1789997525.454148:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712976512 00000100:00100000:2.0:1789997525.454166:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712976384:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.454174:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712976128 00000100:00100000:1.0:1789997525.454177:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712976128 00000100:00080000:2.0:1789997525.454188:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997525.454196:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1789997525.454203:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1789997525.454208:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712976000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.454214:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712976512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997525.454268:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712976000:12345-0@lo:400:kworker.0 Request processed in 64us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997525.454272:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712976512:12345-0@lo:400:kworker.0 Request processed in 59us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997525.454279:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1789997525.454293:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1789997525.454299:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712976128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997525.454318:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712976000:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.454324:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712976128:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997525.454327:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712976512:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.454329:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1789997525.454920:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712976128:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.455019:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712976256:0@lo:400:kworker.0 00000100:00100000:1.0:1789997525.455030:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712975872:0@lo:400:kworker.0 00000100:00100000:3.0:1789997525.455229:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00010000:00010000:2.0:1789997525.771788:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997526.641099:0:82695:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd370ed110 20000000:00000080:2.0:1789997526.641116:0:82695:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e88800 uarg=0000000000000000 00010000:00010000:2.0:1789997526.641404:0:82695:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997526.641419:0:82695:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997526.641446:0:82695:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997526.641466:0:82695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997526.641485:0:82695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc5b expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997526.641493:0:82695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997526.641534:0:82695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cc5b expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997526.641550:0:82695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cc5b expref: 18 pid: 5803 timeout: 1865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997526.641565:0:82695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82695:1876946712976640:0@lo:104: 00000100:00100000:2.0:1789997526.641628:0:82695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997526.641778:0:82695:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa16f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997526.641892:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712976640 00000100:00100000:0.0:1789997526.641900:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712976640 00000100:00100000:0.0:1789997526.641957:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789997526.641967:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82695:x1876946712976640:12345-0@lo:104: 00010000:00010000:0.0:1789997526.641979:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642048:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997526.642054:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82695:x1876946712976640:12345-0@lo:104: Request processed in 89us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997526.642061:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:0.0:1789997526.642082:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997526.642088:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642095:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997526.642099:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642107:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997526.642114:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997526.642120:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997526.642149:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642155:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997526.642175:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642185:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3600/0x65b43101d592cc5b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc62 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642199:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997526.642200:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997526.642202:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997526.642216:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997526.642225:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712976768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997526.642254:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997526.642289:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712976768 00000100:00100000:0.0:1789997526.642293:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712976768 00010000:00010000:0.0:1789997526.642313:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc5b expref: 19 pid: 5803 timeout: 1865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997526.642334:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789997526.642340:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712976768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997526.642349:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997526.642354:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc5b expref: 19 pid: 5803 timeout: 1865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642364:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cc5b expref: 19 pid: 5803 timeout: 1865 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642379:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642388:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642405:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642412:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642418:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642424:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642441:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997526.642445:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642453:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642462:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.642470:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997526.642501:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712976768:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997526.642507:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789997526.642544:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712976768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997526.642797:0:82695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc62 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cc5b expref: 18 pid: 5803 timeout: 1865 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997526.642808:0:82695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82695:1876946712976640:0@lo:104: 00010000:00010000:2.0:1789997526.642821:0:82695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997526.642828:0:82695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997526.642835:0:82695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997526.642840:0:82695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cc69 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997526.794877:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997527.320723:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997527.320774:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997527.320788:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704476032 00000100:00100000:0.0:1789997527.320800:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704476032 00000100:00100000:0.0:1789997527.320852:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1047 00000100:00100000:0.0:1789997527.320864:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704476032:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997527.320934:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704476032:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997527.320942:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1047 00000100:00100000:1.0:1789997527.321407:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997527.321453:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997527.322611:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704476288 00000100:00100000:0.0:1789997527.322622:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704476288 00000100:00100000:2.0:1789997527.322682:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704476160 00000100:00100000:2.0:1789997527.322687:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704476160 00000100:00100000:0.0:1789997527.322704:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704476416 00000100:00100000:0.0:1789997527.322707:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704476416 00000100:00100000:2.0:1789997527.322724:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1247 00000100:00100000:0.0:1789997527.322728:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 433 00000100:00100000:2.0:1789997527.322734:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704476160:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997527.322734:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704476288:12345-192.168.204.4@tcp:9:kworker.0 00000100:00080000:1.0:1789997527.322744:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997527.322751:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997527.322753:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789997527.322761:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592c562 00000100:00080000:0.0:1789997527.322771:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38fb47e800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789997527.322797:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704476160:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 64us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997527.322804:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1247 00000001:00000004:0.0:1789997527.322818:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967347 00000100:00100000:2.0:1789997527.322827:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 434 00000100:00100000:2.0:1789997527.322835:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7416c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704476416:12345-192.168.204.4@tcp:9:kworker.0 00010000:00010000:1.0:1789997527.322835:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997527.322849:0:8169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592c4b3 00000100:00080000:2.0:1789997527.322855:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38fb47c000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789997527.322918:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789997527.322932:0:8169:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967347 00000100:00100000:0.0:1789997527.323072:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704476288:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 336us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997527.323079:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 433 00000100:00100000:2.0:1789997527.323560:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7416c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704476416:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 725us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997527.323569:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 434 00000100:00100000:0.0:1789997527.498877:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712976896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997527.498947:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997527.499877:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712976896 00000100:00100000:2.0:1789997527.499887:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712976896 00000100:00100000:2.0:1789997527.499942:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1789997527.499953:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712976896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997527.499987:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997527.501077:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712977024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997527.501132:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997527.501262:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712977024 00000100:00100000:3.0:1789997527.501268:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712977024 00000100:00100000:3.0:1789997527.501302:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1789997527.501312:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712977024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997527.501339:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997527.501446:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712977024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997527.501453:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1789997527.501504:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712977024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997527.501540:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997527.501545:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997527.502671:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712976896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2703us (3706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997527.502681:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1789997527.502764:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712976896:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997527.820385:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997528.336246:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997528.336254:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997528.336258:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997528.336303:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997528.336316:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997528.336327:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997528.336351:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712977152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997528.336427:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997528.336475:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789997528.336770:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712977152 00000100:00100000:2.0:1789997528.336780:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712977152 00000100:00100000:2.0:1789997528.336834:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1789997528.336843:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712977152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997528.336856:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997528.336870:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cc70 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997528.336892:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cc70 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997528.336903:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc70 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997528.336913:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2200, rc 0) 00000100:00100000:2.0:1789997528.336951:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712977152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997528.336957:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1789997528.337114:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712977152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997528.337128:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997528.337137:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997528.337154:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997528.337159:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997528.337166:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997528.842869:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997529.350719:0:82891:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2c519d20 20000000:00000080:2.0:1789997529.350737:0:82891:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c8597000 uarg=0000000000000000 00010000:00010000:2.0:1789997529.351236:0:82891:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997529.351254:0:82891:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997529.351271:0:82891:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997529.351290:0:82891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997529.351307:0:82891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc70 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997529.351316:0:82891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997529.351355:0:82891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cc70 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997529.351520:0:82891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cc70 expref: 18 pid: 5805 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997529.351538:0:82891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82891:1876946712977280:0@lo:104: 00000100:00100000:2.0:1789997529.351604:0:82891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997529.351768:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789997529.351778:0:82891:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e42ad300 going to sleep for 11 seconds 00000100:00100000:3.0:1789997529.352026:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712977280 00000100:00100000:3.0:1789997529.352035:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712977280 00000100:00100000:3.0:1789997529.352085:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789997529.352096:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82891:x1876946712977280:12345-0@lo:104: 00010000:00010000:3.0:1789997529.352110:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997529.352227:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997529.352233:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:82891:x1876946712977280:12345-0@lo:104: Request processed in 139us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997529.352240:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00010000:00010000:1.0:1789997529.352516:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997529.352525:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.352533:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997529.352537:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.352547:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997529.352555:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997529.352560:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:2.0:1789997529.352593:0:82891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a38700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82891:1876946712977280:0@lo:104: 00010000:00010000:2.0:1789997529.352614:0:82891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.352681:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.352688:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997529.352716:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.352723:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3400/0x65b43101d592cc70 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc77 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.352740:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997529.352741:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997529.352743:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997529.352764:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997529.352775:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712977408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997529.352811:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997529.352902:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712977408 00000100:00100000:1.0:1789997529.352906:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712977408 00010000:00010000:1.0:1789997529.352926:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc70 expref: 19 pid: 5805 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997529.352956:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789997529.352964:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712977408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997529.352975:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997529.352980:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc70 expref: 19 pid: 5805 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.352991:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cc70 expref: 19 pid: 5805 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353007:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592cc77 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cc70 expref: 19 pid: 5805 timeout: 1868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353021:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353029:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353042:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353049:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353060:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353066:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353072:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997529.353076:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353084:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353104:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997529.353112:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997529.353148:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946712977408:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997529.353156:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00010000:00010000:2.0:1789997529.353169:0:82891:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997529.353179:0:82891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997529.353186:0:82891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592cc7e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997529.353423:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712977408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997529.866917:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997529.921138:0:82939:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff603cb70 20000000:00000080:0.0:1789997529.921155:0:82939:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa6c00 uarg=0000000000000000 10000000:01000000:0.0:1789997529.921203:0:82939:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997529.921226:0:82939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921241:0:82939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921252:0:82939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921258:0:82939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921265:0:82939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921272:0:82939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921278:0:82939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997529.921283:0:82939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921290:0:82939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921302:0:82939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921309:0:82939:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997529.921316:0:82939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660fe00/0x65b43101d592cc85 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997530.572026:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712977664:0@lo:400:kworker.0 00000100:00100000:0.0:1789997530.572097:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997530.572141:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712978176:0@lo:400:kworker.0 00000100:00100000:0.0:1789997530.572163:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997530.572186:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997530.572192:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712977792:0@lo:400:kworker.0 00000100:00100000:0.0:1789997530.572213:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997530.572307:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712977920:0@lo:400:kworker.0 00000100:00100000:2.0:1789997530.572342:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997530.572409:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789997530.572416:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712977536:0@lo:400:kworker.0 00000100:00100000:2.0:1789997530.572446:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997530.572470:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712978048:0@lo:400:kworker.0 00000100:00100000:2.0:1789997530.572495:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997530.572514:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712977920 00000100:00100000:3.0:1789997530.572523:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712977920 00000100:00100000:2.0:1789997530.572535:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712977536 00000100:00100000:2.0:1789997530.572541:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712977536 00000100:00100000:3.0:1789997530.572588:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712978048 00000100:00100000:2.0:1789997530.572591:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1789997530.572593:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712978048 00000100:00100000:2.0:1789997530.572604:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712977536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997530.572622:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1789997530.572630:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712977920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997530.573011:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712977664 00000100:00100000:1.0:1789997530.573016:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712977664 00000100:00100000:1.0:1789997530.573048:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712978176 00000100:00100000:1.0:1789997530.573051:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712978176 00000100:00100000:1.0:1789997530.573072:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712977792 00000100:00100000:1.0:1789997530.573075:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712977792 00000100:00100000:1.0:1789997530.573093:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1789997530.573099:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712977664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997530.574026:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712977920:12345-0@lo:400:kworker.0 Request processed in 1394us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997530.574038:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1789997530.574065:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:3.0:1789997530.574074:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712978048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997530.574113:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712978048:12345-0@lo:400:kworker.0 Request processed in 42us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997530.574159:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00080000:3.0:1789997530.574181:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997530.574186:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997530.574189:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997530.574261:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712977536:0@lo:400:kworker.0 00000100:00100000:3.0:1789997530.574278:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712978048:0@lo:400:kworker.0 00000100:00100000:3.0:1789997530.574290:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712977920:0@lo:400:kworker.0 00000100:00100000:1.0:1789997530.577429:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712977664:12345-0@lo:400:kworker.0 Request processed in 4322us (5324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997530.577444:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1789997530.577477:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1789997530.577487:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712978176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997530.577533:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712978176:12345-0@lo:400:kworker.0 Request processed in 51us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997530.577539:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1789997530.577550:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1789997530.577556:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712977792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997530.577585:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712977792:12345-0@lo:400:kworker.0 Request processed in 29us (5371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997530.577591:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1789997530.577690:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712977792:0@lo:400:kworker.0 00000100:00100000:1.0:1789997530.577708:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712977664:0@lo:400:kworker.0 00000100:00100000:1.0:1789997530.577719:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712978176:0@lo:400:kworker.0 00000100:00100000:2.0:1789997530.579905:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712977536:12345-0@lo:400:kworker.0 Request processed in 7296us (7450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997530.579919:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 10000000:01000000:3.0:1789997530.698735:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997530.698744:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997530.698749:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997530.698799:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997530.698885:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997530.698899:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997530.698927:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712978304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997530.699018:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997530.699066:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712978304 00000100:00100000:2.0:1789997530.699075:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712978304 00000100:00100000:3.0:1789997530.699081:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c33959c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997530.699130:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1789997530.699140:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712978304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997530.699152:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997530.699165:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cc8c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997530.699188:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cc8c expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997530.699199:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc8c expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997530.699209:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3200, rc 0) 00000100:00100000:2.0:1789997530.699265:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712978304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997530.699271:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1789997530.702036:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712978304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997530.702064:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997530.702076:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997530.702099:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997530.702107:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997530.702116:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997530.891119:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789997531.132173:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997531.132181:0:7614:0:(genops.c:885:class_export_put()) final put ffff8a38fb47b000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997531.132213:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38fb47b000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0001 00000020:00000080:0.0:1789997531.132253:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38fb47c000 for lustre-OST0001 00000001:00100000:1.0:1789997531.134363:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997531.134369:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a38fb47e000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997531.134461:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38fb47e000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:1.0:1789997531.134499:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38fb47e800 for lustre-OST0000 00010000:00010000:1.0:1789997531.915309:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997532.438138:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997532.438197:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997532.438347:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704476672 00000100:00100000:2.0:1789997532.438358:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704476672 00000100:00100000:3.0:1789997532.438469:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704476544 00000100:00100000:3.0:1789997532.438475:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704476544 00000100:00100000:3.0:1789997532.438523:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1051 00000100:00100000:3.0:1789997532.438534:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704476544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997532.438568:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1251 00000100:00100000:2.0:1789997532.438578:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704476672:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997532.438623:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704476544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 89us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997532.438628:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704476672:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 50us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997532.438648:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1051 00000100:00100000:2.0:1789997532.438687:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1251 00000100:00080000:1.0:1789997532.440598:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997532.618893:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997532.618926:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712978432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997532.618996:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997532.619066:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712978432 00000100:00100000:3.0:1789997532.619074:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712978432 00000100:00100000:3.0:1789997532.619158:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1789997532.619169:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712978432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997532.619202:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997532.619253:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712978432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997532.619260:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1789997532.619323:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712978432:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997532.619864:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997532.620844:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712978560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997532.620892:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997532.620945:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712978560 00000100:00100000:3.0:1789997532.620951:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712978560 00000100:00100000:3.0:1789997532.620994:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1789997532.621002:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712978560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997532.621028:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997532.621044:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997532.621132:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712978560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997532.621139:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1789997532.621264:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712978560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997532.938968:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997533.488499:0:83237:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe42d890a0 20000000:00000080:1.0:1789997533.488515:0:83237:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba2400 uarg=0000000000000000 10000000:01000000:1.0:1789997533.488561:0:83237:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997533.488580:0:83237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997533.488597:0:83237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cc8c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997533.488605:0:83237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997533.488642:0:83237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cc8c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997533.489667:0:83237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cc8c expref: 18 pid: 5805 timeout: 1872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997533.489688:0:83237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83237:1876946712978688:0@lo:104: 00000100:00100000:1.0:1789997533.489765:0:83237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997533.489822:0:83237:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e01ca240 going to sleep for 11 seconds 00000100:00100000:0.0:1789997533.489847:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712978688 00000100:00100000:0.0:1789997533.489856:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712978688 00000100:00100000:0.0:1789997533.489921:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789997533.489932:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:83237:x1876946712978688:12345-0@lo:104: 00010000:00010000:0.0:1789997533.489946:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490013:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997533.490019:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:83237:x1876946712978688:12345-0@lo:104: Request processed in 90us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997533.490026:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00010000:0.0:1789997533.490047:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997533.490053:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490072:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997533.490077:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490086:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997533.490093:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997533.490100:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997533.490135:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490142:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997533.490163:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490170:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592cc8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490186:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997533.490188:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997533.490190:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997533.490227:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997533.490240:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712978816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997533.490273:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997533.490340:0:83237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83237:1876946712978688:0@lo:104: 00010000:00010000:2.0:1789997533.490358:0:83237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997533.490408:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712978816 00000100:00100000:0.0:1789997533.490413:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712978816 00010000:00010000:0.0:1789997533.490431:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc8c expref: 19 pid: 5805 timeout: 1872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997533.490461:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789997533.490468:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712978816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997533.490479:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997533.490484:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cc8c expref: 19 pid: 5805 timeout: 1872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490494:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cc8c expref: 19 pid: 5805 timeout: 1872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490507:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592cc93 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cc8c expref: 19 pid: 5805 timeout: 1872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490519:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490527:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490540:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490548:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490555:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490561:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490567:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997533.490571:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490578:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490604:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997533.490613:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997533.490643:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712978816:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997533.490650:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789997533.490712:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712978816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997533.490980:0:83237:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997533.490994:0:83237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997533.491000:0:83237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592cc9a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789997533.953620:0:83285:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd32138500 20000000:00000080:2.0:1789997533.953636:0:83285:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c8597000 uarg=0000000000000000 00010000:00010000:2.0:1789997533.954221:0:83285:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997533.954238:0:83285:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997533.954252:0:83285:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997533.954270:0:83285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954298:0:83285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954309:0:83285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954316:0:83285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954322:0:83285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954330:0:83285:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954337:0:83285:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997533.954341:0:83285:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954349:0:83285:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954362:0:83285:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954370:0:83285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997533.954376:0:83285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3800/0x65b43101d592cca1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997533.964016:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997534.989506:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997535.242763:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997535.242771:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997535.242776:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997535.242829:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.242841:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.242853:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997535.242879:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712978944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997535.242938:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997535.243002:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997535.243035:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712978944 00000100:00100000:2.0:1789997535.243045:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712978944 00000100:00100000:2.0:1789997535.243096:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1789997535.243106:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712978944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997535.243119:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997535.243138:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cca8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.243162:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cca8 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.243178:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cca8 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.243187:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997535.243231:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712978944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997535.243238:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1789997535.243288:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712978944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997535.243304:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.243313:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997535.243332:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997535.243338:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.243350:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997535.691019:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712979456:0@lo:400:kworker.0 00000100:00100000:0.0:1789997535.691098:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712979072:0@lo:400:kworker.0 00000100:00100000:3.0:1789997535.691162:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997535.691230:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997535.691236:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712979328:0@lo:400:kworker.0 00000100:00100000:3.0:1789997535.691449:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997535.691485:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712979456 00000100:00100000:3.0:1789997535.691492:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712979456 00000100:00100000:3.0:1789997535.691556:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1789997535.691566:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712979456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997535.691620:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712979456:12345-0@lo:400:kworker.0 Request processed in 56us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997535.691627:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1789997535.691651:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712979328 00000100:00100000:3.0:1789997535.691676:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712979328 00000100:00100000:3.0:1789997535.691707:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:3.0:1789997535.691713:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712979328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997535.691744:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712979328:12345-0@lo:400:kworker.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997535.691750:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00080000:3.0:1789997535.691767:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997535.691772:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997535.691804:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712979328:0@lo:400:kworker.0 00000100:00100000:3.0:1789997535.691816:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712979456:0@lo:400:kworker.0 00000100:00100000:1.0:1789997535.692642:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712979200:0@lo:400:kworker.0 00000100:00100000:1.0:1789997535.692719:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997535.692766:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712979712:0@lo:400:kworker.0 00000100:00100000:1.0:1789997535.692790:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997535.692823:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712979200 00000100:00100000:1.0:1789997535.692828:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712979200 00000100:00100000:1.0:1789997535.692875:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712979712 00000100:00100000:1.0:1789997535.692878:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712979712 00000100:00100000:3.0:1789997535.692892:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1789997535.692900:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712979200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997535.692908:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1789997535.692913:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712979712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997535.693552:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712979712:12345-0@lo:400:kworker.0 Request processed in 636us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997535.693560:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1789997535.693935:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997535.693975:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712979584:0@lo:400:kworker.0 00000100:00100000:0.0:1789997535.694012:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997535.695033:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712979200:12345-0@lo:400:kworker.0 Request processed in 2129us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997535.695120:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:3.0:1789997535.695158:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712979072 00000100:00100000:3.0:1789997535.695164:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712979072 00000100:00100000:3.0:1789997535.695286:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1789997535.695297:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712979072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997535.695357:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712979072:12345-0@lo:400:kworker.0 Request processed in 62us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997535.696534:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712979200:0@lo:400:kworker.0 00000100:00100000:1.0:1789997535.696555:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712979712:0@lo:400:kworker.0 00000100:00080000:1.0:1789997535.696594:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997535.696692:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712979072:0@lo:400:kworker.0 00000100:00100000:3.0:1789997535.697359:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1789997535.697546:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712979584 00000100:00100000:3.0:1789997535.697553:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712979584 00000100:00100000:3.0:1789997535.697684:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1789997535.697694:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712979584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997535.697775:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712979584:12345-0@lo:400:kworker.0 Request processed in 83us (3762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997535.697782:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00080000:1.0:1789997535.697836:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997535.697863:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712979584:0@lo:400:kworker.0 00000100:00100000:2.0:1789997535.765860:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997535.766078:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704476800 00000100:00100000:3.0:1789997535.766090:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704476800 00000100:00100000:3.0:1789997535.766177:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 814 00000100:00100000:3.0:1789997535.766190:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49008:x1876946704476800:12345-192.168.204.4@tcp:101:rm.0 00000100:00080000:1.0:1789997535.766203:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997535.766211:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997535.766323:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed0c expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.766403:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ccbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.766418:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ccbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.766431:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ccbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997535.766466:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997535.766471:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997535.766495:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ccbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.766519:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed0c expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.766536:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ccbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed0c expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.766544:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997535.766547:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997535.766550:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997535.766623:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49008:x1876946704476800:12345-192.168.204.4@tcp:101:rm.0 Request processed in 429us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997535.766630:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 814 00000100:00100000:3.0:1789997535.769286:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997535.769537:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704476928 00000100:00100000:1.0:1789997535.769546:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704476928 00000100:00100000:1.0:1789997535.769603:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 815 00000100:00100000:1.0:1789997535.769615:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49008:x1876946704476928:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997535.769635:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997535.769688:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ccc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed13 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.769750:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.769764:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.769779:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.769841:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.769848:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.769855:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770201:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770210:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770217:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770223:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997535.770227:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770235:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770259:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:1.0:1789997535.770262:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997535.770268:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770274:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cccb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770285:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770291:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770296:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770301:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997535.770304:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770311:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770318:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38e062d500) 00010000:00010000:1.0:1789997535.770320:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997535.770323:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770330:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592ccd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770361:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ccc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed13 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770376:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:1.0:1789997535.770379:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997535.770383:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ccc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed13 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.770392:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997535.770461:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49008:x1876946704476928:12345-192.168.204.4@tcp:101:rm.0 Request processed in 848us (1185us total) trans 0 rc 301/301 00000100:00100000:1.0:1789997535.770468:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 815 00000100:00100000:1.0:1789997535.804017:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997535.804080:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704477056 00000100:00100000:3.0:1789997535.804091:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704477056 00000100:00100000:3.0:1789997535.804157:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 816 00000100:00100000:3.0:1789997535.804186:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704477056:12345-192.168.204.4@tcp:41:mkdir.0 00000004:00000024:3.0:1789997535.804232:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789997535.804306:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997535.804370:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704477056:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 203us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997535.804379:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 816 00000100:00100000:3.0:1789997535.804396:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704477312 00000100:00100000:3.0:1789997535.804400:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704477312 00000100:00100000:3.0:1789997535.804436:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 817 00000100:00100000:3.0:1789997535.804443:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49012:x1876946704477312:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:3.0:1789997535.804479:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997535.804506:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ccbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed0c expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.804526:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997535.804539:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997535.805037:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.805053:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.805064:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.805078:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.805090:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.805100:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997535.807206:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00010000:2.0:1789997535.807222:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.807231:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.807240:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.807245:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997535.807261:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.807269:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.807282:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:2.0:1789997535.807286:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997535.807291:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.807669:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ccd9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997535.807692:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dc353c0 reply state 000000007eb789f3 transno 4294967609 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997535.807700:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997535.807954:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49012:x1876946704477312:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 3507us (3645us total) trans 4294967609 rc 0/0 00000100:00100000:2.0:1789997535.807963:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 817 00010000:00010000:3.0:1789997535.810107:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.810121:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.810129:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.810134:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997535.810138:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.810145:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.810159:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997535.810162:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997535.810167:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997535.810173:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cce0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997535.834982:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997535.835075:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704477440 00000100:00100000:2.0:1789997535.835087:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704477440 00000100:00100000:2.0:1789997535.835154:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 818 00000100:00100000:2.0:1789997535.835165:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49016:x1876946704477440:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1789997535.835188:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997535.835221:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed1a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.835298:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ccee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.835312:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ccee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.835324:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ccee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997535.835356:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789997535.835359:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997535.835378:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ccee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.835403:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed1a expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.835434:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ccee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed1a expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.835443:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997535.835446:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997535.835449:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2200, rc 0) 00000100:00100000:2.0:1789997535.835515:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49016:x1876946704477440:12345-192.168.204.4@tcp:101:chown.0 Request processed in 351us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997535.835523:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 818 00000100:00100000:1.0:1789997535.837266:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997535.837339:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704477568 00000100:00100000:2.0:1789997535.837344:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704477568 00000100:00100000:2.0:1789997535.837390:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 819 00000100:00100000:2.0:1789997535.837396:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49016:x1876946704477568:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1789997535.837409:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997535.837424:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592ccf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed21 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.837817:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.837833:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.837845:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.837859:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.837866:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.837873:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838005:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838014:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838022:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997535.838054:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:2.0:1789997535.838058:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997535.838078:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838089:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838096:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838103:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838114:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997535.838118:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838125:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838136:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997535.838139:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997535.838144:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838150:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592ccfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838161:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838167:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838172:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838176:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997535.838179:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838185:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838194:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997535.838197:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997535.838200:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838206:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cd03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838240:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592ccf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed21 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838266:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed21 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.838274:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997535.838277:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997535.838279:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2000, rc 0) 00000100:00100000:2.0:1789997535.838360:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49016:x1876946704477568:12345-192.168.204.4@tcp:101:chown.0 Request processed in 962us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997535.838367:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 819 00000100:00100000:0.0:1789997535.840729:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997535.840774:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704477824 00000100:00100000:1.0:1789997535.840783:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704477824 00000100:00100000:1.0:1789997535.840880:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 820 00000100:00100000:1.0:1789997535.840897:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49016:x1876946704477824:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:1.0:1789997535.840947:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997535.840968:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed21 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.840983:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:1.0:1789997535.840992:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997535.841011:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.841034:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997535.841041:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997535.841216:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a0345d6 reply state 00000000f9b5b14c transno 4294967610 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997535.841223:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997535.841229:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:1.0:1789997535.841327:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49016:x1876946704477824:12345-192.168.204.4@tcp:36:chown.0 Request processed in 437us (606us total) trans 4294967610 rc 0/0 00000100:00100000:1.0:1789997535.841333:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 820 00010000:00010000:2.0:1789997535.842413:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.842425:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.842433:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.842443:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997535.842448:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.842455:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.842469:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:2.0:1789997535.842472:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997535.842489:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997535.842495:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.010846:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997536.382985:0:83480:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccfce68e0 20000000:00000080:1.0:1789997536.383005:0:83480:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba2800 uarg=0000000000000000 10000000:01000000:1.0:1789997536.383051:0:83480:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997536.383070:0:83480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.383087:0:83480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cca8 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.383094:0:83480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.383133:0:83480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cca8 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.383147:0:83480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cca8 expref: 18 pid: 5805 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997536.383161:0:83480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83480:1876946712979840:0@lo:104: 00000100:00100000:1.0:1789997536.383221:0:83480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997536.383284:0:83480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38faf3df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789997536.383348:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712979840 00000100:00100000:3.0:1789997536.383355:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712979840 00000100:00100000:3.0:1789997536.383404:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1789997536.383413:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:83480:x1876946712979840:12345-0@lo:104: 00010000:00010000:3.0:1789997536.383425:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997536.383485:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997536.383491:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:83480:x1876946712979840:12345-0@lo:104: Request processed in 80us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997536.383498:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00010000:00010000:3.0:1789997536.383518:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997536.383524:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997536.383532:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997536.383536:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997536.383545:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997536.383553:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997536.383559:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997536.383585:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997536.383593:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997536.383611:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997536.383618:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cca8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ccaf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997536.383632:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997536.383634:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997536.383636:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997536.383650:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997536.383684:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712979968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997536.383712:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997536.383793:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712979968 00000100:00100000:0.0:1789997536.383798:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712979968 00010000:00010000:0.0:1789997536.383819:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cca8 expref: 19 pid: 5805 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997536.383849:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789997536.383857:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712979968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997536.383866:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997536.383872:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cca8 expref: 19 pid: 5805 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383881:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cca8 expref: 19 pid: 5805 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383896:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383904:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383918:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383925:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383931:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383938:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383943:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997536.383948:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383955:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383964:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997536.383974:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997536.384006:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712979968:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997536.384013:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789997536.384046:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712979968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997536.384146:0:83480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592ccaf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cca8 expref: 18 pid: 5805 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997536.384156:0:83480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83480:1876946712979840:0@lo:104: 00010000:00010000:1.0:1789997536.384168:0:83480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.384177:0:83480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.384183:0:83480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.384189:0:83480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592cd18 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789997536.948751:0:83528:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd9945cb0 20000000:00000080:1.0:1789997536.948765:0:83528:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba1000 uarg=0000000000000000 00010000:00010000:1.0:1789997536.948986:0:83528:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997536.949022:0:83528:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:1.0:1789997536.949026:0:83528:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997536.949039:0:83528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ccee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed1a expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949061:0:83528:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997536.949073:0:83528:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997536.949086:0:83528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949096:0:83528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949105:0:83528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949109:0:83528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949113:0:83528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949117:0:83528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949121:0:83528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997536.949124:0:83528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949130:0:83528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949137:0:83528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949142:0:83528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997536.949148:0:83528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592cd1f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997537.034794:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997537.559883:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997537.560028:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704477952 00000100:00100000:3.0:1789997537.560042:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704477952 00000100:00100000:3.0:1789997537.560104:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1054 00000100:00100000:3.0:1789997537.560114:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704477952:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997537.560277:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704477952:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 163us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997537.560284:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1054 00000100:00100000:1.0:1789997537.564465:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997537.564719:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704478080 00000100:00100000:2.0:1789997537.564749:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704478080 00000100:00100000:2.0:1789997537.564828:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1255 00000100:00100000:2.0:1789997537.564840:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704478080:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997537.564923:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704478080:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997537.564931:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1255 00000100:00080000:3.0:1789997537.565173:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997537.743425:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997537.744585:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712980096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997537.744673:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997537.747418:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712980096 00000100:00100000:0.0:1789997537.747431:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712980096 00000100:00100000:0.0:1789997537.747503:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:0.0:1789997537.747515:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712980096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997537.747555:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997537.747641:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712980096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997537.747648:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00080000:0.0:1789997537.747800:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997537.747856:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712980096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997537.748155:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712980224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997537.748196:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997537.751454:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712980224 00000100:00100000:0.0:1789997537.751470:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712980224 00000100:00100000:0.0:1789997537.751541:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1789997537.751554:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712980224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997537.751598:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997537.751700:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712980224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (3503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997537.751707:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00080000:0.0:1789997537.753386:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997537.753451:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712980224:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789997537.806931:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967610 is committed 00010000:00010000:0.0:1789997538.058819:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997538.187797:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997538.187805:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997538.187810:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997538.187860:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997538.187872:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997538.187889:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997538.187917:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712980352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997538.188182:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997538.188343:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d8ff4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789997538.188671:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712980352 00000100:00100000:0.0:1789997538.188681:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712980352 00000100:00100000:0.0:1789997538.188749:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1789997538.188759:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712980352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997538.188772:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997538.188788:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592cd26 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997538.188821:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592cd26 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997538.188832:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cd26 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997538.188845:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660f200, rc 0) 00000100:00100000:0.0:1789997538.188894:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712980352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997538.188903:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1789997538.188933:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712980352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997538.189176:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997538.189187:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997538.189232:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997538.189237:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997538.189246:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997539.017033:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997539.017179:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704478208 00000100:00100000:3.0:1789997539.017206:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704478208 00000100:00080000:0.0:1789997539.017353:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997539.017507:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 13 00000100:00100000:3.0:1789997539.017520:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4886c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5579:x1876946704478208:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997539.017549:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997539.017551:0:6674:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592ccee) 00010000:00010000:3.0:1789997539.017554:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997539.017609:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4886c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5579:x1876946704478208:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 92us (585us total) trans 0 rc 116/116 00000100:00100000:3.0:1789997539.017617:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 13 00010000:00010000:3.0:1789997539.082766:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997539.620368:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997539.620632:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704478336 00000100:00100000:0.0:1789997539.620643:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704478336 00000100:00100000:0.0:1789997539.620718:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 821 00000100:00100000:0.0:1789997539.620729:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49120:x1876946704478336:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997539.620750:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997539.620773:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed28 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.620853:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592cd3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.620867:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592cd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.620880:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592cd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997539.620914:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789997539.620918:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997539.620939:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592cd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.620967:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed28 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.620996:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592cd3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed28 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.621004:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997539.621007:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997539.621011:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ee00, rc 0) 00000100:00100000:0.0:1789997539.622644:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49120:x1876946704478336:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 1910us (2278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997539.622668:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 821 00000100:00100000:1.0:1789997539.626719:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997539.626797:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704478464 00000100:00100000:2.0:1789997539.626808:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704478464 00000100:00100000:2.0:1789997539.626864:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 822 00000100:00100000:2.0:1789997539.626874:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49120:x1876946704478464:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997539.626894:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997539.626915:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cd42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed2f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.626972:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.626998:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627009:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627023:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627030:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627382:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627838:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cd57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627849:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cd57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627856:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cd57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997539.627885:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:2.0:1789997539.627889:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997539.627908:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cd57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627919:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627926:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627933:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627941:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997539.627945:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627952:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627963:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:2.0:1789997539.627966:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997539.627971:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627977:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592cd49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627986:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.627998:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.628004:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.628009:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997539.628011:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.628017:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.628024:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38d0bdf100) 00010000:00010000:2.0:1789997539.628026:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997539.628029:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.628035:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cd50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.628064:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cd42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed2f expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.628089:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cd57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed2f expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.628097:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997539.628100:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997539.628103:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789997539.628168:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49120:x1876946704478464:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 1295us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997539.628188:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 822 00000100:00100000:2.0:1789997539.630747:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997539.631242:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704478720 00000100:00100000:3.0:1789997539.631254:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704478720 00000100:00100000:0.0:1789997539.631758:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 823 00000100:00100000:0.0:1789997539.631772:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49120:x1876946704478720:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997539.631823:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997539.631847:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cd57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed2f expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.631863:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:0.0:1789997539.631875:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997539.631900:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.631913:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.631924:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997539.655455:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967611 is committed 00000004:00010000:0.0:1789997539.655523:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002aac3062 reply state 000000000e0de859 transno 4294967611 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997539.655537:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997539.655553:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00080000:0.0:1789997539.655727:0:5812:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997539.655748:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49120:x1876946704478720:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 23976us (25002us total) trans 4294967611 rc 0/0 00000100:00100000:0.0:1789997539.655757:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 823 00010000:00010000:0.0:1789997539.655796:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.655806:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.655819:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.655825:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997539.655830:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.655838:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.655853:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9600) 00010000:00010000:0.0:1789997539.655856:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997539.655861:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.655868:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997539.695405:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997539.695605:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704478848 00000100:00100000:3.0:1789997539.695616:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704478848 00000100:00100000:0.0:1789997539.695779:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 824 00000100:00100000:0.0:1789997539.695793:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49124:x1876946704478848:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997539.695817:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997539.695838:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed36 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.695895:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.695909:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.695924:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.695937:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.695944:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.695967:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696267:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cd7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696276:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696283:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997539.696310:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789997539.696315:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997539.696336:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cd7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696347:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696354:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696365:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696371:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997539.696375:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696382:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696392:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997539.696395:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997539.696399:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696405:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cd6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696416:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696423:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696428:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696434:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997539.696437:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696447:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696454:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38c28e9600) 00010000:00010000:0.0:1789997539.696456:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997539.696459:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696464:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cd73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696493:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cd65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed36 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696506:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cd7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed36 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.696513:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997539.696516:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997539.696518:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660f800, rc 0) 00000100:00100000:0.0:1789997539.696624:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49124:x1876946704478848:12345-192.168.204.4@tcp:101:touch.0 Request processed in 835us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997539.696640:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 824 00000100:00100000:0.0:1789997539.699300:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997539.699345:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704479104 00000100:00100000:1.0:1789997539.699355:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704479104 00000100:00100000:1.0:1789997539.699458:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 825 00000100:00100000:1.0:1789997539.699469:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49124:x1876946704479104:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997539.699488:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997539.699508:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592cd81 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed3d expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.699952:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.699969:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.699982:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.700045:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.700054:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.700061:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997539.700822:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:1.0:1789997539.701071:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cd96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701084:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cd96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701093:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cd96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701128:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701136:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701142:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701148:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997539.701152:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701159:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701184:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:1.0:1789997539.701187:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997539.701192:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701201:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592cd88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997539.701213:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3f68f08 reply state 00000000a260c531 transno 4294967612 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997539.701222:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997539.701255:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592cd81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed3d expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701270:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cd96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed3d expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.701277:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997539.701279:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997539.701281:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:1.0:1789997539.701354:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49124:x1876946704479104:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1887us (2061us total) trans 4294967612 rc 0/0 00000100:00100000:1.0:1789997539.701363:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 825 00010000:00010000:0.0:1789997539.703225:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.703240:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.703248:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.703255:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997539.703259:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.703267:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.703282:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38e062da00) 00010000:00010000:0.0:1789997539.703285:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997539.703290:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.703296:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592cd8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997539.705576:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997539.705772:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704479360 00000100:00100000:3.0:1789997539.705783:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704479360 00000100:00100000:3.0:1789997539.705909:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 826 00000100:00100000:3.0:1789997539.705921:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49124:x1876946704479360:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:3.0:1789997539.705977:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997539.706001:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cd96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed3d expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997539.706021:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:3.0:1789997539.706032:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997539.706090:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997539.706105:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997539.706116:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997539.706281:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000cea4d35 reply state 000000005fcfa8f5 transno 4294967613 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997539.706295:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997539.706437:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49124:x1876946704479360:12345-192.168.204.4@tcp:36:touch.0 Request processed in 518us (869us total) trans 4294967613 rc 0/0 00000100:00100000:3.0:1789997539.706445:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 826 00010000:00010000:2.0:1789997539.707988:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.708003:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.708010:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.708016:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997539.708020:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.708028:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.708040:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:2.0:1789997539.708043:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997539.708048:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.708054:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cda4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997539.708300:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997539.708404:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704479488 00000100:00100000:3.0:1789997539.708411:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704479488 00000100:00100000:3.0:1789997539.708457:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 827 00000100:00100000:3.0:1789997539.708595:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49124:x1876946704479488:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997539.708619:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997539.708633:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cdab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed44 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997539.708778:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cdab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed44 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997539.708885:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cdab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed44 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997539.708901:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997539.708903:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997539.708905:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997539.708957:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49124:x1876946704479488:12345-192.168.204.4@tcp:101:touch.0 Request processed in 492us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997539.708964:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 827 00000100:00100000:1.0:1789997539.713288:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997539.713380:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704479616 00000100:00100000:3.0:1789997539.713392:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704479616 00000100:00100000:3.0:1789997539.713489:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 435 00000100:00100000:3.0:1789997539.713498:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876946704479616:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:3.0:1789997539.713531:0:6659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1728 last 0 00000020:00000080:3.0:1789997539.713559:0:6659:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592cdb2 00002000:00100000:3.0:1789997539.713572:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a38c859b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789997539.713600:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789997539.713873:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789997539.713901:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c859c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789997539.713971:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704479616:12345-192.168.204.4@tcp:8:touch.0 Request processed in 472us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997539.713979:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 435 00000100:00100000:2.0:1789997539.716162:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997539.716400:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704479744 00000100:00100000:0.0:1789997539.716409:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704479744 00000100:00100000:0.0:1789997539.716521:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 436 00000100:00100000:0.0:1789997539.716534:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:0:x1876946704479744:12345-192.168.204.4@tcp:2:touch.0 00000100:00080000:2.0:1789997539.716904:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789997539.746011:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967348 is committed 00000001:00100000:3.0:1789997539.746035:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:1.0:1789997539.746148:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:0:x1876946704479744:12345-192.168.204.4@tcp:2:touch.0 Request processed in 29612us (29987us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789997539.746159:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 436 00000100:00100000:0.0:1789997539.748896:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997539.748954:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704480000 00000100:00100000:3.0:1789997539.748965:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704480000 00000100:00100000:3.0:1789997539.749155:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:3.0:1789997539.749166:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49124:x1876946704480000:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:3.0:1789997539.749522:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49124:x1876946704480000:12345-192.168.204.4@tcp:35:touch.0 Request processed in 357us (634us total) trans 4294967614 rc 0/0 00000100:00100000:3.0:1789997539.749530:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 86 00000100:00100000:3.0:1789997539.781117:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997539.783354:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704480128 00000100:00100000:2.0:1789997539.783368:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704480128 00000100:00100000:2.0:1789997539.783584:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 828 00000100:00100000:2.0:1789997539.783598:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49128:x1876946704480128:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997539.783637:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997539.783675:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cdb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed4b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783749:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783764:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783776:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783791:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783798:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783805:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783913:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cdce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783922:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cdce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.783933:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cdce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997539.783966:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00000004:00200000:2.0:1789997539.783970:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997539.783990:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cdce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784001:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cdce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784009:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784016:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784023:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784029:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997539.784033:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784041:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784053:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:2.0:1789997539.784057:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997539.784062:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784072:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784085:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784090:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784096:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784101:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997539.784105:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784110:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784117:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38d0bdf100) 00010000:00010000:2.0:1789997539.784119:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997539.784122:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784127:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cdc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784183:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cdb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed4b expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784202:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cdce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed4b expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.784210:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:2.0:1789997539.784213:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997539.784215:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997539.784288:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49128:x1876946704480128:12345-192.168.204.4@tcp:101:rm.0 Request processed in 693us (3182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997539.784295:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 828 00000100:00100000:1.0:1789997539.787546:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997539.787625:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704480256 00000100:00100000:3.0:1789997539.787635:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704480256 00000100:00100000:3.0:1789997539.787781:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 437 00000100:00100000:3.0:1789997539.787792:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704480256:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997539.787813:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997539.787835:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed52 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997539.787863:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6ab131e3, atime: 0x6ab131e3, ctime: 0x6ab131e3, blocks: 0x1 00010000:00010000:3.0:1789997539.787883:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=1728s v=(0 0) 00010000:00010000:3.0:1789997539.787887:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997539.787897:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997539.787916:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997539.787929:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997539.787984:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704480256:12345-192.168.204.4@tcp:101:rm.0 Request processed in 193us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997539.788123:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 437 00000100:00100000:0.0:1789997539.791698:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997539.791800:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704480512 00000100:00100000:2.0:1789997539.791821:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704480512 00000100:00100000:2.0:1789997539.791881:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 829 00000100:00100000:2.0:1789997539.791892:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49128:x1876946704480512:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997539.791951:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997539.791996:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592cdce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed4b expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792021:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592cdab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed44 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792040:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:2.0:1789997539.792051:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997539.792072:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792085:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792097:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792116:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792123:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792141:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792252:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792261:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792268:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997539.792882:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 64 off9856 00000004:00080000:2.0:1789997539.792891:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1728485236751ns, next at 1729485234262ns, rc = 0 00010000:00010000:2.0:1789997539.792933:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792940:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792947:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792952:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792959:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792963:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.792983:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997539.792997:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793001:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793005:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793009:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997539.793012:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793017:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793022:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997539.793024:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997539.793027:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793031:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592cdea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793041:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793046:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793049:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793052:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997539.793053:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793057:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793060:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:2.0:1789997539.793061:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997539.793063:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997539.793066:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592cddc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997539.793071:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0ec983d reply state 00000000794fa16e transno 4294967615 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997539.793076:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997539.793137:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49128:x1876946704480512:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1246us (1447us total) trans 4294967615 rc 0/0 00000100:00100000:2.0:1789997539.793145:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 829 00010000:00010000:1.0:1789997539.793340:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997539.793348:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.793360:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997539.793363:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.793369:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.793379:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:1.0:1789997539.793382:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997539.793394:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.793399:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592cdf1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997539.793413:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997539.793415:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997539.793417:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997539.795308:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.795328:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.795336:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.795342:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997539.795346:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.795352:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.795379:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38d0bdf100) 00010000:00010000:0.0:1789997539.795383:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997539.795387:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997539.795394:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592cde3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997540.106751:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997540.412378:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997540.413366:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704480640 00000100:00100000:2.0:1789997540.413501:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704480640 00000100:00100000:2.0:1789997540.413577:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 830 00000100:00100000:2.0:1789997540.413589:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49144:x1876946704480640:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997540.413616:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997540.413636:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592cdf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed59 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.413716:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cdff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.413731:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cdff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.413746:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cdff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997540.413780:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:2.0:1789997540.413785:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997540.413805:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cdff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.413831:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592cdf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed59 expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.413847:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cdff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed59 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.413856:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:2.0:1789997540.413859:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997540.413864:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3000, rc 0) 00000100:00100000:2.0:1789997540.413937:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49144:x1876946704480640:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 349us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997540.413946:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 830 00000100:00100000:2.0:1789997540.418748:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997540.418837:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704480896 00000100:00100000:3.0:1789997540.418848:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704480896 00000100:00100000:3.0:1789997540.418907:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 831 00000100:00100000:3.0:1789997540.418917:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49144:x1876946704480896:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997540.418973:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997540.419001:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cdff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed59 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.419023:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cd7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed36 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.419036:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:3.0:1789997540.419046:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997540.419070:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.419085:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.419094:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997540.453038:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967612 is committed 00000001:00080000:1.0:1789997540.453055:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967615 is committed 00000004:00080000:1.0:1789997540.453059:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 74 committed 00000001:00080000:1.0:1789997540.453081:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967616 is committed 00000100:00100000:0.0:1789997540.453213:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997540.453235:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712980480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997540.453315:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997540.453475:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712980480 00000100:00100000:2.0:1789997540.453483:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712980480 00000100:00100000:2.0:1789997540.453552:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1789997540.453563:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712980480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789997540.453589:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:26 count 1 00010000:00010000:2.0:1789997540.453614:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.453635:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.453645:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789997540.453650:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997540.453682:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.453711:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.453726:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 5 pid: 6658 timeout: 1829 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997540.453738:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712980608:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997540.453811:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee505780 going to sleep for 11 seconds 00000100:00080000:0.0:1789997540.453863:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00010000:3.0:1789997540.453945:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000594c7373 reply state 00000000abaf1160 transno 4294967616 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997540.453955:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997540.453967:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00080000:3.0:1789997540.454066:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997540.454087:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49144:x1876946704480896:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 35171us (35346us total) trans 4294967616 rc 0/0 00000100:00100000:3.0:1789997540.454154:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 831 00010000:00010000:2.0:1789997540.455595:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.455610:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.455617:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.455623:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.455628:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.455637:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.455671:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49e700) 00010000:00010000:2.0:1789997540.455675:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997540.455682:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.455688:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592ce06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997540.465578:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712980608:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997540.465608:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997540.465755:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997540.465836:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704481024 00000100:00100000:3.0:1789997540.465843:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704481024 00010000:00010000:3.0:1789997540.465878:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 6 pid: 6658 timeout: 1829 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997540.465956:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 371 00000100:00100000:3.0:1789997540.465968:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704481024:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997540.465982:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997540.465989:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 6 pid: 6658 timeout: 1829 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.466001:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 6 pid: 6658 timeout: 1829 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.466026:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000796ada4e/0x65b43101d592cdd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed52 expref: 6 pid: 6658 timeout: 1829 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.466039:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997540.466044:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997540.466049:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.466059:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.466091:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997540.466144:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704481024:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 178us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997540.466151:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 371 00010000:00010000:1.0:1789997540.466215:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.466224:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.466234:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.466242:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.466262:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789997540.466951:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712980480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13389us (13634us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789997540.466961:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000004:00080000:0.0:1789997540.467100:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fadf0e00/2, rc 0, transno 4294967349 00000100:00100000:0.0:1789997540.467108:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712980480:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789997540.467544:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997540.467553:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.467564:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997540.467569:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.467581:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.467599:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.467606:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cb882fe/0x65b43101d592ce0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.467624:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997540.467626:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997540.467628:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997540.504911:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997540.505200:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704481152 00000100:00100000:2.0:1789997540.505212:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704481152 00000100:00100000:2.0:1789997540.505273:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 832 00000100:00100000:2.0:1789997540.505285:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49148:x1876946704481152:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997540.505310:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997540.505332:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed60 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505393:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505409:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505421:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505438:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505445:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505453:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505799:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ce29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505809:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505817:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997540.505844:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:2.0:1789997540.505849:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997540.505868:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ce29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505884:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505891:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505898:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505904:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.505908:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505916:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505927:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:2.0:1789997540.505930:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997540.505935:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505942:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505951:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505957:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505963:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505968:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.505971:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505977:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505984:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997540.505986:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997540.505989:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.505994:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.506022:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed60 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.506036:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ce29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed60 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.506043:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997540.506046:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997540.506048:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2200, rc 0) 00000100:00100000:2.0:1789997540.506111:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49148:x1876946704481152:12345-192.168.204.4@tcp:101:touch.0 Request processed in 829us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997540.506119:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 832 00000100:00100000:0.0:1789997540.510582:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997540.510694:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704481408 00000100:00100000:1.0:1789997540.510705:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704481408 00000100:00100000:1.0:1789997540.510756:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 833 00000100:00100000:1.0:1789997540.510767:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49148:x1876946704481408:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997540.510789:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997540.510919:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592ce30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed67 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.511281:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.511297:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.511309:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.511328:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.511336:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.511345:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997540.513899:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:1.0:1789997540.514638:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592ce45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514689:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592ce45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514703:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592ce45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514785:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514791:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514796:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514800:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997540.514803:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514820:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514836:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:1.0:1789997540.514839:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997540.514845:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514852:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592ce37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997540.514864:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8c8e724 reply state 00000000d5b3e79b transno 4294967617 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997540.514874:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997540.514912:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592ce30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed67 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514933:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592ce45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed67 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.514941:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:1.0:1789997540.514944:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997540.514957:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997540.515035:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49148:x1876946704481408:12345-192.168.204.4@tcp:101:touch.0 Request processed in 4271us (4462us total) trans 4294967617 rc 0/0 00000100:00100000:1.0:1789997540.515044:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 833 00010000:00010000:2.0:1789997540.520217:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.520237:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.520245:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.520252:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.520257:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.520265:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.520281:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38e062d100) 00010000:00010000:2.0:1789997540.520284:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997540.520289:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.520295:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592ce3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997540.525197:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997540.525338:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704481664 00000100:00100000:2.0:1789997540.525348:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704481664 00000100:00100000:2.0:1789997540.525414:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 834 00000100:00100000:2.0:1789997540.525426:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49148:x1876946704481664:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:2.0:1789997540.525484:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997540.525511:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592ce45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed67 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.525535:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:2.0:1789997540.525546:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997540.525587:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.525599:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.525609:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997540.525786:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000253c56fb reply state 0000000089699eeb transno 4294967618 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997540.525796:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997540.525884:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49148:x1876946704481664:12345-192.168.204.4@tcp:36:touch.0 Request processed in 460us (697us total) trans 4294967618 rc 0/0 00000100:00100000:2.0:1789997540.525892:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 834 00010000:00010000:3.0:1789997540.528302:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.528379:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997540.528533:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:3.0:1789997540.528591:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.528602:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997540.528606:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.528615:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.528703:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997540.528708:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789997540.528809:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704481792 00000100:00100000:1.0:1789997540.528819:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704481792 00000100:00100000:1.0:1789997540.528876:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 835 00000100:00100000:1.0:1789997540.528887:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49148:x1876946704481792:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997540.528909:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997540.528928:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592ce5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed6e expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.529014:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592ce5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed6e expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.529039:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592ce5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed6e expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.529059:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:1.0:1789997540.529063:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789997540.529066:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997540.529116:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49148:x1876946704481792:12345-192.168.204.4@tcp:101:touch.0 Request processed in 231us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997540.529124:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 835 00010000:00010000:3.0:1789997540.529221:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.529230:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592ce53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997540.531561:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997540.531595:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704481920 00000100:00100000:1.0:1789997540.531604:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704481920 00000100:00100000:1.0:1789997540.531738:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 439 00000100:00100000:1.0:1789997540.531747:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876946704481920:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:1.0:1789997540.531780:0:6659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1729 last 0 00000020:00000080:1.0:1789997540.531816:0:6659:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592ce61 00002000:00100000:1.0:1789997540.531828:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a37c804d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789997540.531852:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789997540.532103:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789997540.532133:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a37c8048000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789997540.532215:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704481920:12345-192.168.204.4@tcp:8:touch.0 Request processed in 467us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997540.532237:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 439 00000100:00100000:0.0:1789997540.533581:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997540.533724:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704482048 00000100:00100000:1.0:1789997540.533732:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704482048 00000100:00080000:0.0:1789997540.533781:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997540.533846:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 440 00000100:00100000:1.0:1789997540.533856:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:0:x1876946704482048:12345-192.168.204.4@tcp:2:touch.0 00000001:00080000:1.0:1789997540.568879:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000001:00100000:1.0:1789997540.568894:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:3.0:1789997540.569017:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:0:x1876946704482048:12345-192.168.204.4@tcp:2:touch.0 Request processed in 35156us (35435us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789997540.569030:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 440 00000100:00100000:0.0:1789997540.570897:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997540.570945:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704482304 00000100:00100000:3.0:1789997540.570954:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704482304 00000100:00100000:3.0:1789997540.571005:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:3.0:1789997540.571014:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de235850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49148:x1876946704482304:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:3.0:1789997540.571401:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de235850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49148:x1876946704482304:12345-192.168.204.4@tcp:35:touch.0 Request processed in 387us (510us total) trans 4294967619 rc 0/0 00000100:00100000:3.0:1789997540.571406:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 87 00000100:00100000:0.0:1789997540.603796:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997540.603853:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704482432 00000100:00100000:2.0:1789997540.603864:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704482432 00000100:00100000:2.0:1789997540.603919:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 836 00000100:00100000:2.0:1789997540.603930:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49152:x1876946704482432:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997540.603964:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997540.603984:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed75 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604049:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604068:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604079:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604094:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604101:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604107:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604198:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592ce7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604206:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604223:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997540.604252:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x45:0x0]: returning size 0 00000004:00200000:2.0:1789997540.604255:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997540.604268:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604277:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604292:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604296:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604300:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604304:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.604307:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604312:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604319:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997540.604321:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997540.604324:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604328:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604336:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604340:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604343:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604347:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.604349:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604352:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604355:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997540.604357:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997540.604358:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604361:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604380:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed75 expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604388:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592ce7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed75 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.604392:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997540.604393:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997540.604395:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3800, rc 0) 00000100:00100000:2.0:1789997540.604442:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49152:x1876946704482432:12345-192.168.204.4@tcp:101:rm.0 Request processed in 514us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997540.604449:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 836 00000100:00100000:0.0:1789997540.607858:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997540.607971:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704482560 00000100:00100000:3.0:1789997540.607981:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704482560 00000100:00100000:3.0:1789997540.608076:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 441 00000100:00100000:3.0:1789997540.608089:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704482560:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997540.608112:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997540.608132:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed7c expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997540.608171:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6ab131e4, atime: 0x6ab131e4, ctime: 0x6ab131e4, blocks: 0x1 00010000:00010000:3.0:1789997540.608191:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=1729s v=(0 0) 00010000:00010000:3.0:1789997540.608196:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997540.608205:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.608225:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997540.608238:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997540.608316:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704482560:12345-192.168.204.4@tcp:101:rm.0 Request processed in 229us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997540.608323:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 441 00000100:00100000:0.0:1789997540.611566:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997540.611859:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704482816 00000100:00100000:2.0:1789997540.611871:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704482816 00000100:00100000:2.0:1789997540.611928:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 837 00000100:00100000:2.0:1789997540.612014:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49152:x1876946704482816:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997540.612086:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997540.612184:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592ce7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed75 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612207:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592ce5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x45:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed6e expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612217:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997540.612229:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997540.612250:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612263:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612273:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612287:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612294:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612363:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612527:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612537:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.612544:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997540.613129:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].26, 64 off9856 00000004:00080000:2.0:1789997540.613140:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1729305485703ns, next at 1730305483222ns, rc = 0 00010000:00010000:2.0:1789997540.613209:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613219:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613228:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613235:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613242:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613248:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613274:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997540.613293:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613300:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613316:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613322:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.613326:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613334:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613343:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997540.613346:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997540.613351:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613357:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592ce99 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613373:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613380:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613386:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613400:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.613403:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613413:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613421:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997540.613424:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997540.613427:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.613433:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592ce8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997540.613443:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6d88b5c reply state 00000000b25839f6 transno 4294967620 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997540.613452:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997540.613538:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49152:x1876946704482816:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1599us (1976us total) trans 4294967620 rc 0/0 00000100:00100000:2.0:1789997540.613549:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 837 00010000:00010000:1.0:1789997540.613870:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997540.613876:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.613884:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997540.613887:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.613893:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.613904:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:1.0:1789997540.613906:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997540.613909:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.613915:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cea0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997540.613931:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997540.613933:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997540.613934:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997540.616196:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.616212:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.616220:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.616226:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997540.616230:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.616243:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.616257:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997540.616261:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997540.616266:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997540.616273:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592ce92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997540.811498:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712981120:0@lo:400:kworker.0 00000100:00100000:0.0:1789997540.811498:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712980736:0@lo:400:kworker.0 00000100:00100000:2.0:1789997540.811572:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712980864:0@lo:400:kworker.0 00000100:00100000:1.0:1789997540.811607:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712980992:0@lo:400:kworker.0 00000100:00100000:3.0:1789997540.811616:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997540.811616:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997540.811699:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712981120 00000100:00100000:3.0:1789997540.811706:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712981120 00000100:00100000:2.0:1789997540.811736:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712980864 00000100:00100000:3.0:1789997540.811772:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1789997540.811782:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712981120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997540.811968:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712980864 00000100:00100000:2.0:1789997540.812019:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1789997540.812033:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712980864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997540.812235:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997540.812241:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997540.812253:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712981120:12345-0@lo:400:kworker.0 Request processed in 470us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997540.812263:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:0.0:1789997540.812282:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712981248:0@lo:400:kworker.0 00000100:00100000:3.0:1789997540.812312:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712981120:0@lo:400:kworker.0 00000100:00100000:2.0:1789997540.812312:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712980864:12345-0@lo:400:kworker.0 Request processed in 286us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997540.812337:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712980992 00000100:00100000:1.0:1789997540.812342:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712980992 00000100:00100000:3.0:1789997540.812389:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712980864:0@lo:400:kworker.0 00000100:00080000:3.0:1789997540.812412:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997540.812416:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997540.812430:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712980736 00000100:00100000:3.0:1789997540.812434:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712980736 00000100:00100000:3.0:1789997540.812458:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1789997540.812458:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1789997540.812465:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712980736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997540.812470:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1789997540.812476:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712980992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997540.812493:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712980736:12345-0@lo:400:kworker.0 Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997540.812499:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1789997540.812521:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712980992:12345-0@lo:400:kworker.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997540.812528:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:3.0:1789997540.812551:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712980992:0@lo:400:kworker.0 00000100:00100000:0.0:1789997540.812896:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997540.812932:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712980736:0@lo:400:kworker.0 00000100:00100000:3.0:1789997540.812936:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712981248 00000100:00100000:3.0:1789997540.812940:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712981248 00000100:00100000:3.0:1789997540.812979:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1789997540.812985:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712981248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997540.813025:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712981248:12345-0@lo:400:kworker.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997540.813038:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00080000:1.0:1789997540.813095:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997540.813254:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712981248:0@lo:400:kworker.0 00010000:00010000:0.0:1789997541.132045:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997541.144592:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.145188:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704482944 00000100:00100000:3.0:1789997541.145199:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704482944 00000100:00100000:3.0:1789997541.145270:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 838 00000100:00100000:3.0:1789997541.145281:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49166:x1876946704482944:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997541.145306:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1789997541.145326:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997541.145327:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed83 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.145391:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ceae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.145406:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ceae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.145419:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ceae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997541.145455:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789997541.145460:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997541.145480:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ceae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.145504:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed83 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.145521:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ceae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed83 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.145530:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:3.0:1789997541.145532:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997541.145537:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997541.145607:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49166:x1876946704482944:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 327us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997541.145614:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 838 00000100:00100000:0.0:1789997541.151009:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997541.151220:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704483200 00000100:00100000:2.0:1789997541.151230:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704483200 00000100:00100000:2.0:1789997541.151287:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 839 00000100:00100000:2.0:1789997541.151296:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49166:x1876946704483200:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997541.151347:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997541.151372:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ceae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed83 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.151450:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592ce29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed60 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.151461:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997541.151470:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997541.151492:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.151504:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.151513:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997541.153126:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042dda4e9 reply state 00000000a9ea0800 transno 4294967621 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997541.153156:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997541.153169:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:2.0:1789997541.153274:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49166:x1876946704483200:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 1975us (2271us total) trans 4294967621 rc 0/0 00000100:00100000:2.0:1789997541.153283:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 839 00010000:00010000:3.0:1789997541.158336:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.158355:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.158363:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.158369:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997541.158429:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.158439:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.158455:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:3.0:1789997541.158458:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997541.158465:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.158471:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592ceb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997541.221326:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997541.221491:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704483328 00000100:00100000:2.0:1789997541.221501:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704483328 00000100:00100000:2.0:1789997541.221591:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 840 00000100:00100000:2.0:1789997541.221602:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49178:x1876946704483328:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997541.221854:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49178:x1876946704483328:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 253us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997541.221863:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 840 00000100:00100000:0.0:1789997541.223615:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997541.223816:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704483456 00000100:00100000:1.0:1789997541.223823:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704483456 00000100:00100000:1.0:1789997541.223905:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 442 00000100:00100000:1.0:1789997541.223915:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49178:x1876946704483456:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997541.224296:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49178:x1876946704483456:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 381us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997541.224304:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 442 00000100:00100000:0.0:1789997541.225997:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.226034:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704483584 00000100:00100000:3.0:1789997541.226041:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704483584 00000100:00100000:3.0:1789997541.226112:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 443 00000100:00100000:3.0:1789997541.226121:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49178:x1876946704483584:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:1.0:1789997541.226192:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997541.226496:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49178:x1876946704483584:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 376us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997541.226504:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 443 00000100:00100000:0.0:1789997541.228121:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997541.228491:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704483712 00000100:00100000:2.0:1789997541.228499:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704483712 00000100:00100000:2.0:1789997541.228553:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 841 00000100:00100000:2.0:1789997541.228563:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49178:x1876946704483712:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997541.229335:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49178:x1876946704483712:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 770us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997541.229344:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 841 00000100:00100000:0.0:1789997541.233353:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.233730:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704483840 00000100:00100000:3.0:1789997541.233740:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704483840 00000100:00100000:3.0:1789997541.233807:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 842 00000100:00100000:3.0:1789997541.233817:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49178:x1876946704483840:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997541.233906:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49178:x1876946704483840:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 90us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997541.233913:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 842 00000100:00100000:0.0:1789997541.235644:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.235706:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704483968 00000100:00100000:3.0:1789997541.235714:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704483968 00000100:00100000:3.0:1789997541.235763:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 444 00000100:00100000:3.0:1789997541.235772:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49178:x1876946704483968:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997541.236287:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49178:x1876946704483968:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 395us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997541.236298:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 444 00000100:00100000:0.0:1789997541.238100:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.238160:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704484096 00000100:00100000:3.0:1789997541.238177:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704484096 00000100:00100000:3.0:1789997541.238345:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 445 00000100:00100000:3.0:1789997541.238356:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49178:x1876946704484096:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997541.238834:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49178:x1876946704484096:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 477us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997541.238843:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 445 00000100:00100000:0.0:1789997541.240481:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.240633:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704484224 00000100:00100000:3.0:1789997541.240642:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704484224 00000100:00100000:3.0:1789997541.240723:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 843 00000100:00100000:3.0:1789997541.240733:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49178:x1876946704484224:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997541.241360:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49178:x1876946704484224:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 625us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997541.241529:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 843 00000100:00100000:0.0:1789997541.280995:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.281507:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704484352 00000100:00100000:3.0:1789997541.281541:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704484352 00000100:00100000:3.0:1789997541.281604:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 844 00000100:00100000:3.0:1789997541.281614:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49182:x1876946704484352:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:3.0:1789997541.281636:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997541.281680:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed8a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.281735:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.281749:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.281761:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.281775:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.281782:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.281789:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282039:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592ced1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282049:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592ced1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282056:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592ced1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997541.282087:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:3.0:1789997541.282092:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997541.282111:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592ced1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282122:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282128:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282135:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282152:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997541.282156:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282163:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282187:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:3.0:1789997541.282190:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997541.282194:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282201:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282213:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282223:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282229:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282233:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997541.282236:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282241:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282247:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38ee49e300) 00010000:00010000:3.0:1789997541.282249:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997541.282252:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282258:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592ceca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282287:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed8a expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282300:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592ced1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed8a expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.282307:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997541.282309:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997541.282312:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997541.282411:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49182:x1876946704484352:12345-192.168.204.4@tcp:101:dd.0 Request processed in 784us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997541.282420:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 844 00000100:00100000:0.0:1789997541.286373:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.286495:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704484608 00000100:00100000:3.0:1789997541.286507:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704484608 00000100:00100000:3.0:1789997541.286610:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 845 00000100:00100000:3.0:1789997541.286622:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49182:x1876946704484608:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:3.0:1789997541.286642:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997541.286737:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592ced8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed91 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.286986:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.287002:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.287033:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.287077:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.287093:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.287100:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997541.287834:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:3.0:1789997541.288010:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ceed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288021:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ceed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288030:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ceed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288063:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288071:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288077:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288083:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997541.288087:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288094:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288106:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997541.288109:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997541.288114:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288119:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cedf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997541.288137:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc9429f4 reply state 00000000fa3a8117 transno 4294967622 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997541.288158:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997541.288187:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592ced8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed91 expref: 15 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288201:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ceed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed91 expref: 14 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.288209:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997541.288212:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997541.288214:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997541.288290:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+15:49182:x1876946704484608:12345-192.168.204.4@tcp:101:dd.0 Request processed in 1670us (1925us total) trans 4294967622 rc 0/0 00000100:00100000:3.0:1789997541.288299:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 845 00010000:00010000:2.0:1789997541.290470:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.290486:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.290494:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.290500:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997541.290504:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.290516:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.290531:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38ee49ee00) 00010000:00010000:2.0:1789997541.290533:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997541.290539:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.290545:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592cee6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997541.293434:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997541.293596:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704484736 00000100:00100000:1.0:1789997541.293608:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704484736 00000100:00100000:1.0:1789997541.293697:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 446 00000100:00100000:1.0:1789997541.293709:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49182:x1876946704484736:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997541.293727:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997541.293749:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed98 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997541.293775:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789997541.293807:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=1729s v=(0 0) 00010000:00010000:1.0:1789997541.293812:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997541.293822:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997541.293841:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997541.293853:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997541.293915:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49182:x1876946704484736:12345-192.168.204.4@tcp:101:dd.0 Request processed in 209us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997541.293922:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 446 00000100:00100000:0.0:1789997541.307458:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997541.307535:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704484864 00000100:00100000:2.0:1789997541.307546:0:6664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704484864 00002000:00100000:2.0:1789997541.307598:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (0->1048575) req@ffff8a38f9b44000 x1876946704484864/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:517/0 lens 488/0 e 0 to 0 dl 1789997552 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997541.307609:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f9b44000 with x1876946704484864 ext(0->1048575) 00002000:00010000:2.0:1789997541.307615:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38f9b44000 00000100:00100000:2.0:1789997541.307649:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:2.0:1789997541.307699:0:6664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704484864:12345-192.168.204.4@tcp:4:dd.0 00000100:00100000:2.0:1789997541.319043:0:6664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704484864:12345-192.168.204.4@tcp:4:dd.0 Request processed in 11333us (11587us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789997541.319058:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00002000:00100000:2.0:1789997541.319071:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (0->1048575) req@ffff8a38f9b44000 x1876946704484864/t4294967350(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:517/0 lens 488/448 e 0 to 0 dl 1789997552 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997541.319082:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f9b44000 with x1876946704484864 ext(0->1048575) 00002000:00010000:2.0:1789997541.319088:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38f9b44000 00000100:00100000:0.0:1789997541.321803:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997541.321903:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704484992 00000100:00100000:2.0:1789997541.321915:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704484992 00000100:00100000:2.0:1789997541.322009:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 846 00000100:00100000:2.0:1789997541.322018:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:49182:x1876946704484992:12345-192.168.204.4@tcp:44:dd.0 00000001:00080000:1.0:1789997541.350569:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967617 is committed 00000001:00080000:1.0:1789997541.350585:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967621 is committed 00000004:00080000:1.0:1789997541.350592:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 72 committed 00000001:00080000:1.0:1789997541.350614:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967622 is committed 00000100:00100000:1.0:1789997541.350768:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712981376:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789997541.350836:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997541.350922:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712981376 00000100:00100000:1.0:1789997541.350931:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712981376 00000100:00100000:1.0:1789997541.350981:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789997541.351131:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49182:x1876946704484992:12345-192.168.204.4@tcp:44:dd.0 Request processed in 29110us (29373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997541.351152:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 846 00000100:00100000:1.0:1789997541.351216:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712981376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789997541.351243:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:26 count 1 00010000:00010000:1.0:1789997541.351269:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997541.351290:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997541.351299:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789997541.351304:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997541.351309:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997541.351336:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997541.351351:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 5 pid: 6658 timeout: 1830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997541.351363:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712981504:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997541.351471:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997541.354158:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712981504:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997541.354199:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997541.354647:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.354892:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704485120 00000100:00100000:3.0:1789997541.354900:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704485120 00000100:00100000:3.0:1789997541.354954:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 448 00000100:00100000:3.0:1789997541.354963:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704485120:12345-192.168.204.4@tcp:16:dd.0 00000100:00100000:0.0:1789997541.358813:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.358874:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704485248 00000100:00100000:3.0:1789997541.358885:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704485248 00010000:00010000:3.0:1789997541.359081:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 6 pid: 6658 timeout: 1830 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997541.359134:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 372 00000100:00100000:3.0:1789997541.359159:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704485248:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997541.359176:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997541.359182:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 6 pid: 6658 timeout: 1830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.359198:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 6 pid: 6658 timeout: 1830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.359222:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d597c86c/0x65b43101d592ce84 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed7c expref: 6 pid: 6658 timeout: 1830 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.359240:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997541.359244:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997541.359250:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.359261:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997541.359295:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997541.359355:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704485248:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 198us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997541.359363:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 372 00010000:00010000:0.0:1789997541.359520:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997541.359530:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997541.359541:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997541.359549:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997541.359569:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997541.359903:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997541.359912:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.359923:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997541.359927:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.359938:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.359951:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.359959:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592cf02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997541.359977:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997541.359979:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997541.359980:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997541.361338:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712981376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10343us (10497us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789997541.361350:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000004:00080000:2.0:1789997541.361499:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38ffd72d80/2, rc 0, transno 4294967349 00000100:00100000:2.0:1789997541.361508:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712981376:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789997541.387613:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967349 is committed 00000001:00080000:0.0:1789997541.387642:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00000100:00100000:1.0:1789997541.387884:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704485120:12345-192.168.204.4@tcp:16:dd.0 Request processed in 32915us (33232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997541.387896:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 448 00000100:00100000:0.0:1789997541.391857:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997541.392102:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704485504 00000100:00100000:3.0:1789997541.392112:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704485504 00000100:00100000:3.0:1789997541.392182:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 88 00000100:00100000:3.0:1789997541.392193:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49182:x1876946704485504:12345-192.168.204.4@tcp:35:dd.0 00000100:00100000:2.0:1789997541.393185:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49182:x1876946704485504:12345-192.168.204.4@tcp:35:dd.0 Request processed in 987us (1332us total) trans 4294967623 rc 0/0 00000100:00100000:2.0:1789997541.393196:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 88 00000001:00080000:1.0:1789997542.105806:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967623 is committed 00010000:00010000:1.0:1789997542.160171:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997542.680596:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997542.680640:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997542.680774:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997542.680804:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997542.680805:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704486016 00000100:00100000:3.0:1789997542.680816:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704486016 00000100:00100000:1.0:1789997542.680826:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704485632 00000100:00100000:1.0:1789997542.680829:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704485632 00000100:00100000:1.0:1789997542.680865:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1057 00000100:00100000:1.0:1789997542.680876:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704485632:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997542.680944:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704485632:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 70us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997542.680952:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1057 00000100:00100000:2.0:1789997542.680962:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704485760 00000100:00100000:2.0:1789997542.680967:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704485760 00000100:00100000:2.0:1789997542.681010:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1259 00000100:00100000:2.0:1789997542.681020:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704485760:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997542.681061:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704485760:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997542.681068:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1259 00000100:00100000:1.0:1789997542.682524:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704485888 00000100:00100000:1.0:1789997542.682533:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704485888 00000100:00100000:1.0:1789997542.682579:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 798 00000100:00100000:1.0:1789997542.682588:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704486016:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997542.682633:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704486016:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997542.682640:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 798 00000100:00100000:1.0:1789997542.682678:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 799 00000100:00100000:1.0:1789997542.682685:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704485888:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997542.682710:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704485888:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997542.682715:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 799 00000100:00080000:2.0:1789997542.683675:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789997542.818188:0:83920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1731510531526ns, next at 1730305483222ns, rc = 0 00000004:00080000:0.0:1789997542.818287:0:83920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1731510632236ns, next at 1729485234262ns, rc = 0 00000004:00080000:1.0:1789997542.820178:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 75 committed 00000004:00080000:1.0:1789997542.820208:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 73 committed 00000100:00100000:3.0:1789997542.858913:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712981632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997542.858977:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997542.859063:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997542.859065:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712981632 00000100:00100000:3.0:1789997542.859070:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712981760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997542.859072:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712981632 00000100:00100000:3.0:1789997542.859094:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997542.859138:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712981760 00000100:00100000:2.0:1789997542.859144:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1789997542.859146:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712981760 00000100:00080000:0.0:1789997542.859151:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997542.859155:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712981632:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997542.859158:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997542.859177:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1789997542.859192:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712981760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997542.859192:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00002000:00000024:3.0:1789997542.859208:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997542.859420:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712981760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 227us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997542.859420:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712981632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 267us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997542.859430:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1789997542.859450:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712981760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997542.859459:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:0.0:1789997542.859462:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fadf0e00, transno 4294967349 00000100:00100000:0.0:1789997542.859474:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712981632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997542.860867:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00010000:00010000:1.0:1789997543.179087:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997543.546005:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000100:00100000:0.0:1789997543.615692:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997543.615895:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704486144 00000100:00100000:2.0:1789997543.615918:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704486144 00000100:00100000:2.0:1789997543.615989:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 847 00000100:00100000:2.0:1789997543.616000:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49374:x1876946704486144:12345-192.168.204.4@tcp:48:lfs.0 00000100:00080000:0.0:1789997543.616079:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997543.616090:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49374:x1876946704486144:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 91us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997543.616113:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 847 00000100:00100000:1.0:1789997543.618752:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997543.618858:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704486272 00000100:00100000:3.0:1789997543.618868:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704486272 00000100:00100000:3.0:1789997543.619004:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 449 00000100:00100000:3.0:1789997543.619016:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49374:x1876946704486272:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997543.619484:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49374:x1876946704486272:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 469us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997543.619492:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 449 00000100:00100000:3.0:1789997543.621548:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997543.621928:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704486400 00000100:00100000:0.0:1789997543.621939:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704486400 00000100:00080000:1.0:1789997543.622018:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997543.622106:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 450 00000100:00100000:0.0:1789997543.622133:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49374:x1876946704486400:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997543.622749:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49374:x1876946704486400:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 632us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997543.622767:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 450 00000100:00100000:1.0:1789997543.624311:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997543.624352:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704486528 00000100:00100000:2.0:1789997543.624360:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704486528 00000100:00100000:2.0:1789997543.624408:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 848 00000100:00100000:2.0:1789997543.624417:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49374:x1876946704486528:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997543.625227:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49374:x1876946704486528:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 809us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997543.625236:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 848 00000100:00100000:0.0:1789997543.629337:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997543.629505:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704486656 00000100:00100000:2.0:1789997543.629516:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704486656 00000100:00100000:2.0:1789997543.629585:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 849 00000100:00100000:2.0:1789997543.629602:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49374:x1876946704486656:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997543.629717:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49374:x1876946704486656:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 117us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997543.629725:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 849 00000100:00100000:3.0:1789997543.634163:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997543.636277:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704486784 00000100:00100000:0.0:1789997543.636291:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704486784 00000100:00100000:0.0:1789997543.636349:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 451 00000100:00100000:0.0:1789997543.636363:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49374:x1876946704486784:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997543.637117:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49374:x1876946704486784:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 756us (2963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997543.637126:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 451 00000100:00100000:3.0:1789997543.639878:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997543.639910:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704486912 00000100:00100000:3.0:1789997543.639919:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704486912 00000100:00100000:3.0:1789997543.639967:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 452 00000100:00100000:3.0:1789997543.639979:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49374:x1876946704486912:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997543.640388:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49374:x1876946704486912:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 409us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997543.640396:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 452 00000100:00100000:0.0:1789997543.643230:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997543.643316:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704487040 00000100:00100000:2.0:1789997543.643325:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704487040 00000100:00100000:2.0:1789997543.643510:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 850 00000100:00100000:2.0:1789997543.643524:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49374:x1876946704487040:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997543.644211:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49374:x1876946704487040:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 688us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997543.644220:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 850 00000100:00100000:2.0:1789997543.689810:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997543.689951:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704487296 00000100:00100000:3.0:1789997543.689961:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704487296 00000100:00100000:3.0:1789997543.690017:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 851 00000100:00100000:3.0:1789997543.690025:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49378:x1876946704487296:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997543.690066:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997543.690111:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592ceed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed91 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690134:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997543.690145:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997543.690166:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690180:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690190:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690205:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690213:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690220:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690568:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690578:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.690586:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997543.691376:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].27, 64 off9920 00000004:00080000:3.0:1789997543.691386:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1732383731589ns, next at 1733383729694ns, rc = 0 00010000:00010000:3.0:1789997543.691478:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691490:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691498:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691507:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691513:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691523:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691546:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997543.691568:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691575:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691580:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691586:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997543.691589:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691596:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691606:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997543.691609:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997543.691613:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691619:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691634:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691645:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691686:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997543.691693:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997543.691694:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997543.691701:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997543.691703:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691714:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997543.691717:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997543.691724:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691727:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997543.691734:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997543.691740:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691741:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.691759:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592cf09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997543.691762:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:2.0:1789997543.691767:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:3.0:1789997543.691772:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3187cd2 reply state 00000000108bbf94 transno 4294967624 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997543.691772:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997543.691788:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592cf1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997543.691791:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997543.691807:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997543.691821:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997543.691824:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997543.691865:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49378:x1876946704487296:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1839us (2064us total) trans 4294967624 rc 0/0 00000100:00100000:3.0:1789997543.691873:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 851 00010000:00010000:3.0:1789997543.693705:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.693723:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.693730:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.693736:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997543.693740:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.693747:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.693759:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997543.693761:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997543.693766:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997543.693772:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cf10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997544.206791:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997544.914436:0:84064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1733606779041ns, next at 1730305483222ns, rc = 0 00000004:00080000:3.0:1789997544.914544:0:84064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1733606889672ns, next at 1733383729694ns, rc = 0 00000004:00080000:1.0:1789997544.940304:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 74 committed 00000001:00080000:1.0:1789997544.940333:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967624 is committed 00000004:00080000:1.0:1789997544.940339:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 76 committed 00000100:00100000:1.0:1789997544.940600:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712981888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997544.940707:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997544.940775:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712981888 00000100:00100000:3.0:1789997544.940785:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712981888 00000100:00080000:1.0:1789997544.940820:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997544.940858:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1789997544.940873:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712981888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789997544.940907:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:27 count 1 00010000:00010000:3.0:1789997544.940942:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997544.940968:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997544.941017:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1b:0x0].0x0 since=4s v=(0 0) 00010000:00010000:3.0:1789997544.941021:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997544.941025:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997544.941053:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997544.941078:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 5 pid: 6659 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997544.941092:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1876946712982016:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997544.941485:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789997544.945929:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997544.945970:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704487424 00000100:00100000:3.0:1789997544.945980:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704487424 00010000:00010000:3.0:1789997544.946023:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 6 pid: 6659 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997544.946087:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 373 00000100:00100000:3.0:1789997544.946097:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704487424:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997544.946112:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997544.946118:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 6 pid: 6659 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997544.946143:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 6 pid: 6659 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997544.946171:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997544.946175:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997544.946181:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997544.946191:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997544.946211:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997544.946268:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704487424:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 172us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997544.946276:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 373 00010000:00010000:1.0:1789997544.946623:0:6658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592cefb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed98 expref: 5 pid: 6659 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997544.946641:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1876946712982016:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997544.946697:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997544.946709:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997544.946717:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997544.946728:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997544.946736:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997544.947468:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997544.947500:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997544.947508:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997544.947518:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997544.947521:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997544.947531:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997544.947546:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997544.947553:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592cf25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997544.947574:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997544.947577:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997544.947580:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997544.947887:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 77 committed 00000004:00080000:0.0:1789997544.949637:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c7c61880/2, rc 0, transno 4294967351 00000100:00100000:0.0:1789997544.949742:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712981888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997544.949795:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712981888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8635us (8797us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789997544.949810:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00010000:00010000:2.0:1789997545.227808:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997545.932591:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712982272:0@lo:400:kworker.0 00000100:00100000:3.0:1789997545.932688:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997545.932710:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997545.932727:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712982144:0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.932767:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997545.932823:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712982272 00000100:00100000:1.0:1789997545.932831:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712982272 00000100:00100000:1.0:1789997545.932885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1789997545.932895:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712982272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.933010:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712982144 00000100:00100000:0.0:1789997545.933015:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712982144 00000100:00100000:0.0:1789997545.933048:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1789997545.933067:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712982144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.933106:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712982144:12345-0@lo:400:kworker.0 Request processed in 41us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997545.933113:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1789997545.933161:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712982144:0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.933204:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712982400:0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.933230:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997545.933261:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712982400 00000100:00100000:0.0:1789997545.933265:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712982400 00000100:00100000:1.0:1789997545.933302:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712982272:12345-0@lo:400:kworker.0 Request processed in 408us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997545.933310:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1789997545.933383:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712982272:0@lo:400:kworker.0 00000100:00100000:1.0:1789997545.933730:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712982528:0@lo:400:kworker.0 00000100:00100000:1.0:1789997545.933760:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997545.933816:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712982528 00000100:00100000:3.0:1789997545.933820:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712982528 00000100:00100000:3.0:1789997545.933862:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:3.0:1789997545.933870:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712982528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997545.933977:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712982528:12345-0@lo:400:kworker.0 Request processed in 108us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997545.933984:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00080000:3.0:1789997545.934017:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997545.934032:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712982656:0@lo:400:kworker.0 00000100:00100000:3.0:1789997545.934069:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997545.934106:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712982656 00000100:00100000:3.0:1789997545.934120:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712982656 00000100:00100000:3.0:1789997545.934145:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1789997545.934152:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712982656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997545.934188:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712982656:12345-0@lo:400:kworker.0 Request processed in 37us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997545.934195:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1789997545.934224:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712982656:0@lo:400:kworker.0 00000100:00100000:1.0:1789997545.934344:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:1.0:1789997545.934350:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38ffd72d80, transno 4294967349 00000100:00100000:1.0:1789997545.934364:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712982528:0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.934412:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1789997545.934423:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712982400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.934468:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712982400:12345-0@lo:400:kworker.0 Request processed in 48us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997545.934475:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00080000:0.0:1789997545.934491:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997545.934510:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712982400:0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.934642:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712982784:0@lo:400:kworker.0 00000100:00100000:0.0:1789997545.934693:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997545.934833:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712982784 00000100:00100000:1.0:1789997545.934839:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712982784 00000100:00100000:1.0:1789997545.934892:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1789997545.934899:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712982784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997545.934938:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712982784:12345-0@lo:400:kworker.0 Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997545.934944:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:1.0:1789997545.934970:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712982784:0@lo:400:kworker.0 00000100:00080000:0.0:1789997545.935362:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997546.250995:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997547.274969:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997547.798870:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997547.798951:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997547.798987:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997547.799042:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997547.799062:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704487680 00000100:00100000:1.0:1789997547.799067:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704487808 00000100:00100000:2.0:1789997547.799073:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704487680 00000100:00100000:1.0:1789997547.799073:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704487808 00000100:00100000:2.0:1789997547.799133:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1263 00000100:00100000:0.0:1789997547.799140:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704487936 00000100:00100000:2.0:1789997547.799147:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704487680:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997547.799147:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704487936 00000100:00100000:3.0:1789997547.799211:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704487552 00000100:00100000:3.0:1789997547.799215:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704487552 00000100:00100000:3.0:1789997547.799243:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1059 00000100:00100000:2.0:1789997547.799244:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704487680:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 102us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997547.799249:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704487552:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997547.799265:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1263 00000100:00100000:3.0:1789997547.799276:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704487552:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997547.799282:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1059 00000100:00100000:1.0:1789997547.799419:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 802 00000100:00100000:1.0:1789997547.799427:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704487808:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997547.799462:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704487808:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997547.799468:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 802 00000100:00100000:0.0:1789997547.800968:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 803 00000100:00100000:0.0:1789997547.800982:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704487936:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997547.801056:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704487936:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997547.801064:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 803 00000100:00080000:3.0:1789997547.801323:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997547.801329:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997547.801332:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997547.979254:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712982912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997547.979320:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997547.979440:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712982912 00000100:00100000:3.0:1789997547.979448:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712982912 00000100:00100000:3.0:1789997547.979507:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1789997547.979517:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712982912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997547.979549:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997547.979591:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712982912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997547.979610:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:2.0:1789997547.979705:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712982912:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997547.979730:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997547.983352:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712983040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997547.983413:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997547.987174:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712983040 00000100:00100000:1.0:1789997547.987199:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712983040 00000100:00080000:2.0:1789997547.987277:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997547.987347:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1789997547.987360:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712983040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997547.987414:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997547.987513:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712983040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (4098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997547.987520:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:2.0:1789997547.987567:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712983040:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789997548.299390:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997549.035432:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967351 is committed 00010000:00010000:0.0:1789997549.323165:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997550.346810:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997551.051602:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712983424:0@lo:400:kworker.0 00000100:00100000:1.0:1789997551.051690:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997551.051755:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789997551.051761:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712983296:0@lo:400:kworker.0 00000100:00100000:1.0:1789997551.051797:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997551.051816:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712983808:0@lo:400:kworker.0 00000100:00100000:1.0:1789997551.051837:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997551.051882:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712983424 00000100:00100000:1.0:1789997551.051890:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712983424 00000100:00100000:2.0:1789997551.052017:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712983552:0@lo:400:kworker.0 00000100:00100000:2.0:1789997551.052049:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997551.052072:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789997551.052090:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712983168:0@lo:400:kworker.0 00000100:00100000:2.0:1789997551.052118:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997551.052139:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712983680:0@lo:400:kworker.0 00000100:00100000:1.0:1789997551.052142:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712983296 00000100:00100000:1.0:1789997551.052146:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712983296 00000100:00100000:2.0:1789997551.052160:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997551.052166:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712983808 00000100:00100000:1.0:1789997551.052169:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712983808 00000100:00100000:2.0:1789997551.052184:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712983552 00000100:00100000:2.0:1789997551.052187:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712983552 00000100:00100000:1.0:1789997551.052207:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1789997551.052211:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712983680 00000100:00100000:2.0:1789997551.052213:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712983680 00000100:00100000:1.0:1789997551.052215:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712983424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997551.052230:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1789997551.052235:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712983552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997551.052265:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712983552:12345-0@lo:400:kworker.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997551.052265:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712983424:12345-0@lo:400:kworker.0 Request processed in 50us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997551.052273:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1789997551.052273:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1789997551.052287:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1789997551.052287:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1789997551.052294:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712983680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997551.052294:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712983296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997551.052318:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712983680:12345-0@lo:400:kworker.0 Request processed in 25us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997551.052318:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712983296:12345-0@lo:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997551.052324:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1789997551.052327:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1789997551.052334:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1789997551.052339:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712983808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997551.052360:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000100:00100000:1.0:1789997551.052362:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712983808:12345-0@lo:400:kworker.0 Request processed in 24us (524us total) trans 0 rc 0/0 00000004:00080000:2.0:1789997551.052364:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c7c61880, transno 4294967351 00000100:00100000:1.0:1789997551.052367:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1789997551.052376:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712983680:0@lo:400:kworker.0 00000100:00080000:1.0:1789997551.052385:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997551.052388:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712983552:0@lo:400:kworker.0 00000100:00080000:1.0:1789997551.052388:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997551.052391:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997551.052418:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712983296:0@lo:400:kworker.0 00000100:00100000:1.0:1789997551.052427:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712983808:0@lo:400:kworker.0 00000100:00100000:1.0:1789997551.052434:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712983424:0@lo:400:kworker.0 00000100:00100000:0.0:1789997551.052843:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712983168 00000100:00100000:0.0:1789997551.052848:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712983168 00000100:00100000:0.0:1789997551.052885:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1789997551.052892:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712983168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997551.052931:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712983168:12345-0@lo:400:kworker.0 Request processed in 40us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997551.052937:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1789997551.052983:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712983168:0@lo:400:kworker.0 00010000:00010000:2.0:1789997551.370989:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997552.395764:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997552.929432:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997552.929729:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997552.929765:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997552.929794:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997552.930338:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704488192 00000100:00100000:1.0:1789997552.930351:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704488192 00000100:00100000:1.0:1789997552.930423:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1267 00000100:00100000:1.0:1789997552.930436:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704488192:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997552.931135:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704488064 00000100:00100000:3.0:1789997552.931153:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704488064 00000100:00100000:3.0:1789997552.931267:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1061 00000100:00100000:3.0:1789997552.931280:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704488064:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997552.931319:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704488064:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997552.931327:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1061 00000100:00080000:3.0:1789997552.931390:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997552.931403:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704488320 00000100:00100000:3.0:1789997552.931407:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704488320 00000100:00100000:3.0:1789997552.931440:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704488448 00000100:00100000:3.0:1789997552.931444:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704488448 00000100:00100000:3.0:1789997552.931465:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 806 00000100:00100000:3.0:1789997552.931471:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704488320:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997552.931495:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704488320:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997552.931501:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 806 00000100:00080000:2.0:1789997552.931838:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997552.931842:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997552.932043:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 807 00000100:00100000:3.0:1789997552.932057:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704488448:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997552.932091:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704488448:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997552.932139:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704488192:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 83us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997552.932148:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1267 00000100:00100000:3.0:1789997552.936323:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 807 00000100:00100000:0.0:1789997553.099425:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997553.099450:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712983936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997553.099498:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997553.099508:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712984064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997553.099518:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997553.099637:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712983936 00000100:00100000:1.0:1789997553.099646:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712983936 00000100:00100000:1.0:1789997553.099734:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1789997553.099744:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712983936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997553.099779:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997553.100170:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997553.105263:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712983936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5511us (5735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997553.105278:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1789997553.105580:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997553.106018:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712984064 00000100:00100000:1.0:1789997553.106028:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712984064 00000100:00100000:1.0:1789997553.106099:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:1.0:1789997553.106111:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712984064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997553.106149:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997553.106207:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712984064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997553.106213:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00080000:3.0:1789997553.106284:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997553.107151:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712984064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997553.109170:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712983936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997553.419205:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997554.442803:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997555.466841:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997556.171053:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712984320:0@lo:400:kworker.0 00000100:00100000:1.0:1789997556.171127:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997556.171256:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997556.171274:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712984192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997556.171296:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712984448:0@lo:400:kworker.0 00000100:00100000:0.0:1789997556.171311:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997556.171821:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712984320 00000100:00100000:1.0:1789997556.171830:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712984320 00000100:00100000:1.0:1789997556.171892:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1789997556.171905:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712984320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997556.171991:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712984576:0@lo:400:kworker.0 00000100:00100000:0.0:1789997556.172023:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997556.172053:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712984704:0@lo:400:kworker.0 00000100:00100000:3.0:1789997556.172062:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997556.172071:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712984320:12345-0@lo:400:kworker.0 Request processed in 168us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997556.172073:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712984192 00000100:00100000:0.0:1789997556.172079:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712984192 00000100:00100000:1.0:1789997556.172083:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1789997556.172096:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997556.172103:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997556.172108:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712984448 00000100:00100000:3.0:1789997556.172116:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712984832:0@lo:400:kworker.0 00000100:00100000:0.0:1789997556.172117:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1789997556.172128:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712984192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997556.172132:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712984576 00000100:00100000:2.0:1789997556.172136:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712984576 00000100:00100000:3.0:1789997556.172155:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997556.172304:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712984704 00000100:00100000:2.0:1789997556.172309:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712984704 00000100:00100000:2.0:1789997556.172336:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:2.0:1789997556.172343:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712984576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997556.172371:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712984832 00000100:00100000:3.0:1789997556.172377:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712984832 00000100:00100000:1.0:1789997556.172405:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712984448 00000100:00100000:3.0:1789997556.172437:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1789997556.172457:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712984832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997556.172470:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712984192:12345-0@lo:400:kworker.0 Request processed in 342us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997556.172477:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1789997556.172482:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1789997556.172483:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712984576:12345-0@lo:400:kworker.0 Request processed in 140us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997556.172491:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712984448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997556.172492:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:2.0:1789997556.172510:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1789997556.172517:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712984704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997556.172534:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712984832:12345-0@lo:400:kworker.0 Request processed in 89us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997556.172545:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712984448:12345-0@lo:400:kworker.0 Request processed in 57us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997556.172549:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712984576:0@lo:400:kworker.0 00000100:00100000:1.0:1789997556.172559:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1789997556.172560:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712984704:12345-0@lo:400:kworker.0 Request processed in 42us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997556.172563:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712984192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997556.172570:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:2.0:1789997556.172571:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00080000:2.0:1789997556.172592:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997556.172599:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997556.172601:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997556.172626:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712984704:0@lo:400:kworker.0 00000100:00100000:0.0:1789997556.172967:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712984320:0@lo:400:kworker.0 00000100:00100000:3.0:1789997556.173638:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712984832:0@lo:400:kworker.0 00000100:00100000:3.0:1789997556.173675:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712984448:0@lo:400:kworker.0 00010000:00010000:1.0:1789997556.490959:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997557.514897:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997558.038983:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997558.040018:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997558.040057:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997558.040099:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997558.040181:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704488960 00000100:00100000:2.0:1789997558.040192:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704488960 00000100:00100000:2.0:1789997558.040262:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704488832 00000100:00100000:2.0:1789997558.040265:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704488832 00000100:00100000:2.0:1789997558.040288:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 810 00000100:00100000:2.0:1789997558.040304:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704488960:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997558.040390:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704488960:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 93us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997558.040397:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 810 00000100:00100000:2.0:1789997558.040412:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 811 00000100:00100000:2.0:1789997558.040418:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704488832:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997558.040439:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704488832:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 22us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997558.040444:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 811 00000100:00080000:1.0:1789997558.040793:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997558.040797:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997558.042756:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704488704 00000100:00100000:0.0:1789997558.042768:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704488704 00000100:00100000:0.0:1789997558.042863:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1271 00000100:00100000:0.0:1789997558.042874:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704488704:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1789997558.043025:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997558.043066:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704488704:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 194us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997558.043074:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1271 00000100:00100000:3.0:1789997558.044737:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704488576 00000100:00100000:3.0:1789997558.044748:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704488576 00000100:00100000:3.0:1789997558.044886:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1063 00000100:00100000:3.0:1789997558.044897:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704488576:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997558.044948:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704488576:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 54us (5978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997558.044955:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1063 00000100:00100000:1.0:1789997558.219179:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997558.219203:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712984960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997558.219272:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712985088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997558.219275:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997558.219313:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997558.219385:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712984960 00000100:00100000:3.0:1789997558.219394:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712984960 00000100:00100000:3.0:1789997558.219446:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712985088 00000100:00100000:3.0:1789997558.219449:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712985088 00000100:00100000:3.0:1789997558.219469:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1789997558.219478:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712984960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997558.219510:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997558.219558:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712984960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997558.219565:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1789997558.219581:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1789997558.219588:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712985088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997558.219605:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997558.219697:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712984960:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997558.219740:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997558.219744:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997558.229761:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712985088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10162us (10436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997558.229775:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1789997558.232046:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712985088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997558.538917:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997559.563162:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997560.587605:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997561.291229:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712985344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997561.291300:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997561.291308:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712985600:0@lo:400:kworker.0 00000100:00100000:2.0:1789997561.291351:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997561.291394:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712985216:0@lo:400:kworker.0 00000100:00100000:1.0:1789997561.291431:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997561.291471:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712985728:0@lo:400:kworker.0 00000100:00100000:1.0:1789997561.291503:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712985216 00000100:00100000:1.0:1789997561.291509:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712985216 00000100:00100000:3.0:1789997561.291528:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712985856:0@lo:400:kworker.0 00000100:00100000:3.0:1789997561.291597:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997561.291698:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1789997561.291709:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712985216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997561.291768:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712985216:12345-0@lo:400:kworker.0 Request processed in 60us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997561.291775:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1789997561.291820:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997561.291857:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712985216:0@lo:400:kworker.0 00000100:00100000:1.0:1789997561.291883:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712985600 00000100:00100000:1.0:1789997561.291886:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712985600 00000100:00100000:1.0:1789997561.291916:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712985728 00000100:00100000:1.0:1789997561.291919:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712985728 00000100:00100000:1.0:1789997561.291937:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1789997561.291944:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712985600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997561.291977:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712985600:12345-0@lo:400:kworker.0 Request processed in 34us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997561.291983:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1789997561.291994:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:1.0:1789997561.292000:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712985728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997561.292201:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712985600:0@lo:400:kworker.0 00000100:00100000:2.0:1789997561.292244:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712985472:0@lo:400:kworker.0 00000100:00080000:2.0:1789997561.292293:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997561.292298:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997561.292446:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712985728:12345-0@lo:400:kworker.0 Request processed in 445us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997561.292453:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:0.0:1789997561.293590:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712985344 00000100:00100000:0.0:1789997561.293599:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712985344 00000100:00100000:0.0:1789997561.293670:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712985856 00000100:00100000:0.0:1789997561.293674:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712985856 00000100:00100000:0.0:1789997561.293707:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1789997561.293714:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712985344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997561.293779:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946712985344:12345-0@lo:400:kworker.0 Request processed in 65us (2480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997561.293786:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1789997561.293801:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1789997561.293806:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712985856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997561.293842:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946712985856:12345-0@lo:400:kworker.0 Request processed in 36us (2245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997561.293847:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00080000:0.0:1789997561.293871:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997561.294218:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946712985344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997561.294230:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946712985856:0@lo:400:kworker.0 00000100:00100000:2.0:1789997561.294649:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712985728:0@lo:400:kworker.0 00000100:00100000:2.0:1789997561.294706:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997561.294798:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712985472 00000100:00100000:1.0:1789997561.294803:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712985472 00000100:00100000:1.0:1789997561.294851:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1789997561.294860:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712985472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997561.294918:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946712985472:12345-0@lo:400:kworker.0 Request processed in 60us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997561.294925:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1789997561.294973:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946712985472:0@lo:400:kworker.0 00000100:00080000:0.0:1789997561.295252:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997561.611482:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997562.635143:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997562.880169:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997562.880370:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704489088 00000100:00100000:1.0:1789997562.880380:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704489088 00000100:00100000:1.0:1789997562.880457:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 852 00000100:00100000:1.0:1789997562.880469:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49677:x1876946704489088:12345-192.168.204.4@tcp:48:lfs.0 00000100:00080000:0.0:1789997562.880557:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997562.880560:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49677:x1876946704489088:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997562.880568:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 852 00000100:00100000:1.0:1789997562.894765:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997562.895081:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704489216 00000100:00100000:2.0:1789997562.895093:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704489216 00000100:00100000:2.0:1789997562.895159:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 454 00000100:00100000:2.0:1789997562.895170:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49677:x1876946704489216:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997562.895533:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49677:x1876946704489216:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 364us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997562.895542:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 454 00000100:00080000:0.0:1789997562.895644:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997562.901762:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997562.902275:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704489344 00000100:00100000:0.0:1789997562.902287:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704489344 00000100:00100000:0.0:1789997562.902362:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 455 00000100:00100000:0.0:1789997562.902374:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49677:x1876946704489344:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:1.0:1789997562.902847:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997562.903215:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49677:x1876946704489344:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 841us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997562.903225:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 455 00000100:00100000:0.0:1789997562.913492:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997562.914706:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704489472 00000100:00100000:1.0:1789997562.914729:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704489472 00000100:00100000:1.0:1789997562.914790:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 853 00000100:00100000:1.0:1789997562.914801:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49677:x1876946704489472:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997562.915249:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49677:x1876946704489472:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 448us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997562.915257:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 853 00000100:00100000:1.0:1789997562.920105:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997562.920277:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704489600 00000100:00100000:2.0:1789997562.920287:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704489600 00000100:00100000:2.0:1789997562.920380:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 854 00000100:00100000:2.0:1789997562.920392:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49677:x1876946704489600:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997562.920488:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49677:x1876946704489600:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 98us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997562.920495:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 854 00000100:00100000:2.0:1789997562.922613:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997562.927251:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704489728 00000100:00100000:0.0:1789997562.927265:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704489728 00000100:00100000:0.0:1789997562.927323:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 456 00000100:00100000:0.0:1789997562.927334:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49677:x1876946704489728:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997562.927934:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49677:x1876946704489728:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 600us (5326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997562.927942:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 456 00000100:00100000:0.0:1789997562.931174:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997562.931245:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704489856 00000100:00100000:1.0:1789997562.931254:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704489856 00000100:00100000:1.0:1789997562.931303:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 457 00000100:00100000:1.0:1789997562.931313:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49677:x1876946704489856:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997562.931961:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49677:x1876946704489856:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 648us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997562.931969:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 457 00000100:00100000:2.0:1789997562.933826:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997562.934970:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704489984 00000100:00100000:3.0:1789997562.934979:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704489984 00000100:00100000:3.0:1789997562.935025:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 855 00000100:00100000:3.0:1789997562.935033:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49677:x1876946704489984:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997562.935372:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49677:x1876946704489984:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 339us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997562.935380:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 855 00000100:00100000:2.0:1789997563.159283:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997563.159340:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997563.159374:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997563.159412:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997563.159475:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704490112 00000100:00100000:3.0:1789997563.159487:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704490112 00000100:00100000:1.0:1789997563.159497:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704490240 00000100:00100000:0.0:1789997563.159497:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704490368 00000100:00100000:1.0:1789997563.159504:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704490240 00000100:00100000:0.0:1789997563.159504:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704490368 00000100:00100000:0.0:1789997563.159550:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704490496 00000100:00100000:0.0:1789997563.159553:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704490496 00000100:00100000:1.0:1789997563.159561:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1275 00000100:00100000:1.0:1789997563.159571:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704490240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997563.159574:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 814 00000100:00100000:0.0:1789997563.159584:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704490368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997563.159606:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1065 00000100:00100000:3.0:1789997563.159617:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704490112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997563.159700:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704490240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 129us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997563.159700:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704490368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 118us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997563.159709:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1275 00000100:00100000:0.0:1789997563.159709:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 814 00000100:00100000:0.0:1789997563.159737:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 815 00000100:00100000:0.0:1789997563.159744:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704490496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997563.159781:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704490496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997563.159788:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 815 00000100:00100000:2.0:1789997563.161240:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704490112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1616us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997563.161253:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1065 00000100:00100000:2.0:1789997563.339324:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997563.339347:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712985984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997563.339428:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997563.339498:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712985984 00000100:00100000:2.0:1789997563.339506:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712985984 00000100:00100000:2.0:1789997563.339576:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:2.0:1789997563.339585:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712985984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997563.339615:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997563.339701:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712985984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997563.339720:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00080000:2.0:1789997563.339745:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997563.339794:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712985984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997563.339813:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712986112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997563.339847:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997563.339888:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712986112 00000100:00100000:0.0:1789997563.339893:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712986112 00000100:00100000:0.0:1789997563.339934:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1789997563.339943:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712986112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997563.339966:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997563.340012:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712986112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997563.340019:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00080000:0.0:1789997563.340035:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997563.340067:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712986112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997563.660398:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997563.928460:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997563.928547:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704490624 00000100:00100000:0.0:1789997563.928558:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704490624 00000100:00100000:0.0:1789997563.928622:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 856 00000100:00100000:0.0:1789997563.928634:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49691:x1876946704490624:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997563.928684:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997563.928717:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaed9f expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997563.928785:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997563.928801:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997563.928813:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997563.928848:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789997563.928852:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997563.928871:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997563.928896:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed9f expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997563.928921:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed9f expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997563.928929:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:0.0:1789997563.928933:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997563.928937:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660ec00, rc 0) 00000100:00100000:0.0:1789997563.928994:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49691:x1876946704490624:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 362us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997563.929002:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 856 00000100:00100000:0.0:1789997563.932166:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997563.932561:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704490880 00000100:00100000:3.0:1789997563.932571:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704490880 00000100:00100000:3.0:1789997563.932629:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 857 00000100:00100000:3.0:1789997563.932639:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49691:x1876946704490880:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997563.932825:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997563.932850:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed9f expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.932870:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592ced1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed8a expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.932881:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997563.932891:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997563.932913:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.933028:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.933038:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997563.948033:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967625 is committed 00000004:00010000:3.0:1789997563.948174:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005409a98f reply state 00000000ed8f54c6 transno 4294967625 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997563.948189:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997563.948203:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00080000:3.0:1789997563.948303:0:5812:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997563.948321:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49691:x1876946704490880:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 15679us (16157us total) trans 4294967625 rc 0/0 00000100:00100000:3.0:1789997563.948328:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 857 00010000:00010000:3.0:1789997563.948862:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.948886:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.948894:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.948900:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997563.948905:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.948913:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.948944:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997563.948948:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997563.948953:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997563.948959:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997563.999468:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997564.002085:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704491008 00000100:00100000:0.0:1789997564.002098:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704491008 00000100:00100000:0.0:1789997564.002178:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 858 00000100:00100000:0.0:1789997564.002189:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49695:x1876946704491008:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:0.0:1789997564.002213:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997564.002234:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeda6 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002294:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002383:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002397:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002413:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002421:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002428:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002766:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cf56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002775:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002784:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997564.002806:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789997564.002810:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997564.002829:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cf56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002841:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002847:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002854:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002864:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660ec00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997564.002869:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002876:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002888:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997564.002891:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997564.002895:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002902:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002913:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002919:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002925:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002930:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997564.002933:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002939:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002950:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997564.002952:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997564.002955:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002961:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.002992:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeda6 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.003006:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cf56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeda6 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.003013:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997564.003015:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997564.003018:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e200, rc 0) 00000100:00100000:0.0:1789997564.003085:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49695:x1876946704491008:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 899us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997564.003093:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 858 00000100:00080000:3.0:1789997564.003897:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997564.007193:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997564.007276:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704491264 00000100:00100000:3.0:1789997564.007286:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704491264 00000100:00100000:3.0:1789997564.007347:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 859 00000100:00100000:3.0:1789997564.007358:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49695:x1876946704491264:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997564.007379:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997564.007400:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedad expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.009779:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.009805:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.009818:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.009835:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.009842:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.009850:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997564.014458:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:3.0:1789997564.015521:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015541:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015553:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015595:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015603:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015610:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015615:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997564.015620:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015628:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015639:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:3.0:1789997564.015642:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997564.015647:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015667:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cf64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997564.015680:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0d71e50 reply state 000000006b3019af transno 4294967626 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997564.015690:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997564.015738:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cf5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedad expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015751:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedad expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.015759:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997564.015761:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997564.015763:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997564.015842:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49695:x1876946704491264:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 8485us (8654us total) trans 4294967626 rc 0/0 00000100:00100000:3.0:1789997564.015851:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 859 00010000:00010000:2.0:1789997564.019788:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.019808:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.019817:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.019824:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997564.019830:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.019838:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.019855:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38ee49e400) 00010000:00010000:2.0:1789997564.019859:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997564.019864:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.019871:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592cf6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997564.022182:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997564.022529:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704491520 00000100:00100000:2.0:1789997564.022541:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704491520 00000100:00100000:2.0:1789997564.022640:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 860 00000100:00100000:2.0:1789997564.022681:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49695:x1876946704491520:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:2.0:1789997564.022754:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997564.022781:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592cf72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedad expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.022800:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:2.0:1789997564.022811:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997564.022850:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.022864:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.022875:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997564.023034:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004fe22cd reply state 0000000090a944d1 transno 4294967627 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997564.023043:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997564.023144:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49695:x1876946704491520:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 494us (971us total) trans 4294967627 rc 0/0 00000100:00100000:2.0:1789997564.023152:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 860 00010000:00010000:2.0:1789997564.024766:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.024784:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.024792:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.024800:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997564.024913:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.024923:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.024938:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997564.024942:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997564.024952:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.024963:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592cf80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997564.025823:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997564.025913:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704491648 00000100:00100000:1.0:1789997564.025923:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704491648 00000100:00100000:1.0:1789997564.026000:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 861 00000100:00100000:1.0:1789997564.026012:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49695:x1876946704491648:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997564.026035:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997564.026056:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cf87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedb4 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.026113:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cf87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedb4 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.026127:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cf87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedb4 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.026145:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997564.026148:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789997564.026153:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:1.0:1789997564.026208:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49695:x1876946704491648:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 199us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997564.026216:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 861 00000100:00100000:0.0:1789997564.030021:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997564.030122:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704491776 00000100:00100000:3.0:1789997564.030133:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704491776 00000100:00100000:3.0:1789997564.030223:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 458 00000100:00100000:3.0:1789997564.030235:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704491776:12345-192.168.204.4@tcp:2:touch.60003 00000100:00080000:0.0:1789997564.030418:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997564.030646:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704491776:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 413us (630us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789997564.030677:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 458 00000100:00100000:0.0:1789997564.035122:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997564.035188:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704492032 00000100:00100000:3.0:1789997564.035199:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704492032 00000100:00100000:3.0:1789997564.035257:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:3.0:1789997564.035268:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49695:x1876946704492032:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:3.0:1789997564.036219:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49695:x1876946704492032:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 948us (1101us total) trans 4294967628 rc 0/0 00000100:00100000:3.0:1789997564.036229:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 89 00000100:00100000:0.0:1789997564.087354:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997564.087572:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704492160 00000100:00100000:2.0:1789997564.087583:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704492160 00000100:00100000:2.0:1789997564.087644:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 862 00000100:00100000:2.0:1789997564.087706:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49699:x1876946704492160:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:2.0:1789997564.087733:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997564.087807:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedbb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.087880:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.087895:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.087908:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.087933:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.087940:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.087946:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088031:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cfa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088053:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088059:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997564.088093:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x47:0x0]: returning size 0 00000004:00200000:0.0:1789997564.088098:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997564.088118:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088133:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088141:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088147:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088153:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088159:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660f800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997564.088163:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088169:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088181:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997564.088185:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997564.088190:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088195:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592cf95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088209:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088215:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088221:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088226:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660fe00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997564.088229:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088236:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088243:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997564.088245:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997564.088248:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088253:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592cf9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088285:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592cf8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedbb expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088298:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cfa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedbb expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.088305:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:0.0:1789997564.088307:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997564.088310:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e800, rc 0) 00000100:00100000:0.0:1789997564.088385:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49699:x1876946704492160:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 732us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997564.088395:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 862 00000100:00100000:0.0:1789997564.091815:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997564.093087:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704492288 00000100:00100000:1.0:1789997564.093099:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704492288 00000100:00100000:1.0:1789997564.093166:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 459 00000100:00100000:1.0:1789997564.093177:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704492288:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:1.0:1789997564.093195:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997564.093216:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedc2 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997564.093241:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x6ab131fb, atime: 0x6ab131fb, ctime: 0x6ab131fb, blocks: 0x1 00010000:00010000:1.0:1789997564.093261:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=1752s v=(0 0) 00010000:00010000:1.0:1789997564.093266:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997564.093275:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.093293:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.093307:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997564.093381:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704492288:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 205us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997564.093389:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 459 00000100:00100000:1.0:1789997564.098308:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997564.098492:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704492544 00000100:00100000:3.0:1789997564.098503:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704492544 00000100:00100000:3.0:1789997564.098622:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 863 00000100:00100000:3.0:1789997564.098634:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49699:x1876946704492544:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997564.098741:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997564.098771:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592cfa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedbb expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.098796:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592cf87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedb4 expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.098807:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:3.0:1789997564.098817:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997564.098840:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.098853:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.098862:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.098876:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.098882:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.098889:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.099108:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.099118:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.099125:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997564.099909:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].27, 64 off9920 00000004:00080000:3.0:1789997564.099932:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1752792266414ns, next at 1753792264199ns, rc = 0 00010000:00010000:3.0:1789997564.100012:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100023:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100032:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100039:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100045:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100052:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100071:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997564.100094:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100101:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100107:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100112:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997564.100116:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100124:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100135:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997564.100138:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997564.100141:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100147:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592cfbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100164:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100170:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100180:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100185:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997564.100187:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100193:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100199:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:3.0:1789997564.100202:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997564.100204:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.100210:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997564.100219:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000450f3af4 reply state 000000007fa93fae transno 4294967629 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997564.100227:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997564.100321:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49699:x1876946704492544:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1686us (2018us total) trans 4294967629 rc 0/0 00000100:00100000:3.0:1789997564.100329:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 863 00010000:00010000:0.0:1789997564.100687:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997564.100704:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.100712:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997564.100715:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.100721:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.100730:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:0.0:1789997564.100733:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997564.100736:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.100741:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592cfc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997564.100757:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997564.100759:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997564.100760:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997564.103617:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.103635:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.103642:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.103647:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997564.103675:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.103684:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.103711:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38ee49e500) 00010000:00010000:2.0:1789997564.103715:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997564.103720:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.103727:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592cfb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997564.416414:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00010000:00010000:0.0:1789997564.687840:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997564.764437:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997564.765391:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704492672 00000100:00100000:2.0:1789997564.765402:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704492672 00000100:00100000:2.0:1789997564.766394:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 864 00000100:00100000:2.0:1789997564.766410:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49718:x1876946704492672:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997564.766435:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997564.766456:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592cfcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedc9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.766521:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cfd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.766770:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.766784:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997564.766883:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:2.0:1789997564.766888:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997564.766917:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.766942:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592cfcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc9 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.766960:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cfd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc9 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.766973:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:2.0:1789997564.766977:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997564.766981:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3200, rc 0) 00000100:00100000:2.0:1789997564.767054:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49718:x1876946704492672:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 648us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997564.767062:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 864 00000100:00100000:0.0:1789997564.771176:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997564.771250:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704492928 00000100:00100000:3.0:1789997564.771261:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704492928 00000100:00100000:3.0:1789997564.771313:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 865 00000100:00100000:3.0:1789997564.771322:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:49718:x1876946704492928:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997564.771375:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997564.771401:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592cfd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc9 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.771421:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592cf56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeda6 expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.771433:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:3.0:1789997564.771442:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997564.771467:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.771480:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.771490:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997564.799896:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967627 is committed 00000001:00080000:0.0:1789997564.799927:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967630 is committed 00000004:00080000:0.0:1789997564.799934:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 75 committed 00000004:00010000:3.0:1789997564.800061:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d787b8e reply state 0000000017b030e8 transno 4294967630 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997564.800075:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997564.800091:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00080000:3.0:1789997564.800207:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997564.800227:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49718:x1876946704492928:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 28902us (29055us total) trans 4294967630 rc 0/0 00000100:00100000:3.0:1789997564.800237:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 865 00000100:00100000:0.0:1789997564.800643:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997564.800679:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712986240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997564.800741:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997564.800828:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712986240 00000100:00100000:1.0:1789997564.800837:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712986240 00000100:00100000:1.0:1789997564.800877:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1789997564.800887:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712986240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789997564.800912:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00010000:00010000:1.0:1789997564.800935:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.800954:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 5 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.800961:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789997564.800965:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997564.800969:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.800995:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 5 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997564.801009:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 5 pid: 6659 timeout: 1853 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997564.801021:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712986368:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997564.801130:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38da301cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789997564.801444:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.801455:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.801462:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.801468:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997564.801472:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.801480:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.801751:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:2.0:1789997564.801754:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997564.801760:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.801766:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592cfdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997564.811441:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946712986368:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997564.811472:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997564.812079:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997564.812147:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704493056 00000100:00100000:3.0:1789997564.812983:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704493056 00010000:00010000:3.0:1789997564.813034:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 6 pid: 6659 timeout: 1853 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997564.813094:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 374 00000100:00100000:3.0:1789997564.813104:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704493056:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997564.813118:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997564.813126:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 6 pid: 6659 timeout: 1853 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.813140:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 6 pid: 6659 timeout: 1853 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.813241:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9bac850/0x65b43101d592cfaa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedc2 expref: 6 pid: 6659 timeout: 1853 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.813256:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997564.813260:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997564.813266:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.813276:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.813312:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997564.813339:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.813352:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.813363:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.813371:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997564.813386:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704493056:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 282us (1308us total) trans 0 rc 0/0 00010000:00010000:2.0:1789997564.813391:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789997564.813396:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 374 00010000:00010000:3.0:1789997564.814022:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997564.814031:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.814054:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997564.814060:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.814069:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.814086:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.814094:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b67b24e/0x65b43101d592cfe2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997564.814116:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997564.814119:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997564.814123:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997564.814145:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712986240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13254us (13397us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789997564.814154:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000004:00080000:2.0:1789997564.814350:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38f9bec000/2, rc 0, transno 4294967351 00000100:00100000:2.0:1789997564.814357:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712986240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789997564.835063:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997564.835096:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704493184 00000100:00100000:2.0:1789997564.835106:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704493184 00000100:00100000:2.0:1789997564.835159:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 866 00000100:00100000:2.0:1789997564.835170:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49722:x1876946704493184:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997564.835195:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997564.835214:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cfe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedd0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835274:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835289:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835299:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835316:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835323:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835331:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835616:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835625:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835633:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997564.835700:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:2.0:1789997564.835704:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997564.835727:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835739:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835747:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835754:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835760:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997564.835765:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835774:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835787:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:2.0:1789997564.835790:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997564.835795:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835801:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592cff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835812:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835823:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835829:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835834:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997564.835837:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835844:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835853:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997564.835855:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997564.835858:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835864:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592cff7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835899:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592cfe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedd0 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835913:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedd0 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997564.835919:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997564.835921:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997564.835924:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997564.835982:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49722:x1876946704493184:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 814us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997564.835989:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 866 00000100:00100000:1.0:1789997565.460808:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997565.461027:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704493312 00000100:00100000:0.0:1789997565.461037:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704493312 00000100:00100000:0.0:1789997565.461134:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 867 00000100:00100000:0.0:1789997565.461145:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49740:x1876946704493312:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997565.461166:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997565.461185:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedd7 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.461245:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d00c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.461259:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d00c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.461275:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d00c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997565.461311:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789997565.461315:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997565.461337:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d00c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.461363:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedd7 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.461382:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d00c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedd7 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.461391:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:0.0:1789997565.461395:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997565.461399:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660e200, rc 0) 00000100:00100000:0.0:1789997565.461461:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49740:x1876946704493312:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 317us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997565.461468:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 867 00000100:00100000:3.0:1789997565.464008:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997565.464049:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704493568 00000100:00100000:3.0:1789997565.464057:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704493568 00000100:00100000:3.0:1789997565.464103:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 868 00000100:00100000:3.0:1789997565.464114:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49740:x1876946704493568:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997565.464163:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997565.464186:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d00c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedd7 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997565.464206:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592cffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedd0 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997565.464216:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:3.0:1789997565.464225:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997565.464246:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997565.464257:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997565.464266:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997565.464610:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b52f6883 reply state 0000000085fc0dd9 transno 4294967631 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997565.464620:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997565.464887:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000100:00100000:3.0:1789997565.465029:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49740:x1876946704493568:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 914us (1027us total) trans 4294967631 rc 0/0 00000100:00100000:3.0:1789997565.465038:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 868 00010000:00010000:0.0:1789997565.466615:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.466632:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.466640:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.466647:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997565.466651:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.466704:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.466719:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:0.0:1789997565.466723:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997565.466728:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.466733:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d013 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997565.571769:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997565.573308:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704493696 00000100:00100000:2.0:1789997565.573324:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704493696 00000100:00100000:2.0:1789997565.573465:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 869 00000100:00100000:2.0:1789997565.573477:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49752:x1876946704493696:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997565.573604:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49752:x1876946704493696:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 129us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997565.573612:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 869 00000100:00100000:3.0:1789997565.578001:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997565.578084:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704493824 00000100:00100000:1.0:1789997565.578096:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704493824 00000100:00100000:1.0:1789997565.578163:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 461 00000100:00100000:1.0:1789997565.578175:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49752:x1876946704493824:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997565.578550:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49752:x1876946704493824:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 376us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997565.578558:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 461 00000100:00100000:1.0:1789997565.580558:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997565.580765:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704493952 00000100:00100000:2.0:1789997565.580773:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704493952 00000100:00100000:2.0:1789997565.580893:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 462 00000100:00100000:2.0:1789997565.580909:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49752:x1876946704493952:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997565.581276:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49752:x1876946704493952:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 368us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997565.581284:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 462 00000100:00080000:0.0:1789997565.581739:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997565.588777:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997565.589073:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704494080 00000100:00100000:1.0:1789997565.589084:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704494080 00000100:00100000:1.0:1789997565.589139:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 870 00000100:00100000:1.0:1789997565.589151:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49752:x1876946704494080:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997565.590039:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49752:x1876946704494080:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 887us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997565.590049:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 870 00000100:00100000:3.0:1789997565.593235:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997565.593300:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704494208 00000100:00100000:2.0:1789997565.593311:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704494208 00000100:00100000:2.0:1789997565.593374:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 871 00000100:00100000:2.0:1789997565.593385:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49752:x1876946704494208:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997565.593490:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49752:x1876946704494208:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997565.593496:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 871 00000100:00100000:2.0:1789997565.595833:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997565.596080:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704494336 00000100:00100000:1.0:1789997565.596089:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704494336 00000100:00100000:1.0:1789997565.596148:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 463 00000100:00100000:1.0:1789997565.596158:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49752:x1876946704494336:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997565.597690:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49752:x1876946704494336:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1495us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997565.597701:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 463 00000100:00100000:3.0:1789997565.599700:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997565.599925:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704494464 00000100:00100000:2.0:1789997565.599935:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704494464 00000100:00100000:2.0:1789997565.599993:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 464 00000100:00100000:2.0:1789997565.600003:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49752:x1876946704494464:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997565.600742:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49752:x1876946704494464:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 738us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997565.600751:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 464 00000100:00100000:2.0:1789997565.604576:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997565.605035:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704494592 00000100:00100000:3.0:1789997565.605047:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704494592 00000100:00100000:2.0:1789997565.605226:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 872 00000100:00100000:2.0:1789997565.605239:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49752:x1876946704494592:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997565.605747:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49752:x1876946704494592:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 510us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997565.605756:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 872 00000100:00100000:3.0:1789997565.646970:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997565.647207:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704494720 00000100:00100000:0.0:1789997565.647219:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704494720 00000100:00100000:0.0:1789997565.647283:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 873 00000100:00100000:0.0:1789997565.647294:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:49756:x1876946704494720:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997565.647318:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997565.647340:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592d01a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedde expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647407:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647423:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647435:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647449:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647457:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647463:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647847:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592d02f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647862:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592d02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647869:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592d02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997565.647891:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:0.0:1789997565.647895:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997565.647914:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592d02f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647926:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647933:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647939:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647945:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997565.647949:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647957:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647970:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997565.647972:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997565.647978:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.647988:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e800/0x65b43101d592d021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648001:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648007:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648012:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648017:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38f660e200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997565.648020:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648025:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648032:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997565.648034:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997565.648037:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648043:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660e200/0x65b43101d592d028 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648071:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660f800/0x65b43101d592d01a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedde expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648090:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592d02f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedde expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.648098:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997565.648100:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997565.648102:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38f660fe00, rc 0) 00000100:00100000:0.0:1789997565.648168:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49756:x1876946704494720:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 875us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997565.648175:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 873 00000100:00100000:3.0:1789997565.652847:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997565.654503:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704494976 00000100:00100000:0.0:1789997565.654518:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704494976 00000100:00100000:0.0:1789997565.654590:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 874 00000100:00100000:0.0:1789997565.654600:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49756:x1876946704494976:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997565.654621:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997565.654641:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592d036 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaede5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.654958:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.654974:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.654986:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655006:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655014:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655036:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997565.655578:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:0.0:1789997565.655851:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d04b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655862:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d04b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655870:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d04b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655904:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655911:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655917:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655923:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997565.655927:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655935:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655949:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997565.655952:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997565.655958:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.655964:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d03d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997565.655977:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f894a2c9 reply state 00000000eb3c3960 transno 4294967632 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997565.655985:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997565.656015:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ec00/0x65b43101d592d036 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaede5 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.656032:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d04b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaede5 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.656039:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997565.656041:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997565.656043:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997565.656119:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:49756:x1876946704494976:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 1519us (3278us total) trans 4294967632 rc 0/0 00000100:00100000:0.0:1789997565.656128:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 874 00010000:00010000:0.0:1789997565.658403:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.658420:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.658431:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.658437:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997565.658441:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.658449:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.658463:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997565.658466:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997565.658471:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997565.658476:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d044 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997565.661419:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997565.661763:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704495104 00000100:00100000:2.0:1789997565.661774:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704495104 00000100:00100000:2.0:1789997565.661876:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 465 00000100:00100000:2.0:1789997565.661887:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49756:x1876946704495104:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:2.0:1789997565.661922:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997565.661944:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedec expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997565.661973:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789997565.661995:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=1754s v=(0 0) 00010000:00010000:2.0:1789997565.662000:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997565.662010:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997565.662037:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997565.662050:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997565.662111:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49756:x1876946704495104:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 225us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997565.662118:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 465 00000100:00100000:2.0:1789997565.685615:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997565.685842:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704495232 00000100:00100000:0.0:1789997565.685853:0:6662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704495232 00002000:00100000:1.0:1789997565.685943:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8a38f9fde300 x1876946704495232/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:541/0 lens 488/0 e 0 to 0 dl 1789997576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789997565.685952:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f9fde300 with x1876946704495232 ext(0->1048575) 00002000:00010000:1.0:1789997565.685957:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38f9fde300 00000100:00100000:1.0:1789997565.685985:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:1.0:1789997565.685993:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704495232:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:1.0:1789997565.696291:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2352:x1876946704495232:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 10285us (10672us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789997565.696305:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00002000:00100000:1.0:1789997565.696319:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c:0x0] (0->1048575) req@ffff8a38f9fde300 x1876946704495232/t4294967352(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:541/0 lens 488/448 e 0 to 0 dl 1789997576 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1789997565.696329:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f9fde300 with x1876946704495232 ext(0->1048575) 00002000:00010000:1.0:1789997565.696336:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38f9fde300 00000100:00100000:2.0:1789997565.698816:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997565.698925:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704495360 00000100:00100000:0.0:1789997565.698934:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704495360 00000100:00100000:0.0:1789997565.698990:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 875 00000100:00100000:0.0:1789997565.699000:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:49756:x1876946704495360:12345-192.168.204.4@tcp:44:dd.60003 00010000:00010000:0.0:1789997565.706951:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997565.721165:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967632 is committed 00000100:00100000:1.0:1789997565.721408:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49756:x1876946704495360:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 22401us (22593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997565.721419:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 875 00000100:00100000:2.0:1789997565.725602:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997565.725738:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704495488 00000100:00100000:1.0:1789997565.725749:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704495488 00000100:00100000:1.0:1789997565.725810:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 466 00000100:00100000:1.0:1789997565.725822:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704495488:12345-192.168.204.4@tcp:16:dd.60003 00000001:00080000:2.0:1789997565.750091:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967352 is committed 00000100:00100000:1.0:1789997565.750538:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704495488:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 24710us (24937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997565.750549:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 466 00000100:00100000:3.0:1789997565.754896:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997565.755031:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704495744 00000100:00100000:1.0:1789997565.755042:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704495744 00000100:00100000:1.0:1789997565.755102:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00100000:1.0:1789997565.755113:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49756:x1876946704495744:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:1.0:1789997565.755609:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49756:x1876946704495744:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 498us (722us total) trans 4294967633 rc 0/0 00000100:00100000:1.0:1789997565.755615:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 90 00000100:00100000:1.0:1789997566.410928:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712986624:0@lo:400:kworker.0 00000100:00100000:1.0:1789997566.410994:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997566.411051:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997566.411058:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712986496:0@lo:400:kworker.0 00000100:00100000:1.0:1789997566.411093:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997566.411128:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712986624 00000100:00100000:1.0:1789997566.411136:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712986624 00000100:00100000:1.0:1789997566.411184:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1789997566.411193:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712986624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997566.411205:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712986752:0@lo:400:kworker.0 00000100:00100000:2.0:1789997566.411250:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997566.411253:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712986624:12345-0@lo:400:kworker.0 Request processed in 60us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997566.411260:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1789997566.411276:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712986752 00000100:00100000:1.0:1789997566.411279:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712986752 00000100:00100000:1.0:1789997566.411329:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:1.0:1789997566.411334:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712986752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997566.411359:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712986752:12345-0@lo:400:kworker.0 Request processed in 26us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997566.411363:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:1.0:1789997566.411377:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712986496 00000100:00100000:1.0:1789997566.411379:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712986496 00000100:00100000:1.0:1789997566.411447:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1789997566.411465:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712986496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997566.411498:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712986496:12345-0@lo:400:kworker.0 Request processed in 44us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997566.411503:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1789997566.411580:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712986752:0@lo:400:kworker.0 00000100:00080000:1.0:1789997566.411590:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997566.411613:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712986496:0@lo:400:kworker.0 00000100:00100000:1.0:1789997566.411625:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712986624:0@lo:400:kworker.0 00000100:00100000:3.0:1789997566.411848:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712987136:0@lo:400:kworker.0 00000100:00100000:3.0:1789997566.411888:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997566.411914:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997566.411921:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712987008:0@lo:400:kworker.0 00000100:00100000:1.0:1789997566.411939:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712987136 00000100:00100000:1.0:1789997566.411945:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712987136 00000100:00100000:3.0:1789997566.411950:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997566.411984:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1789997566.411992:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712987136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997566.411994:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712987008 00000100:00100000:3.0:1789997566.412000:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712987008 00000100:00100000:1.0:1789997566.412035:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712987136:12345-0@lo:400:kworker.0 Request processed in 44us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997566.412042:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1789997566.412046:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1789997566.412052:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712987008:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789997566.412068:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997566.412072:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997566.412092:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712987008:12345-0@lo:400:kworker.0 Request processed in 42us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997566.412099:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1789997566.412127:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712987008:0@lo:400:kworker.0 00000100:00100000:3.0:1789997566.412137:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712987136:0@lo:400:kworker.0 00000100:00100000:0.0:1789997566.412159:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997566.412171:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712986880:0@lo:400:kworker.0 00000100:00100000:0.0:1789997566.412204:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997566.414196:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712986880 00000100:00100000:1.0:1789997566.414208:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712986880 00000100:00100000:1.0:1789997566.414335:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1789997566.414347:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712986880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997566.414422:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712986880:12345-0@lo:400:kworker.0 Request processed in 79us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997566.414429:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1789997566.414567:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712986880:0@lo:400:kworker.0 00000100:00080000:1.0:1789997566.414626:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789997566.596827:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967633 is committed 00010000:00010000:1.0:1789997566.730952:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997567.458337:0:84579:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1756150680893ns, next at 1753792264199ns, rc = 0 00000004:00080000:0.0:1789997567.458503:0:84579:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1756150848879ns, next at 1733383729694ns, rc = 0 00000004:00080000:2.0:1789997567.464456:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 78 committed 00000004:00080000:2.0:1789997567.464486:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 76 committed 00010000:00010000:3.0:1789997567.755038:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997568.282102:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997568.282135:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997568.282164:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997568.282190:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997568.282216:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704496000 00000100:00100000:3.0:1789997568.282226:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704496000 00000100:00100000:3.0:1789997568.282286:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1279 00000100:00100000:3.0:1789997568.282296:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704496000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997568.282365:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704496000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997568.282373:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1279 00000100:00100000:3.0:1789997568.282398:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704496128 00000100:00100000:3.0:1789997568.282402:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704496128 00000100:00100000:3.0:1789997568.282424:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704496256 00000100:00100000:3.0:1789997568.282427:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704496256 00000100:00100000:3.0:1789997568.282449:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 818 00000100:00100000:3.0:1789997568.282455:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704496128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997568.282483:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704496128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997568.282489:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 818 00000100:00100000:3.0:1789997568.282501:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 819 00000100:00100000:3.0:1789997568.282508:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704496256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997568.282531:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704496256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997568.282537:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 819 00000100:00080000:3.0:1789997568.282704:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997568.282708:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997568.282711:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997568.283514:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704495872 00000100:00100000:0.0:1789997568.283522:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704495872 00000100:00100000:0.0:1789997568.283577:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1067 00000100:00100000:0.0:1789997568.283589:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704495872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997568.283674:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704495872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997568.283682:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1067 00000001:00080000:2.0:1789997568.425996:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00000100:00100000:2.0:1789997568.458930:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712987264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997568.459006:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997568.459102:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712987264 00000100:00100000:3.0:1789997568.459110:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712987264 00000100:00100000:0.0:1789997568.459388:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1789997568.459401:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712987264:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997568.459425:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789997568.459439:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997568.459603:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712987264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 205us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997568.459622:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1789997568.459711:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712987392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997568.459739:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997568.459769:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712987392 00000100:00100000:0.0:1789997568.459773:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712987392 00000100:00100000:0.0:1789997568.459803:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1789997568.459809:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712987392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997568.459827:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789997568.459859:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712987392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997568.459868:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00080000:0.0:1789997568.459881:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997568.459911:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712987392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997568.460049:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:2.0:1789997568.460055:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38f9bec000, transno 4294967351 00000100:00100000:2.0:1789997568.460109:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712987264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997568.549096:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997568.549155:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704496384 00000100:00100000:1.0:1789997568.549166:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704496384 00000100:00100000:1.0:1789997568.549225:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 876 00000100:00100000:1.0:1789997568.549236:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49950:x1876946704496384:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997568.549337:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49950:x1876946704496384:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 102us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997568.549344:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 876 00000100:00100000:2.0:1789997568.552785:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997568.552868:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704496512 00000100:00100000:3.0:1789997568.552879:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704496512 00000100:00100000:3.0:1789997568.552937:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 467 00000100:00100000:3.0:1789997568.552950:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49950:x1876946704496512:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997568.553366:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49950:x1876946704496512:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 418us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997568.553374:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 467 00000100:00100000:0.0:1789997568.556204:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997568.556323:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704496640 00000100:00100000:2.0:1789997568.556332:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704496640 00000100:00100000:2.0:1789997568.556406:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 468 00000100:00100000:2.0:1789997568.556418:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49950:x1876946704496640:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997568.556834:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49950:x1876946704496640:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 415us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997568.556843:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 468 00000100:00100000:0.0:1789997568.559977:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997568.560081:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704496768 00000100:00100000:2.0:1789997568.560092:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704496768 00000100:00100000:2.0:1789997568.560151:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 877 00000100:00100000:2.0:1789997568.560161:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49950:x1876946704496768:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997568.560634:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49950:x1876946704496768:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 473us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997568.560642:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 877 00000100:00100000:2.0:1789997568.568032:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997568.568087:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704496896 00000100:00100000:2.0:1789997568.568097:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704496896 00000100:00100000:2.0:1789997568.568149:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 878 00000100:00100000:2.0:1789997568.568160:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49950:x1876946704496896:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997568.568306:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49950:x1876946704496896:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 147us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997568.568314:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 878 00000100:00100000:0.0:1789997568.571941:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997568.571974:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704497024 00000100:00100000:0.0:1789997568.571984:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704497024 00000100:00100000:0.0:1789997568.572431:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 469 00000100:00100000:0.0:1789997568.572444:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49950:x1876946704497024:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997568.572975:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:49950:x1876946704497024:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 533us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997568.572984:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 469 00000100:00100000:0.0:1789997568.580347:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997568.580448:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704497152 00000100:00100000:2.0:1789997568.580460:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704497152 00000100:00100000:2.0:1789997568.580548:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 470 00000100:00100000:2.0:1789997568.580560:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49950:x1876946704497152:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997568.581144:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:49950:x1876946704497152:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 585us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997568.581153:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 470 00000100:00100000:0.0:1789997568.586144:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997568.586319:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704497280 00000100:00100000:2.0:1789997568.586329:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704497280 00000100:00100000:2.0:1789997568.586392:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 879 00000100:00100000:2.0:1789997568.586404:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49950:x1876946704497280:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997568.587125:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49950:x1876946704497280:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 721us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997568.587135:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 879 00000100:00100000:0.0:1789997568.635298:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997568.635568:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704497536 00000100:00100000:3.0:1789997568.635579:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704497536 00000100:00100000:3.0:1789997568.635688:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 880 00000100:00100000:3.0:1789997568.635700:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:49953:x1876946704497536:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997568.635755:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997568.635785:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d04b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaede5 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.635814:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:3.0:1789997568.635823:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997568.635845:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.635859:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.635868:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.635881:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.635888:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.635899:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.636186:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.636195:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.636201:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997568.638243:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].28, 64 off9984 00000004:00080000:3.0:1789997568.638257:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1757330602653ns, next at 1758330599655ns, rc = 0 00010000:00010000:3.0:1789997568.638357:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.638371:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.638382:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.638389:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.638395:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.638402:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.638437:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997568.638471:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.638476:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997568.638481:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.638486:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.638497:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997568.638501:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.638510:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.638527:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:0.0:1789997568.638530:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997568.638535:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.638540:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d075 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.638554:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997568.638555:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997568.638557:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997568.639923:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.639941:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997568.639947:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.639955:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.639972:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997568.639975:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997568.639981:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.639988:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d06e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.640023:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.640030:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.640042:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.640046:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997568.640050:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.640056:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.640062:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:3.0:1789997568.640065:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997568.640068:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997568.640075:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d060 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997568.640086:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008362ad4c reply state 0000000078b9bb99 transno 4294967634 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997568.640095:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997568.640195:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:49953:x1876946704497536:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 4494us (4915us total) trans 4294967634 rc 0/0 00000100:00100000:3.0:1789997568.640204:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 880 00010000:00010000:0.0:1789997568.644296:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.644315:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.644324:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.644331:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997568.644336:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.644344:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.644360:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x1c2d2f2 (ffff8a38ee49ef00) 00010000:00010000:0.0:1789997568.644363:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997568.644368:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997568.644375:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d067 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997568.779011:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997569.802763:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997570.051481:0:84725:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1758743823724ns, next at 1753792264199ns, rc = 0 00000004:00080000:0.0:1789997570.051647:0:84725:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1758743992903ns, next at 1758330599655ns, rc = 0 00000004:00080000:1.0:1789997570.089765:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 80 committed 00000004:00080000:1.0:1789997570.089784:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 77 committed 00000001:00080000:1.0:1789997570.090035:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967634 is committed 00000004:00080000:1.0:1789997570.090041:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 79 committed 00000100:00100000:0.0:1789997570.090616:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997570.090640:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712987520:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997570.090738:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997570.091267:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712987520 00000100:00100000:1.0:1789997570.091276:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712987520 00000100:00080000:0.0:1789997570.091361:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997570.091366:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1789997570.091379:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712987520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789997570.091406:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:28 count 1 00010000:00010000:1.0:1789997570.091430:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997570.091452:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997570.091462:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1c:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1789997570.091467:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997570.091471:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997570.091499:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997570.091520:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 5 pid: 6656 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997570.091533:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712987648:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997570.091613:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32bca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789997570.099870:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997570.099995:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712987648:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997570.100022:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997570.100075:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704497664 00000100:00100000:2.0:1789997570.100083:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704497664 00010000:00010000:2.0:1789997570.100140:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 6 pid: 6656 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997570.100172:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 375 00000100:00100000:2.0:1789997570.100183:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704497664:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997570.100264:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997570.100272:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 6 pid: 6656 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789997570.100276:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997570.100643:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 6 pid: 6656 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997570.100800:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6f69bfa/0x65b43101d592d059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedec expref: 6 pid: 6656 timeout: 1858 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997570.100897:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997570.100913:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997570.100920:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997570.100931:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997570.100959:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997570.100978:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997570.100997:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997570.101009:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997570.101017:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997570.101047:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789997570.101053:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704497664:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 872us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997570.101061:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 375 00010000:00010000:3.0:1789997570.101173:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997570.101182:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997570.101198:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997570.101203:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997570.101214:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997570.101228:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997570.101236:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7e7eec0/0x65b43101d592d07c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997570.101258:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997570.101260:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997570.101262:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997570.101678:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712987520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10278us (10916us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789997570.101687:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000004:00080000:3.0:1789997570.102312:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38e0c60a80/2, rc 0, transno 4294967353 00000100:00100000:3.0:1789997570.102457:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712987520:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789997570.827974:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997571.530899:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712987776:0@lo:400:kworker.0 00000100:00100000:2.0:1789997571.530944:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712988160:0@lo:400:kworker.0 00000100:00100000:0.0:1789997571.530973:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712987904:0@lo:400:kworker.0 00000100:00100000:3.0:1789997571.531005:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997571.531015:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997571.531024:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997571.531077:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712988416:0@lo:400:kworker.0 00000100:00100000:2.0:1789997571.531079:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997571.531084:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712987776 00000100:00100000:2.0:1789997571.531090:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712988288:0@lo:400:kworker.0 00000100:00100000:1.0:1789997571.531095:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712987776 00000100:00100000:0.0:1789997571.531106:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997571.531114:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712988160 00000100:00100000:3.0:1789997571.531121:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712988160 00000100:00100000:2.0:1789997571.531130:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997571.531135:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997571.531142:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712988032:0@lo:400:kworker.0 00000100:00100000:1.0:1789997571.531157:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1789997571.531170:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712987776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997571.531174:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997571.531183:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712988288 00000100:00100000:3.0:1789997571.531188:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712988288 00000100:00100000:2.0:1789997571.531198:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1789997571.531209:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712988160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997571.531212:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712987904 00000100:00100000:0.0:1789997571.531218:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712987904 00000100:00100000:3.0:1789997571.531223:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:3.0:1789997571.531234:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712988288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997571.531247:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712987776:12345-0@lo:400:kworker.0 Request processed in 79us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997571.531256:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1789997571.531258:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712988416 00000100:00100000:0.0:1789997571.531262:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712988416 00000100:00100000:2.0:1789997571.531279:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712988160:12345-0@lo:400:kworker.0 Request processed in 71us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997571.531288:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1789997571.531290:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712988032 00000100:00100000:3.0:1789997571.531293:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712988288:12345-0@lo:400:kworker.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997571.531295:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712988032 00000100:00100000:3.0:1789997571.531306:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1789997571.531329:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1789997571.531338:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712987904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997571.531341:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:2.0:1789997571.531342:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712988288:0@lo:400:kworker.0 00000100:00100000:1.0:1789997571.531357:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712988416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997571.531360:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1789997571.531362:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712988160:0@lo:400:kworker.0 00000100:00100000:3.0:1789997571.531376:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712988032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997571.531402:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712987904:12345-0@lo:400:kworker.0 Request processed in 63us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997571.531412:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:2.0:1789997571.531413:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712987776:0@lo:400:kworker.0 00000100:00100000:1.0:1789997571.531419:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712988416:12345-0@lo:400:kworker.0 Request processed in 65us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997571.531429:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1789997571.531440:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712988032:12345-0@lo:400:kworker.0 Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997571.531448:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00080000:1.0:1789997571.531456:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997571.531463:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997571.531467:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712988032:0@lo:400:kworker.0 00000100:00100000:0.0:1789997571.531482:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712987904:0@lo:400:kworker.0 00000100:00100000:0.0:1789997571.531494:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712988416:0@lo:400:kworker.0 00010000:00010000:3.0:1789997571.851582:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997572.874979:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997573.400941:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997573.400984:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997573.400991:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704497792 00000100:00100000:3.0:1789997573.401001:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704497792 00000100:00100000:0.0:1789997573.401019:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997573.401053:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1069 00000100:00100000:3.0:1789997573.401064:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704497792:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997573.401095:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997573.401153:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704497792:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 91us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997573.401158:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704498048 00000100:00100000:3.0:1789997573.401161:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1069 00000100:00100000:2.0:1789997573.401162:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704498048 00000100:00100000:2.0:1789997573.401197:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704498176 00000100:00100000:3.0:1789997573.401200:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 822 00000100:00100000:2.0:1789997573.401200:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704498176 00000100:00100000:3.0:1789997573.401207:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704498048:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997573.401220:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 823 00000100:00100000:2.0:1789997573.401226:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704498176:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:0.0:1789997573.401619:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997573.401624:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997573.402320:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704497920 00000100:00100000:1.0:1789997573.402327:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704497920 00000100:00100000:1.0:1789997573.402382:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1283 00000100:00100000:1.0:1789997573.402392:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704497920:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997573.402455:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704497920:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 65us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997573.402462:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1283 00000100:00080000:0.0:1789997573.402580:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997573.403626:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704498176:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2394us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997573.403638:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 823 00000100:00100000:2.0:1789997573.406355:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704498048:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 5136us (5358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997573.406370:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 822 00000100:00100000:0.0:1789997573.578934:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997573.578958:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712988544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997573.579042:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997573.579099:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712988672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997573.579122:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712988544 00000100:00100000:0.0:1789997573.579131:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712988544 00000100:00100000:2.0:1789997573.579132:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997573.579191:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712988672 00000100:00100000:0.0:1789997573.579195:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712988672 00000100:00100000:2.0:1789997573.579211:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1789997573.579223:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712988544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997573.579237:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1789997573.579247:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712988672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997573.579270:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00002000:00000024:0.0:1789997573.579271:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997573.579326:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712988544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997573.579334:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712988672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997573.579336:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1789997573.579346:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00080000:2.0:1789997573.579364:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997573.579370:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997573.579411:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712988672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997573.579447:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712988544:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789997573.622774:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00010000:00010000:1.0:1789997573.899202:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997574.923460:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997575.948130:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997576.652257:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997576.652285:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712988800:0@lo:400:kworker.0 00000100:00100000:1.0:1789997576.652322:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712989056:0@lo:400:kworker.0 00000100:00100000:2.0:1789997576.652405:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712989312:0@lo:400:kworker.0 00000100:00100000:3.0:1789997576.652434:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712988928:0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.653247:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997576.653248:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997576.653312:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712989184:0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.653343:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997576.653378:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712988800 00000100:00100000:0.0:1789997576.653385:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712988800 00000100:00100000:0.0:1789997576.654053:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1789997576.654066:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712988800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.654125:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712988800:12345-0@lo:400:kworker.0 Request processed in 62us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997576.654132:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1789997576.654165:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712989184 00000100:00100000:0.0:1789997576.654170:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712989184 00000100:00100000:0.0:1789997576.654209:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:0.0:1789997576.654215:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712989184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.654248:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712989184:12345-0@lo:400:kworker.0 Request processed in 33us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997576.654254:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00080000:0.0:1789997576.654270:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997576.654304:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712989184:0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.654315:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712988800:0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.654703:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712989056 00000100:00100000:0.0:1789997576.654708:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712989056 00000100:00100000:0.0:1789997576.654745:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1789997576.654752:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712989056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.654806:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712989056:12345-0@lo:400:kworker.0 Request processed in 54us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997576.654813:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1789997576.654907:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712989056:0@lo:400:kworker.0 00000100:00080000:1.0:1789997576.654932:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997576.655863:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997576.655906:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712989440:0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.655915:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712988928 00000100:00100000:0.0:1789997576.655922:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712988928 00000100:00100000:3.0:1789997576.655935:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997576.656205:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712989440 00000100:00100000:0.0:1789997576.656210:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712989440 00000100:00100000:0.0:1789997576.656241:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1789997576.656250:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997576.656260:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:3.0:1789997576.656272:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712989440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.656299:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712988928:12345-0@lo:400:kworker.0 Request processed in 50us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997576.656307:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1789997576.656320:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712989440:12345-0@lo:400:kworker.0 Request processed in 50us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997576.656329:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:3.0:1789997576.656363:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712988928:0@lo:400:kworker.0 00000100:00080000:1.0:1789997576.656390:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997576.656517:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712989440:0@lo:400:kworker.0 00000100:00100000:2.0:1789997576.656796:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997576.657054:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712989312 00000100:00100000:0.0:1789997576.657059:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712989312 00000100:00100000:0.0:1789997576.657095:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:0.0:1789997576.657101:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712989312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997576.657144:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712989312:12345-0@lo:400:kworker.0 Request processed in 42us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997576.657151:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1789997576.657172:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:2.0:1789997576.657179:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38e0c60a80, transno 4294967353 00000100:00100000:2.0:1789997576.657200:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712989312:0@lo:400:kworker.0 00000100:00080000:1.0:1789997576.657201:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789997576.972274:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997577.994821:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997578.519602:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997578.519731:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997578.519757:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997578.519787:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704498688 00000100:00100000:3.0:1789997578.519801:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704498688 00000100:00100000:2.0:1789997578.519857:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704498304 00000100:00100000:2.0:1789997578.519863:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704498304 00000100:00100000:3.0:1789997578.519871:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 826 00000100:00100000:3.0:1789997578.519886:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704498688:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997578.519901:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1071 00000100:00100000:2.0:1789997578.519912:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704498304:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997578.519922:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704498432 00000100:00100000:1.0:1789997578.519930:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704498432 00000100:00100000:1.0:1789997578.519971:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1287 00000100:00100000:3.0:1789997578.519977:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704498688:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997578.519986:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704498432:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997578.519989:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 826 00000100:00080000:3.0:1789997578.520335:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997578.520341:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997578.522929:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704498304:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3009us (3340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997578.522943:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1071 00000100:00100000:1.0:1789997578.523502:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704498432:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3516us (3766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997578.523514:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1287 00000100:00100000:0.0:1789997578.523780:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997578.524444:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704498560 00000100:00100000:3.0:1789997578.524454:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704498560 00000100:00100000:3.0:1789997578.524523:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 827 00000100:00100000:3.0:1789997578.524534:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704498560:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:1.0:1789997578.524675:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997578.524700:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704498560:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 166us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997578.524708:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 827 00000100:00100000:0.0:1789997578.698929:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712989568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997578.699002:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997578.699083:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712989568 00000100:00100000:0.0:1789997578.699091:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712989568 00000100:00080000:1.0:1789997578.699125:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997578.699150:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1789997578.699166:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712989568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997578.699202:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997578.699366:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997578.699375:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712989696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997578.699406:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997578.699446:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712989696 00000100:00100000:2.0:1789997578.699450:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712989696 00000100:00100000:2.0:1789997578.699479:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1789997578.699486:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712989696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997578.699504:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997578.699546:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712989696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997578.699552:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1789997578.699600:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712989696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997578.699764:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712989568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 605us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997578.699771:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1789997578.699803:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712989568:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997578.699843:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997579.019043:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997580.046246:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997581.066778:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997581.771410:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712990080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997581.771420:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712989952:0@lo:400:kworker.0 00000100:00100000:3.0:1789997581.771460:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712990208:0@lo:400:kworker.0 00000100:00100000:0.0:1789997581.771495:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997581.771516:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997581.771516:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712989824:0@lo:400:kworker.0 00000100:00100000:2.0:1789997581.771528:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712990080 00000100:00100000:1.0:1789997581.771562:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997581.771586:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712989824 00000100:00100000:2.0:1789997581.771594:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712990080 00000100:00100000:0.0:1789997581.771594:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712989824 00000100:00100000:1.0:1789997581.771606:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712990336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997581.771639:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997581.771678:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1789997581.771685:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1789997581.771691:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712989824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997581.771698:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712990080:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789997581.771703:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997581.771731:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997581.771767:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712990080:12345-0@lo:400:kworker.0 Request processed in 72us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997581.771775:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712989824:12345-0@lo:400:kworker.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997581.771779:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1789997581.771789:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1789997581.771803:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712989952 00000100:00100000:2.0:1789997581.771807:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712989952 00000100:00100000:2.0:1789997581.771836:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1789997581.771844:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712989952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997581.771847:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712990080:0@lo:400:kworker.0 00000100:00100000:0.0:1789997581.771884:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712989824:0@lo:400:kworker.0 00000100:00100000:2.0:1789997581.771886:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712989952:12345-0@lo:400:kworker.0 Request processed in 41us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997581.771897:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:2.0:1789997581.771940:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712990208 00000100:00100000:2.0:1789997581.771945:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712990208 00000100:00100000:0.0:1789997581.771951:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712990336 00000100:00100000:0.0:1789997581.771957:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712990336 00000100:00100000:2.0:1789997581.771982:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1789997581.771993:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1789997581.771994:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712990208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997581.772005:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712990336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997581.772036:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712990208:12345-0@lo:400:kworker.0 Request processed in 46us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997581.772044:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1789997581.772059:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712990336:12345-0@lo:400:kworker.0 Request processed in 56us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997581.772066:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1789997581.772101:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712990336:0@lo:400:kworker.0 00000100:00080000:0.0:1789997581.772124:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997581.772127:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997581.772177:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712989952:0@lo:400:kworker.0 00000100:00100000:1.0:1789997581.772185:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712990464:0@lo:400:kworker.0 00000100:00100000:1.0:1789997581.772211:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997581.773139:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712990464 00000100:00100000:0.0:1789997581.773147:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712990464 00000100:00100000:0.0:1789997581.773225:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1789997581.773234:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712990464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997581.773288:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712990464:12345-0@lo:400:kworker.0 Request processed in 55us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997581.773295:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00080000:1.0:1789997581.773397:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997581.773441:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712990464:0@lo:400:kworker.0 00000100:00100000:3.0:1789997581.773641:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712990208:0@lo:400:kworker.0 00010000:00010000:2.0:1789997582.091574:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997583.114895:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997583.638623:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997583.638702:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997583.638745:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997583.638784:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997583.638815:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704499072 00000100:00100000:2.0:1789997583.638824:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704499072 00000100:00100000:2.0:1789997583.638878:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704499200 00000100:00100000:2.0:1789997583.638882:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704499200 00000100:00100000:2.0:1789997583.638904:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 830 00000100:00100000:2.0:1789997583.638915:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704499072:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997583.638982:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704499072:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997583.638990:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 830 00000100:00100000:2.0:1789997583.639006:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 831 00000100:00100000:2.0:1789997583.639013:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704499200:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997583.639037:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704499200:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997583.639043:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 831 00000100:00100000:3.0:1789997583.639177:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704498816 00000100:00100000:3.0:1789997583.639182:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704498816 00000100:00100000:3.0:1789997583.639222:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1073 00000100:00100000:3.0:1789997583.639229:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704498816:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997583.639255:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704498816:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997583.639261:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1073 00000100:00100000:1.0:1789997583.640641:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704498944 00000100:00100000:1.0:1789997583.640681:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704498944 00000100:00100000:1.0:1789997583.640729:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1291 00000100:00100000:1.0:1789997583.640737:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704498944:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997583.640790:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704498944:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 54us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997583.640797:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1291 00000100:00080000:1.0:1789997583.640816:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997583.640821:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997583.640823:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997583.819564:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712990592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997583.819631:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997583.819686:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712990592 00000100:00100000:2.0:1789997583.819696:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712990592 00000100:00100000:0.0:1789997583.819730:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997583.819740:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712990720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997583.819749:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1789997583.819758:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712990592:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997583.819766:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997583.819791:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712990720 00002000:00000024:2.0:1789997583.819794:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997583.819794:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712990720 00000100:00100000:0.0:1789997583.819819:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1789997583.819825:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712990720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997583.819844:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997583.819859:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712990592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997583.819866:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00080000:1.0:1789997583.819885:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997583.819891:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997583.819892:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712990720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997583.819899:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1789997583.819923:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712990592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997583.819952:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712990720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997584.139169:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997585.162830:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997586.186921:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997586.890904:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712990848:0@lo:400:kworker.0 00000100:00100000:0.0:1789997586.890920:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712990976:0@lo:400:kworker.0 00000100:00100000:3.0:1789997586.891685:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712991104:0@lo:400:kworker.0 00000100:00100000:1.0:1789997586.892072:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997586.892110:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997586.892128:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712991360:0@lo:400:kworker.0 00000100:00100000:3.0:1789997586.892143:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997586.892153:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712991488:0@lo:400:kworker.0 00000100:00100000:1.0:1789997586.892159:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997586.892176:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997586.892181:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712991232:0@lo:400:kworker.0 00000100:00100000:3.0:1789997586.892187:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997586.892202:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997586.892262:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712990848 00000100:00100000:2.0:1789997586.892271:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712990848 00000100:00100000:2.0:1789997586.892326:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1789997586.892336:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712991104 00000100:00100000:2.0:1789997586.892337:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712990848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997586.892344:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712991104 00000100:00100000:1.0:1789997586.892386:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712991488 00000100:00100000:1.0:1789997586.892390:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712991488 00000100:00100000:2.0:1789997586.892407:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712990848:12345-0@lo:400:kworker.0 Request processed in 72us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997586.892417:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1789997586.892417:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1789997586.892452:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712991360 00000100:00100000:2.0:1789997586.892456:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712991360 00000100:00100000:2.0:1789997586.892479:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712991232 00000100:00100000:2.0:1789997586.892482:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712991232 00000100:00100000:2.0:1789997586.892499:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1789997586.892505:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712991360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997586.892536:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712991360:12345-0@lo:400:kworker.0 Request processed in 31us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997586.892542:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:2.0:1789997586.892553:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1789997586.892559:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712991232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997586.892583:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712991232:12345-0@lo:400:kworker.0 Request processed in 25us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997586.892589:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1789997586.893141:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997586.893188:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712990976 00000100:00100000:0.0:1789997586.893193:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712990976 00000100:00100000:1.0:1789997586.893521:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712991104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997586.893570:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712991104:12345-0@lo:400:kworker.0 Request processed in 55us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997586.895084:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1789997586.895102:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712991488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997586.895158:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712991488:12345-0@lo:400:kworker.0 Request processed in 65us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997586.895165:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1789997586.895396:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712991232:0@lo:400:kworker.0 00000100:00100000:2.0:1789997586.895413:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712991360:0@lo:400:kworker.0 00000100:00100000:2.0:1789997586.895422:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712990848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997586.895484:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712991488:0@lo:400:kworker.0 00000100:00100000:2.0:1789997586.895494:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712991104:0@lo:400:kworker.0 00000100:00080000:2.0:1789997586.895543:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997586.895548:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997586.895552:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997586.898767:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:0.0:1789997586.898810:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1789997586.898832:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712990976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997586.898936:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712990976:12345-0@lo:400:kworker.0 Request processed in 116us (5912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997586.899164:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712990976:0@lo:400:kworker.0 00000100:00100000:0.0:1789997586.900397:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00010000:00010000:3.0:1789997587.211569:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997587.820579:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997587.820679:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704499328 00000100:00100000:2.0:1789997587.820691:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704499328 00000100:00100000:2.0:1789997587.820786:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 881 00000100:00100000:2.0:1789997587.820799:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50255:x1876946704499328:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00080000:1.0:1789997587.821030:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997587.821442:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50255:x1876946704499328:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 644us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997587.821452:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 881 00000100:00100000:3.0:1789997587.823735:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997587.823832:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704499456 00000100:00100000:2.0:1789997587.823919:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704499456 00000100:00100000:2.0:1789997587.823999:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 472 00000100:00100000:2.0:1789997587.824010:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50255:x1876946704499456:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997587.824795:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50255:x1876946704499456:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 784us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997587.824804:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 472 00000100:00080000:1.0:1789997587.825865:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997587.827066:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997587.827159:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704499584 00000100:00100000:2.0:1789997587.827168:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704499584 00000100:00080000:1.0:1789997587.827255:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997587.827298:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 473 00000100:00100000:2.0:1789997587.827308:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50255:x1876946704499584:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997587.828178:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50255:x1876946704499584:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 866us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997587.828188:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 473 00000100:00100000:3.0:1789997587.833443:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997587.833569:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704499712 00000100:00100000:2.0:1789997587.833579:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704499712 00000100:00100000:2.0:1789997587.833641:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 882 00000100:00100000:2.0:1789997587.833676:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50255:x1876946704499712:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997587.834167:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50255:x1876946704499712:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 516us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997587.834174:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 882 00000100:00100000:3.0:1789997587.838179:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997587.838953:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704499840 00000100:00100000:1.0:1789997587.838965:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704499840 00000100:00100000:1.0:1789997587.839036:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 883 00000100:00100000:1.0:1789997587.839047:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50255:x1876946704499840:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997587.839165:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50255:x1876946704499840:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 120us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997587.839173:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 883 00000100:00100000:0.0:1789997587.849922:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997587.850015:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704499968 00000100:00100000:3.0:1789997587.850027:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704499968 00000100:00100000:3.0:1789997587.850087:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 474 00000100:00100000:3.0:1789997587.850098:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50255:x1876946704499968:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997587.850784:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50255:x1876946704499968:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 686us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997587.850794:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 474 00000100:00100000:3.0:1789997587.855077:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997587.855183:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704500096 00000100:00100000:0.0:1789997587.855194:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704500096 00000100:00100000:0.0:1789997587.855327:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 475 00000100:00100000:0.0:1789997587.855339:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50255:x1876946704500096:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997587.855961:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50255:x1876946704500096:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 623us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997587.855969:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 475 00000100:00100000:0.0:1789997587.859933:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997587.860022:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704500224 00000100:00100000:3.0:1789997587.860032:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704500224 00000100:00100000:3.0:1789997587.860092:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 884 00000100:00100000:3.0:1789997587.860104:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50255:x1876946704500224:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997587.860770:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50255:x1876946704500224:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 665us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997587.860779:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 884 00000100:00100000:1.0:1789997587.883433:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997587.883472:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704500352 00000100:00100000:1.0:1789997587.883482:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704500352 00000100:00100000:1.0:1789997587.883534:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 885 00000100:00100000:1.0:1789997587.883544:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50256:x1876946704500352:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997587.883565:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997587.883584:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedf3 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.883643:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d08a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.883673:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.883689:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997587.883724:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00000004:00200000:1.0:1789997587.883729:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997587.883748:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.883774:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedf3 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.883791:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d08a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedf3 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.883799:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:1.0:1789997587.883802:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997587.883806:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997587.883861:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50256:x1876946704500352:12345-192.168.204.4@tcp:101:rm.0 Request processed in 319us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997587.883871:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 885 00000100:00100000:3.0:1789997587.887812:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997587.887859:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704500608 00000100:00100000:0.0:1789997587.887869:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704500608 00000100:00100000:0.0:1789997587.887933:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 886 00000100:00100000:0.0:1789997587.887944:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50256:x1876946704500608:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997587.887966:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997587.887988:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d091 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaedfa expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997587.888075:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00010000:0.0:1789997587.888339:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d091 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedfa expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997587.888355:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997587.888358:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789997587.888363:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d091 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedfa expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997587.888385:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997587.888452:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50256:x1876946704500608:12345-192.168.204.4@tcp:101:rm.0 Request processed in 509us (647us total) trans 4294967635 rc 301/301 00000100:00100000:0.0:1789997587.888460:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 886 00000100:00100000:1.0:1789997587.892372:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997587.892426:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704500736 00000100:00100000:1.0:1789997587.892437:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704500736 00000100:00100000:1.0:1789997587.892484:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:1.0:1789997587.892493:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50256:x1876946704500736:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:1.0:1789997587.897369:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50256:x1876946704500736:12345-192.168.204.4@tcp:37:rm.0 Request processed in 4865us (4993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997587.897384:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 91 00000100:00100000:0.0:1789997587.902087:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997587.902240:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704500992 00000100:00100000:1.0:1789997587.902251:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704500992 00000100:00100000:1.0:1789997587.902592:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:1.0:1789997587.902603:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50256:x1876946704500992:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:1.0:1789997587.903385:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50256:x1876946704500992:12345-192.168.204.4@tcp:35:rm.0 Request processed in 715us (1238us total) trans 4294967636 rc 0/0 00000100:00100000:1.0:1789997587.903394:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 92 00000100:00100000:1.0:1789997587.912292:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997587.913926:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704501248 00000100:00100000:0.0:1789997587.913941:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704501248 00000100:00100000:0.0:1789997587.914017:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 887 00000100:00100000:1.0:1789997587.914160:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50256:x1876946704501248:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997587.914219:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789997587.914259:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d08a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedf3 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.914285:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660fe00/0x65b43101d592d02f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaedde expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.914305:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:1.0:1789997587.914323:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38f660ee00/0x65b43101d592cd3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaed28 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.914333:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:1.0:1789997587.914340:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997587.914375:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.914390:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.914401:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.914417:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.914425:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.914432:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.915017:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.915030:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.915044:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997587.916434:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 16384 00010000:00010000:1.0:1789997587.916625:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.916636:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.916644:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.916651:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997587.916693:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.916701:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.916716:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997587.916719:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997587.916724:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.916730:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d0ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.917202:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.917210:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.917217:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.917222:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997587.917225:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.917241:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.917250:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:1.0:1789997587.917254:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997587.917257:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997587.917263:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d09f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997587.917277:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d75368a9 reply state 000000009209b358 transno 4294967637 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997587.917285:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997587.917376:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50256:x1876946704501248:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3344us (5086us total) trans 4294967637 rc 0/0 00000100:00100000:1.0:1789997587.917386:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 887 00010000:00010000:0.0:1789997587.923847:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997587.923862:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997587.923871:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997587.923878:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997587.923883:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997587.923891:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997587.923908:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38e062d900) 00010000:00010000:0.0:1789997587.923912:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997587.923917:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997587.923928:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0a6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997588.235806:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997588.764156:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997588.764185:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997588.764205:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997588.764244:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997588.764274:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704501632 00000100:00100000:2.0:1789997588.764284:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704501632 00000100:00100000:2.0:1789997588.764330:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704501760 00000100:00100000:2.0:1789997588.764334:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704501760 00000100:00100000:2.0:1789997588.764354:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 834 00000100:00100000:2.0:1789997588.764377:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704501632:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997588.764449:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704501632:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997588.764457:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 834 00000100:00100000:2.0:1789997588.764474:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 835 00000100:00100000:2.0:1789997588.764480:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704501760:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997588.764506:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704501760:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997588.764512:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 835 00000100:00100000:2.0:1789997588.764529:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704501504 00000100:00100000:2.0:1789997588.764532:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704501504 00000100:00100000:2.0:1789997588.764556:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1295 00000100:00100000:2.0:1789997588.764562:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704501504:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997588.764589:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704501504:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997588.764594:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1295 00000100:00100000:1.0:1789997588.765201:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704501376 00000100:00100000:1.0:1789997588.765207:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704501376 00000100:00100000:1.0:1789997588.765257:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1075 00000100:00100000:1.0:1789997588.765266:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704501376:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997588.765309:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704501376:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997588.765315:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1075 00000100:00100000:3.0:1789997588.938848:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997588.939009:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712991744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997588.939077:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997588.939149:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712991744 00000100:00100000:2.0:1789997588.939156:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712991744 00000100:00100000:2.0:1789997588.939207:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1789997588.939230:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712991744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997588.939263:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997588.939310:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712991744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997588.939317:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1789997588.939367:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712991744:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997588.939454:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997588.941556:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712991616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997588.941627:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997588.942348:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712991616 00000100:00100000:2.0:1789997588.942357:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712991616 00000100:00100000:2.0:1789997588.942547:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:2.0:1789997588.942557:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712991616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997588.942595:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997588.942669:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712991616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997588.942676:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00080000:1.0:1789997588.942780:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997588.943698:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712991616:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997589.258883:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997590.171619:0:85134:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbff20c90 20000000:00000080:0.0:1789997590.171634:0:85134:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb10f800 uarg=0000000000000000 10000000:01000000:0.0:1789997590.171793:0:85134:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997590.171811:0:85134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997590.171829:0:85134:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592cd26 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997590.171838:0:85134:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997590.171876:0:85134:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592cd26 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997590.171889:0:85134:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592cd26 expref: 18 pid: 5803 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997590.171903:0:85134:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85134:1876946712991872:0@lo:104: 00000100:00100000:0.0:1789997590.171958:0:85134:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997590.172049:0:85134:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59480 going to sleep for 11 seconds 00000100:00100000:1.0:1789997590.172090:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712991872 00000100:00100000:1.0:1789997590.172098:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712991872 00000100:00100000:1.0:1789997590.172214:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789997590.172224:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:85134:x1876946712991872:12345-0@lo:104: 00010000:00010000:1.0:1789997590.172237:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997590.172340:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997590.172347:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:85134:x1876946712991872:12345-0@lo:104: Request processed in 124us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997590.172355:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:2.0:1789997590.172453:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997590.172461:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172468:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997590.172472:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172480:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997590.172488:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997590.172494:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997590.172522:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172529:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997590.172548:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172555:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592cd26 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592cd2d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997590.172567:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712992000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997590.172570:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997590.172574:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997590.172576:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997590.172605:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997590.172630:0:85134:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85134:1876946712991872:0@lo:104: 00000100:00100000:2.0:1789997590.172697:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712992000 00000100:00100000:2.0:1789997590.172702:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712992000 00010000:00010000:2.0:1789997590.172719:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cd26 expref: 19 pid: 5803 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997590.172736:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789997590.172741:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712992000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997590.172750:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997590.172754:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592cd26 expref: 19 pid: 5803 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172763:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592cd26 expref: 19 pid: 5803 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172775:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660f200/0x65b43101d592cd2d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592cd26 expref: 19 pid: 5803 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172787:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172795:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172807:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172814:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172821:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172828:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172834:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997590.172838:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172845:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172852:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.172861:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997590.172893:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946712992000:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997590.172900:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789997590.172927:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712992000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997590.172956:0:85134:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997590.172971:0:85134:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997590.172978:0:85134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997590.172985:0:85134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d0b4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.284714:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997590.918264:0:85183:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9451a8b0 20000000:00000080:2.0:1789997590.918283:0:85183:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9b13c00 uarg=0000000000000000 00010000:00010000:2.0:1789997590.918988:0:85183:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997590.919004:0:85183:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997590.919018:0:85183:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997590.919038:0:85183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919053:0:85183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919068:0:85183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919075:0:85183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919082:0:85183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919089:0:85183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919096:0:85183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997590.919100:0:85183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919108:0:85183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919120:0:85183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919128:0:85183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997590.919134:0:85183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d0bb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997591.040724:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967635 is committed 00000001:00080000:1.0:1789997591.040747:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967637 is committed 00010000:00010000:0.0:1789997591.307043:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997591.627803:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997591.627811:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997591.627895:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997591.628009:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997591.628022:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997591.628034:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997591.628059:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712992128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997591.628126:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997591.628194:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e14f8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789997591.628257:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712992128 00000100:00100000:2.0:1789997591.628266:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712992128 00000100:00100000:2.0:1789997591.628358:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1789997591.628369:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712992128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997591.628382:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997591.628406:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d0c2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997591.628429:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997591.628440:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997591.628448:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997591.628493:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712992128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997591.628500:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:3.0:1789997591.628635:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712992128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997591.628649:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997591.628678:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997591.628697:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997591.628702:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997591.628710:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997592.010878:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712992256:0@lo:400:kworker.0 00000100:00100000:2.0:1789997592.010948:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997592.011022:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712992768:0@lo:400:kworker.0 00000100:00100000:0.0:1789997592.011022:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712992256 00000100:00100000:0.0:1789997592.011032:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712992256 00000100:00100000:2.0:1789997592.011051:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997592.011088:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997592.011088:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712992768 00000100:00100000:0.0:1789997592.011093:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712992768 00000100:00100000:2.0:1789997592.011098:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712992384:0@lo:400:kworker.0 00000100:00100000:2.0:1789997592.011125:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997592.011137:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712992384 00000100:00100000:0.0:1789997592.011141:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712992384 00000100:00100000:2.0:1789997592.011172:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712992512:0@lo:400:kworker.0 00000100:00100000:0.0:1789997592.011185:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:0.0:1789997592.011196:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712992256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997592.011205:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997592.011225:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997592.011232:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712992640:0@lo:400:kworker.0 00000100:00100000:1.0:1789997592.011347:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1789997592.011357:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712992768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997592.011640:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1789997592.011673:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712992384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997592.013847:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946712992256:12345-0@lo:400:kworker.0 Request processed in 2644us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997592.013851:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997592.013863:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1789997592.013912:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712992768:12345-0@lo:400:kworker.0 Request processed in 2556us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997592.013919:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:2.0:1789997592.013930:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712992512 00000100:00080000:1.0:1789997592.013942:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997592.013950:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946712992256:0@lo:400:kworker.0 00000100:00100000:0.0:1789997592.013963:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712992768:0@lo:400:kworker.0 00000100:00100000:0.0:1789997592.013996:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712992640 00000100:00100000:0.0:1789997592.014000:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712992640 00000100:00100000:0.0:1789997592.014044:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1789997592.014053:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712992640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997592.014102:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712992640:12345-0@lo:400:kworker.0 Request processed in 52us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997592.014108:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00080000:0.0:1789997592.014122:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997592.014180:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712992512 00000100:00100000:3.0:1789997592.014211:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712992384:12345-0@lo:400:kworker.0 Request processed in 2562us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997592.014219:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1789997592.014222:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1789997592.014233:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712992512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997592.014275:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712992640:0@lo:400:kworker.0 00000100:00100000:2.0:1789997592.014277:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712992512:12345-0@lo:400:kworker.0 Request processed in 47us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997592.014287:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1789997592.014293:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712992512:0@lo:400:kworker.0 00000100:00080000:0.0:1789997592.014366:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997592.014459:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712992384:0@lo:400:kworker.0 00010000:00010000:0.0:1789997592.331111:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997593.036919:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997593.037026:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704501888 00000100:00100000:0.0:1789997593.037035:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704501888 00000100:00100000:0.0:1789997593.037097:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 888 00000100:00100000:0.0:1789997593.037105:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50369:x1876946704501888:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997593.037122:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997593.037164:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d0d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee01 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789997593.037180:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997593.037226:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d0d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.037240:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.037253:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997593.037288:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789997593.037292:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997593.037320:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.037347:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d0d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee01 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.037380:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee01 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.037388:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997593.037391:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997593.037395:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997593.037566:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50369:x1876946704501888:12345-192.168.204.4@tcp:101:rm.0 Request processed in 461us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997593.037574:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 888 00000100:00100000:1.0:1789997593.039284:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997593.039479:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704502016 00000100:00100000:2.0:1789997593.039490:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704502016 00000100:00100000:2.0:1789997593.039537:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 889 00000100:00100000:2.0:1789997593.039548:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50369:x1876946704502016:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997593.039565:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997593.039581:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d0de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee08 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039630:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039641:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039648:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039688:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039700:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039707:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039909:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039917:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039923:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039929:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997593.039934:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039942:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039954:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:2.0:1789997593.039957:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997593.039962:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039968:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d0e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039979:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039986:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039992:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.039997:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997593.040000:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.040005:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.040012:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997593.040015:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997593.040018:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.040023:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d0ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.040051:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d0de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee08 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.040061:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:2.0:1789997593.040063:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997593.040066:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d0de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee08 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.040076:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2400, rc 0) 00000100:00100000:2.0:1789997593.040139:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50369:x1876946704502016:12345-192.168.204.4@tcp:101:rm.0 Request processed in 583us (849us total) trans 0 rc 301/301 00000100:00100000:2.0:1789997593.040147:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 889 00000100:00100000:2.0:1789997593.063298:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997593.063748:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704502272 00000100:00100000:1.0:1789997593.063758:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704502272 00000100:00100000:1.0:1789997593.063858:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 890 00000100:00100000:1.0:1789997593.063869:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50373:x1876946704502272:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:1.0:1789997593.063919:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997593.063943:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d0d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee01 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.063968:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:1.0:1789997593.063979:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997593.064204:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.064214:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.064221:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.064229:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.064233:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.064237:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997593.065103:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00010000:1.0:1789997593.065114:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.065121:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.065139:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.065145:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997593.065149:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.065157:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.065182:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997593.065188:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997593.065193:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.065199:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d0f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997593.065222:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc76bf8c reply state 00000000e4ba25ff transno 4294967638 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997593.065231:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997593.065332:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50373:x1876946704502272:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 1462us (2041us total) trans 4294967638 rc 0/0 00000100:00100000:1.0:1789997593.065340:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 890 00010000:00010000:0.0:1789997593.067427:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.067442:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.067449:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.067454:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997593.067458:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.067466:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.067482:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38e062dd00) 00010000:00010000:0.0:1789997593.067485:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997593.067491:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.067496:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d0fa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997593.095116:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997593.095234:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704502400 00000100:00100000:1.0:1789997593.095244:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704502400 00000100:00100000:1.0:1789997593.095345:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 891 00000100:00100000:1.0:1789997593.095365:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50377:x1876946704502400:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:1.0:1789997593.095391:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997593.095411:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee0f expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.095466:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d108 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.095492:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.095503:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997593.095538:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997593.095542:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997593.095559:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d108 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.095581:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee0f expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.095597:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d108 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee0f expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.095606:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997593.095608:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997593.095611:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997593.095713:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50377:x1876946704502400:12345-192.168.204.4@tcp:101:chown.0 Request processed in 359us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997593.095720:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 891 00000100:00100000:1.0:1789997593.098404:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997593.098511:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704502528 00000100:00100000:2.0:1789997593.098524:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704502528 00000100:00100000:2.0:1789997593.098593:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 892 00000100:00100000:2.0:1789997593.098604:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50377:x1876946704502528:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1789997593.098625:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997593.098644:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d10f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee16 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.098735:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.098766:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.098781:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.098799:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.098808:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.098815:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.098936:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099077:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099089:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997593.099141:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:2.0:1789997593.099144:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997593.099168:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099181:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099189:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099196:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099202:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997593.099207:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099215:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099228:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:2.0:1789997593.099232:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997593.099237:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099243:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099256:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099263:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099269:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099274:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997593.099277:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099282:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099289:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997593.099291:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997593.099294:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099299:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d11d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099330:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d10f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee16 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099348:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee16 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.099355:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997593.099357:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997593.099359:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2000, rc 0) 00000100:00100000:2.0:1789997593.099431:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50377:x1876946704502528:12345-192.168.204.4@tcp:101:chown.0 Request processed in 828us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997593.099439:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 892 00000100:00100000:2.0:1789997593.105641:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997593.105716:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704502784 00000100:00100000:3.0:1789997593.105727:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704502784 00000100:00100000:3.0:1789997593.105792:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 893 00000100:00100000:3.0:1789997593.105803:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50377:x1876946704502784:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:3.0:1789997593.105857:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997593.105882:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee16 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.105902:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997593.105913:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997593.105938:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.105951:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.105962:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997593.146817:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967638 is committed 00000001:00080000:0.0:1789997593.146833:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967639 is committed 00000004:00010000:3.0:1789997593.146937:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025e83826 reply state 00000000c731f123 transno 4294967639 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997593.147023:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997593.147041:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00080000:3.0:1789997593.147188:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997593.147211:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50377:x1876946704502784:12345-192.168.204.4@tcp:36:chown.0 Request processed in 41406us (41576us total) trans 4294967639 rc 0/0 00000100:00100000:3.0:1789997593.147221:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 893 00010000:00010000:0.0:1789997593.147547:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.147556:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.147565:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.147571:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997593.147575:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.147583:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.147598:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:0.0:1789997593.147602:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997593.147607:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.147615:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d12b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.355175:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997593.731469:0:85380:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdaff551b0 20000000:00000080:2.0:1789997593.731489:0:85380:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9b13c00 uarg=0000000000000000 10000000:01000000:2.0:1789997593.731539:0:85380:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997593.731561:0:85380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.731581:0:85380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.731590:0:85380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.731630:0:85380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.731645:0:85380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 18 pid: 5805 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997593.731736:0:85380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85380:1876946712992896:0@lo:104: 00000100:00100000:2.0:1789997593.731800:0:85380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997593.731874:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712992896 00000100:00100000:0.0:1789997593.731883:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712992896 00000100:00100000:2.0:1789997593.731897:0:85380:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c13cb840 going to sleep for 11 seconds 00000100:00100000:0.0:1789997593.731945:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789997593.731956:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:85380:x1876946712992896:12345-0@lo:104: 00010000:00010000:0.0:1789997593.731969:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997593.732038:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997593.732045:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:85380:x1876946712992896:12345-0@lo:104: Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997593.732052:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:1.0:1789997593.732096:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997593.732104:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.732111:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997593.732127:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.732137:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997593.732144:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997593.732149:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997593.732188:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.732196:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997593.732239:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.732245:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b400/0x65b43101d592d0c2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d0c9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997593.732260:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997593.732262:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997593.732264:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997593.732272:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997593.732282:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712993024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997593.732318:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997593.732359:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712993024 00000100:00100000:3.0:1789997593.732366:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712993024 00010000:00010000:3.0:1789997593.732389:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 19 pid: 5805 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997593.732470:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789997593.732479:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946712993024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997593.732490:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997593.732496:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 19 pid: 5805 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997593.732497:0:85380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85380:1876946712992896:0@lo:104: 00010000:00010000:3.0:1789997593.732514:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 19 pid: 5805 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.732526:0:85380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732531:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d0c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d0c2 expref: 19 pid: 5805 timeout: 1932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732552:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732561:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732575:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732588:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732600:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732607:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732613:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997593.732618:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732627:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732647:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997593.732681:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997593.732717:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946712993024:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997593.732725:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789997593.732741:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946712993024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997593.732828:0:85380:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.732837:0:85380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997593.732842:0:85380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592d132 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997593.880107:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997593.880235:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997593.880280:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997593.880333:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704502912 00000100:00100000:1.0:1789997593.880363:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704502912 00000100:00100000:1.0:1789997593.880419:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1077 00000100:00100000:1.0:1789997593.880430:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704502912:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997593.880501:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704502912:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997593.880510:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1077 00000100:00100000:0.0:1789997593.881150:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704503040 00000100:00100000:0.0:1789997593.881157:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704503040 00000100:00100000:2.0:1789997593.881183:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704503168 00000100:00100000:2.0:1789997593.881190:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704503168 00000100:00080000:3.0:1789997593.881338:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997593.881350:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997593.881389:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 838 00000100:00100000:2.0:1789997593.881398:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704503168:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997593.881451:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704503168:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 55us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997593.881458:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 838 00000100:00100000:1.0:1789997593.881686:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 839 00000100:00100000:1.0:1789997593.881695:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704503040:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997593.881863:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704503040:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 169us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997593.881870:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 839 00000100:00100000:3.0:1789997594.058913:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712993152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997594.058978:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997594.059097:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712993152 00000100:00100000:1.0:1789997594.059104:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712993152 00000100:00100000:1.0:1789997594.059163:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1789997594.059171:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712993152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997594.059200:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997594.059238:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712993152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997594.059244:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00080000:1.0:1789997594.059276:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997594.059308:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712993152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997594.059322:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997594.059328:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712993280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997594.059358:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997594.059380:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712993280 00000100:00100000:1.0:1789997594.059383:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712993280 00000100:00100000:1.0:1789997594.059405:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:1.0:1789997594.059410:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712993280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997594.059426:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997594.059452:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712993280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997594.059458:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00080000:1.0:1789997594.059469:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997594.059484:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712993280:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1789997594.277184:0:85428:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe32f96360 20000000:00000080:0.0:1789997594.277202:0:85428:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb10f800 uarg=0000000000000000 00010000:00010000:0.0:1789997594.277924:0:85428:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997594.277958:0:85428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:0.0:1789997594.277962:0:85428:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997594.277972:0:85428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d108 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee0f expref: 5 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.277996:0:85428:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997594.278014:0:85428:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997594.278029:0:85428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278042:0:85428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278057:0:85428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278064:0:85428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278070:0:85428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278078:0:85428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278083:0:85428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997594.278087:0:85428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278094:0:85428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278115:0:85428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278124:0:85428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.278130:0:85428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592d139 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997594.379397:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997595.402968:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997595.467101:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997595.467109:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997595.467113:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997595.467157:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997595.467169:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997595.467180:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997595.467205:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712993408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997595.467277:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997595.467329:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997595.467449:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712993408 00000100:00100000:2.0:1789997595.467458:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712993408 00000100:00100000:2.0:1789997595.467517:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1789997595.467527:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946712993408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997595.467542:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997595.467555:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d140 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997595.467579:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d140 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997595.467608:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d140 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997595.467619:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789997595.467690:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946712993408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997595.467697:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1789997595.467911:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946712993408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997595.467927:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997595.467936:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997595.467953:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997595.467957:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997595.467964:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997596.335427:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997596.335494:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704503296 00000100:00100000:2.0:1789997596.335506:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704503296 00000100:00100000:2.0:1789997596.335592:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00100000:2.0:1789997596.335603:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:6036:x1876946704503296:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997596.335619:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997596.335621:0:5797:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592d108) 00010000:00010000:2.0:1789997596.335623:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997596.335725:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:6036:x1876946704503296:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 115us (299us total) trans 0 rc 116/116 00000100:00100000:2.0:1789997596.335733:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 14 00000100:00080000:1.0:1789997596.335852:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789997596.427736:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997596.949063:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997596.949148:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704503424 00000100:00100000:3.0:1789997596.949158:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704503424 00000100:00100000:3.0:1789997596.949214:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 894 00000100:00100000:3.0:1789997596.949223:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50482:x1876946704503424:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997596.949247:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997596.949269:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d14e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee1d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997596.949324:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d155 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997596.949337:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997596.949348:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997596.949380:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997596.949384:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997596.949401:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997596.949422:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d14e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee1d expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997596.949438:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d155 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee1d expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997596.949452:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997596.949455:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997596.949459:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997596.949508:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50482:x1876946704503424:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 286us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997596.949514:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 894 00000100:00100000:0.0:1789997596.952575:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997596.952700:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704503552 00000100:00100000:2.0:1789997596.952710:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704503552 00000100:00100000:2.0:1789997596.952756:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 895 00000100:00100000:2.0:1789997596.952765:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50482:x1876946704503552:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997596.952785:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997596.952803:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d15c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.952857:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.952872:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.952884:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.952897:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.952903:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.952909:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953200:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953210:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953217:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997596.953250:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:2.0:1789997596.953254:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997596.953273:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953721:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953731:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953738:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953744:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997596.953748:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953755:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953768:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:2.0:1789997596.953771:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997596.953776:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953783:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953793:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953800:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953810:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953815:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997596.953818:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953824:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953832:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997596.953835:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997596.953838:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953843:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d16a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953877:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d15c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee24 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953891:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee24 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997596.953898:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997596.953900:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997596.953902:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2000, rc 0) 00000100:00100000:2.0:1789997596.954966:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50482:x1876946704503552:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 2196us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997596.954979:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 895 00000100:00100000:3.0:1789997596.966159:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997596.966234:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704503808 00000100:00100000:0.0:1789997596.966244:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704503808 00000100:00100000:0.0:1789997596.966308:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 896 00000100:00100000:0.0:1789997596.966318:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50482:x1876946704503808:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997596.966372:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997596.966399:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee24 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997596.966415:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:0.0:1789997596.966426:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997596.966452:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997596.966466:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997596.966476:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997597.004180:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000020532eb8 reply state 00000000c54733dc transno 4294967640 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997597.004192:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967640 is committed 00000100:00100000:0.0:1789997597.004200:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997597.004217:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00080000:0.0:1789997597.004426:0:5810:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997597.004453:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50482:x1876946704503808:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 38131us (38297us total) trans 4294967640 rc 0/0 00000100:00100000:0.0:1789997597.004463:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 896 00010000:00010000:2.0:1789997597.004537:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.004546:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.004554:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.004560:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997597.004566:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.004575:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.004592:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997597.004594:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997597.004601:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.004608:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d178 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997597.057753:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997597.057927:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704503936 00000100:00100000:3.0:1789997597.057937:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704503936 00000100:00100000:3.0:1789997597.058035:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 897 00000100:00100000:3.0:1789997597.058048:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50486:x1876946704503936:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997597.058083:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997597.058104:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d17f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee2b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.058168:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.058183:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.058310:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.058395:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.058404:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.058413:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059275:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059288:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059298:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997597.059401:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789997597.059406:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997597.059427:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059440:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059446:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059452:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059457:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997597.059461:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059468:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059481:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997597.059485:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997597.059560:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059573:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059588:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059595:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059601:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059607:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997597.059610:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059617:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059626:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997597.059815:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997597.059821:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.059827:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d18d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.060436:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d17f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee2b expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.060454:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee2b expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.060461:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997597.060464:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997597.060466:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:2.0:1789997597.062171:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50486:x1876946704503936:12345-192.168.204.4@tcp:101:touch.0 Request processed in 4120us (4422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997597.062182:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 897 00000100:00100000:0.0:1789997597.068960:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997597.069092:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704504192 00000100:00100000:2.0:1789997597.069102:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704504192 00000100:00100000:3.0:1789997597.069424:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 898 00000100:00100000:3.0:1789997597.069438:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50486:x1876946704504192:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997597.069460:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997597.069479:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d19b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee32 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.071023:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.071044:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.071069:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.071085:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.071093:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.071104:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997597.073310:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:1.0:1789997597.073811:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073829:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073841:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073879:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073886:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073892:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073898:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997597.073902:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073908:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073920:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:1.0:1789997597.073923:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997597.073928:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.073934:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997597.074085:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c2659bc reply state 00000000a2db7613 transno 4294967641 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997597.074096:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997597.074135:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d19b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee32 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.074152:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee32 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.074159:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997597.074161:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997597.074164:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997597.074245:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50486:x1876946704504192:12345-192.168.204.4@tcp:101:touch.0 Request processed in 4810us (5295us total) trans 4294967641 rc 0/0 00000100:00100000:1.0:1789997597.074253:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 898 00010000:00010000:2.0:1789997597.076586:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.076603:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.076610:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.076616:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997597.076620:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.076627:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.076643:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38e062d900) 00010000:00010000:2.0:1789997597.076646:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997597.076651:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.076672:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d1a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997597.079171:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997597.079641:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704504448 00000100:00100000:3.0:1789997597.079671:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704504448 00000100:00100000:3.0:1789997597.079733:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 899 00000100:00100000:3.0:1789997597.079743:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50486:x1876946704504448:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:3.0:1789997597.079796:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997597.079821:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d1b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee32 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.079839:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:3.0:1789997597.079853:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997597.079899:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.079913:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.079922:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997597.080072:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009c9a1da reply state 00000000cc82ecae transno 4294967642 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997597.080081:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997597.080234:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50486:x1876946704504448:12345-192.168.204.4@tcp:36:touch.0 Request processed in 490us (1069us total) trans 4294967642 rc 0/0 00000100:00100000:3.0:1789997597.080241:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 899 00010000:00010000:0.0:1789997597.083187:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.083214:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.083221:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.083227:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997597.083231:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.083238:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.083252:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:0.0:1789997597.083255:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997597.083259:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.083265:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d1be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997597.089083:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997597.089186:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704504576 00000100:00100000:1.0:1789997597.089266:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704504576 00000100:00100000:1.0:1789997597.089400:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 900 00000100:00100000:1.0:1789997597.089412:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50486:x1876946704504576:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997597.089435:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997597.089457:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee39 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.089522:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee39 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.089539:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee39 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.089559:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:1.0:1789997597.089562:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789997597.089566:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997597.089695:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50486:x1876946704504576:12345-192.168.204.4@tcp:101:touch.0 Request processed in 285us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997597.089702:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 900 00000100:00100000:3.0:1789997597.094581:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997597.094756:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704504704 00000100:00100000:1.0:1789997597.094766:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704504704 00000100:00080000:2.0:1789997597.094877:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997597.095143:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 476 00000100:00100000:1.0:1789997597.095156:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704504704:12345-192.168.204.4@tcp:2:touch.0 00000100:00100000:1.0:1789997597.096408:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704504704:12345-192.168.204.4@tcp:2:touch.0 Request processed in 1248us (1840us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789997597.096419:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 476 00000100:00100000:0.0:1789997597.098974:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997597.101784:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704504960 00000100:00100000:2.0:1789997597.101799:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704504960 00000100:00100000:2.0:1789997597.101877:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:2.0:1789997597.101889:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de233450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50486:x1876946704504960:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:2.0:1789997597.102255:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de233450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50486:x1876946704504960:12345-192.168.204.4@tcp:35:touch.0 Request processed in 368us (3288us total) trans 4294967643 rc 0/0 00000100:00100000:2.0:1789997597.102266:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 93 00000100:00100000:2.0:1789997597.131240:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997597.131306:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712993664:0@lo:400:kworker.0 00000100:00100000:2.0:1789997597.131376:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997597.131446:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712993536:0@lo:400:kworker.0 00000100:00100000:2.0:1789997597.131486:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997597.131527:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712993536 00000100:00100000:2.0:1789997597.131536:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712993536 00000100:00100000:2.0:1789997597.131593:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1789997597.131604:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712993536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997597.131689:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712993536:12345-0@lo:400:kworker.0 Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997597.131697:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1789997597.131761:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712993664 00000100:00100000:3.0:1789997597.131766:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712993664 00000100:00100000:3.0:1789997597.131858:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:3.0:1789997597.131866:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712993664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997597.131912:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712993536:0@lo:400:kworker.0 00000100:00100000:0.0:1789997597.133188:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712994176:0@lo:400:kworker.0 00000100:00100000:1.0:1789997597.133338:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712993792:0@lo:400:kworker.0 00000100:00100000:2.0:1789997597.133369:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712993920:0@lo:400:kworker.0 00000100:00100000:3.0:1789997597.134490:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712993664:12345-0@lo:400:kworker.0 Request processed in 2619us (3109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997597.134501:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1789997597.135649:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997597.136121:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712994176 00000100:00100000:3.0:1789997597.136130:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712994176 00000100:00100000:3.0:1789997597.136186:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1789997597.136719:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997597.136752:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997597.136788:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712994048:0@lo:400:kworker.0 00000100:00080000:2.0:1789997597.136809:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997597.136825:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997597.136832:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712993792 00000100:00100000:2.0:1789997597.136838:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712993792 00000100:00100000:1.0:1789997597.136868:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712993920 00000100:00100000:1.0:1789997597.136874:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712993920 00000100:00100000:2.0:1789997597.136880:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:2.0:1789997597.136891:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712993792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997597.136912:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712994048 00000100:00100000:1.0:1789997597.136917:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712994048 00000100:00100000:1.0:1789997597.136946:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:2.0:1789997597.136951:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712993792:12345-0@lo:400:kworker.0 Request processed in 62us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997597.136958:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712993920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997597.136965:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00080000:2.0:1789997597.136987:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997597.136990:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997597.136993:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997597.137454:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712994176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997597.137512:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712994176:12345-0@lo:400:kworker.0 Request processed in 1318us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997597.137523:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1789997597.137684:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712993920:12345-0@lo:400:kworker.0 Request processed in 729us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997597.137687:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1789997597.137697:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:2.0:1789997597.137703:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712994048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997597.137743:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712993792:0@lo:400:kworker.0 00000100:00100000:1.0:1789997597.137785:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712993920:0@lo:400:kworker.0 00000100:00100000:2.0:1789997597.137822:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712994048:12345-0@lo:400:kworker.0 Request processed in 125us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997597.137830:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1789997597.137835:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712994048:0@lo:400:kworker.0 00000100:00100000:0.0:1789997597.138373:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712994176:0@lo:400:kworker.0 00000100:00100000:0.0:1789997597.138391:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712993664:0@lo:400:kworker.0 00000100:00100000:0.0:1789997597.151978:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997597.152147:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704505088 00000100:00100000:2.0:1789997597.152158:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704505088 00000100:00100000:2.0:1789997597.152290:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 901 00000100:00100000:2.0:1789997597.152301:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50490:x1876946704505088:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997597.152324:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997597.152343:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee40 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152402:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152417:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152429:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152442:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152449:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152455:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152555:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d1e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152564:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152570:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997597.152601:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 0 00000004:00200000:2.0:1789997597.152605:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997597.152623:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152634:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152643:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152649:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152699:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152716:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997597.152720:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152727:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152739:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:2.0:1789997597.152742:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997597.152747:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152754:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152768:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152774:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152780:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152785:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997597.152788:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152795:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152802:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997597.152804:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997597.152807:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152813:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152845:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee40 expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152859:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee40 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.152866:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:2.0:1789997597.152868:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997597.152871:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2200, rc 0) 00000100:00100000:2.0:1789997597.152925:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50490:x1876946704505088:12345-192.168.204.4@tcp:101:rm.0 Request processed in 626us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997597.152932:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 901 00000100:00100000:3.0:1789997597.157454:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997597.157568:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704505216 00000100:00100000:1.0:1789997597.157580:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704505216 00000100:00100000:1.0:1789997597.157641:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 477 00000100:00100000:1.0:1789997597.157673:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704505216:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997597.157698:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997597.157717:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee47 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997597.157742:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x6ab1321d, atime: 0x6ab1321d, ctime: 0x6ab1321d, blocks: 0x1 00010000:00010000:1.0:1789997597.157760:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=1785s v=(0 0) 00010000:00010000:1.0:1789997597.157765:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997597.157774:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.157805:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.157819:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997597.157881:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704505216:12345-192.168.204.4@tcp:101:rm.0 Request processed in 231us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997597.157888:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 477 00000100:00100000:0.0:1789997597.161213:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997597.161269:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704505472 00000100:00100000:2.0:1789997597.161278:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704505472 00000100:00100000:2.0:1789997597.161332:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 902 00000100:00100000:2.0:1789997597.161341:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50490:x1876946704505472:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997597.161381:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997597.161401:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d1e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee40 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161417:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d1c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee39 expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161425:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:2.0:1789997597.161434:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997597.161451:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161462:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161471:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161483:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161490:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161497:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161585:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161592:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.161614:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997597.162250:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].28, 64 off9984 00000004:00080000:2.0:1789997597.162262:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1785854607820ns, next at 1786854605087ns, rc = 0 00010000:00010000:2.0:1789997597.162316:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162326:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162338:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162345:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162350:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162356:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162374:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997597.162393:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162399:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162406:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.162408:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997597.162416:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997597.162419:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162421:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.162439:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997597.162441:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.162445:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162453:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997597.162457:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997597.162462:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162463:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162477:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d1fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.162478:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:0.0:1789997597.162484:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997597.162489:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.162496:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d204 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162500:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162509:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.162513:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997597.162514:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.162518:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997597.162520:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997597.162522:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997597.162523:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162529:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162534:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:2.0:1789997597.162536:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997597.162538:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.162541:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d1ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997597.162548:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074beda73 reply state 0000000049c5002b transno 4294967644 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997597.162557:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997597.162715:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50490:x1876946704505472:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1372us (1509us total) trans 4294967644 rc 0/0 00000100:00100000:2.0:1789997597.162723:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 902 00010000:00010000:0.0:1789997597.164726:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.164742:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.164758:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.164764:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997597.164768:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.164775:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.164789:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38d0bdf000) 00010000:00010000:0.0:1789997597.164792:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997597.164796:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.164800:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d1f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997597.450874:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997597.894688:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997597.895018:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704505600 00000100:00100000:3.0:1789997597.895029:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704505600 00000100:00100000:3.0:1789997597.895240:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 903 00000100:00100000:3.0:1789997597.895252:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50505:x1876946704505600:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997597.895276:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997597.895295:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d20b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee4e expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.895357:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.895370:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.895381:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997597.895416:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789997597.895420:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997597.895438:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.895467:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d20b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee4e expref: 13 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.895483:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee4e expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.895496:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997597.895499:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997597.895502:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997597.895565:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50505:x1876946704505600:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 315us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997597.895572:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 903 00000100:00100000:2.0:1789997597.901274:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997597.901354:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704505856 00000100:00100000:3.0:1789997597.901364:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704505856 00000100:00100000:3.0:1789997597.901417:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 904 00000100:00100000:3.0:1789997597.901426:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50505:x1876946704505856:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997597.901475:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997597.901501:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee4e expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.901521:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee2b expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.901532:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997597.901542:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997597.901566:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.901579:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.901588:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997597.948640:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967641 is committed 00000001:00080000:0.0:1789997597.948675:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967644 is committed 00000004:00080000:0.0:1789997597.948683:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 78 committed 00000001:00080000:0.0:1789997597.948703:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967645 is committed 00000004:00010000:3.0:1789997597.948766:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fe6989a reply state 0000000080f97e36 transno 4294967645 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997597.948779:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997597.948794:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000100:00100000:2.0:1789997597.948858:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997597.948877:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712994304:0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1789997597.948883:0:5812:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997597.948899:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50505:x1876946704505856:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 47471us (47631us total) trans 4294967645 rc 0/0 00000100:00100000:3.0:1789997597.948908:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 904 00000100:00100000:2.0:1789997597.948999:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789997597.949049:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997597.949054:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712994304 00010000:00010000:3.0:1789997597.949059:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997597.949061:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712994304 00010000:00010000:3.0:1789997597.949077:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.949083:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997597.949088:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.949095:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997597.949103:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00010000:00010000:3.0:1789997597.949110:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997597.949113:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789997597.949113:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712994304:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789997597.949118:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997597.949127:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d219 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789997597.949136:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:28 count 1 00010000:00010000:0.0:1789997597.949157:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.949173:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.949183:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789997597.949187:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997597.949191:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.949219:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.949232:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 6 pid: 8169 timeout: 1886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997597.949244:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712994432:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997597.949309:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c609c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997597.953293:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997597.953476:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712994432:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997597.953502:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997597.953531:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704505984 00000100:00100000:2.0:1789997597.953537:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704505984 00010000:00010000:2.0:1789997597.953569:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 7 pid: 8169 timeout: 1886 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997597.953639:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 378 00000100:00100000:2.0:1789997597.953650:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704505984:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997597.953727:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997597.953734:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 7 pid: 8169 timeout: 1886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.953747:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 7 pid: 8169 timeout: 1886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.953770:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d1e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee47 expref: 7 pid: 8169 timeout: 1886 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.953785:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997597.953789:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997597.953794:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.953804:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.953929:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997597.953978:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704505984:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 330us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997597.953985:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 378 00010000:00010000:0.0:1789997597.954062:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.954071:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.954081:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.954090:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.954108:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997597.954627:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946712994304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5514us (5627us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789997597.954637:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00010000:00010000:0.0:1789997597.954974:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997597.954981:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.954991:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997597.954995:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.955005:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.955020:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.955027:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592d220 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.955061:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997597.955064:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997597.955065:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789997597.955143:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38f94d9880/2, rc 0, transno 4294967353 00000100:00100000:2.0:1789997597.955150:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712994304:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789997597.984593:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997597.984704:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704506112 00000100:00100000:0.0:1789997597.984714:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704506112 00000100:00100000:0.0:1789997597.984774:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 905 00000100:00100000:0.0:1789997597.984915:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50509:x1876946704506112:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997597.984939:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997597.984961:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d227 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee55 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985025:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985049:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985061:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985076:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985084:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985091:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985391:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d23c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985400:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985408:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997597.985437:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:0.0:1789997597.985441:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997597.985460:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985471:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985479:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985486:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985492:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997597.985497:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985505:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985516:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:0.0:1789997597.985520:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997597.985525:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985532:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d22e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985556:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985562:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985569:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985574:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997597.985577:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985583:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985591:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997597.985593:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997597.985596:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985601:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d235 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985631:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee55 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985646:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d23c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee55 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997597.985713:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997597.985716:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997597.985718:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:1.0:1789997597.985935:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50509:x1876946704506112:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1148us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997597.985944:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 905 00000100:00100000:3.0:1789997597.995423:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997597.995713:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704506368 00000100:00100000:2.0:1789997597.995725:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704506368 00000100:00100000:2.0:1789997597.995779:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 906 00000100:00100000:2.0:1789997597.995789:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50509:x1876946704506368:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997597.995808:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997597.995825:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d243 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee5c expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.996648:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.996693:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.996705:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.996720:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.996727:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.996733:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997597.997770:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:2.0:1789997597.998011:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998251:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998264:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998303:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998377:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998385:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998392:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997597.998396:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998404:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998416:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:2.0:1789997597.998419:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997597.998423:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998430:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d24a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997597.998442:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058d73477 reply state 00000000140e14bf transno 4294967646 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997597.998450:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997597.998481:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d243 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee5c expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998494:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee5c expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997597.998507:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997597.998509:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997597.998512:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2400, rc 0) 00000100:00100000:2.0:1789997597.998587:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50509:x1876946704506368:12345-192.168.204.4@tcp:101:touch.0 Request processed in 2798us (3172us total) trans 4294967646 rc 0/0 00000100:00100000:2.0:1789997597.998595:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 906 00010000:00010000:2.0:1789997598.002161:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.002180:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.002189:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.002195:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997598.002199:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.002207:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.002223:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997598.002226:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997598.002232:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.002238:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d251 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997598.002694:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.003418:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704506624 00000100:00100000:1.0:1789997598.003429:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704506624 00000100:00100000:1.0:1789997598.003537:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 907 00000100:00100000:1.0:1789997598.003548:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50509:x1876946704506624:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:1.0:1789997598.003603:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997598.003623:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee5c expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.003638:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:1.0:1789997598.003681:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1789997598.003705:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789997598.003722:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.003746:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.003758:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997598.003898:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b3e5da4 reply state 0000000095f337d4 transno 4294967647 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997598.003907:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997598.004008:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50509:x1876946704506624:12345-192.168.204.4@tcp:36:touch.0 Request processed in 460us (1317us total) trans 4294967647 rc 0/0 00000100:00100000:1.0:1789997598.004015:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 907 00010000:00010000:3.0:1789997598.005573:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.005588:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.005595:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.005601:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997598.005605:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.005613:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.005628:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:3.0:1789997598.005631:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997598.005635:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.005641:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d266 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997598.006480:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997598.007608:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704506752 00000100:00100000:2.0:1789997598.007619:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704506752 00000100:00100000:2.0:1789997598.007694:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 908 00000100:00100000:2.0:1789997598.007706:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50509:x1876946704506752:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997598.007731:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997598.007752:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d26d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee63 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.007811:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d26d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee63 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.009577:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d26d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee63 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.009623:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997598.009626:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997598.009630:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789997598.011604:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50509:x1876946704506752:12345-192.168.204.4@tcp:101:touch.0 Request processed in 3889us (5117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997598.011616:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 908 00000100:00100000:0.0:1789997598.016615:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.017092:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704506880 00000100:00100000:1.0:1789997598.017106:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704506880 00000100:00100000:1.0:1789997598.017368:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 479 00000100:00100000:1.0:1789997598.017380:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704506880:12345-192.168.204.4@tcp:2:touch.0 00000100:00100000:1.0:1789997598.017740:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704506880:12345-192.168.204.4@tcp:2:touch.0 Request processed in 361us (1132us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789997598.017748:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 479 00000100:00080000:2.0:1789997598.017843:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997598.026008:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.026145:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704507136 00000100:00100000:1.0:1789997598.026156:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704507136 00000100:00100000:1.0:1789997598.026219:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:1.0:1789997598.026230:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50509:x1876946704507136:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:1.0:1789997598.026628:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50509:x1876946704507136:12345-192.168.204.4@tcp:35:touch.0 Request processed in 397us (625us total) trans 4294967648 rc 0/0 00000100:00100000:1.0:1789997598.026637:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 94 00000100:00100000:3.0:1789997598.063412:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.063584:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704507264 00000100:00100000:1.0:1789997598.063594:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704507264 00000100:00100000:1.0:1789997598.063696:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 909 00000100:00100000:1.0:1789997598.063708:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50513:x1876946704507264:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997598.063733:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997598.063752:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee6a expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063809:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063823:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063834:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063847:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063854:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063861:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063939:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063947:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.063954:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997598.064016:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 0 00000004:00200000:1.0:1789997598.064021:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997598.064052:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064063:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064070:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064076:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064082:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064088:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997598.064091:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064098:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064109:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:1.0:1789997598.064112:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997598.064116:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064121:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d27b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064133:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064142:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064148:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064152:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997598.064155:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064160:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064166:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38e062d200) 00010000:00010000:1.0:1789997598.064169:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997598.064171:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064176:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064204:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee6a expref: 13 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064216:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee6a expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.064223:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:1.0:1789997598.064225:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997598.064228:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:0.0:1789997598.064788:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50513:x1876946704507264:12345-192.168.204.4@tcp:101:rm.0 Request processed in 1081us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997598.064797:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 909 00000100:00100000:0.0:1789997598.069448:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.069532:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704507392 00000100:00100000:1.0:1789997598.069542:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704507392 00000100:00100000:1.0:1789997598.069601:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 480 00000100:00100000:1.0:1789997598.069611:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704507392:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997598.069628:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997598.069696:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee71 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997598.069721:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x6ab1321d, atime: 0x6ab1321d, ctime: 0x6ab1321d, blocks: 0x1 00010000:00010000:1.0:1789997598.069739:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=1786s v=(0 0) 00010000:00010000:1.0:1789997598.069744:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997598.069752:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.069770:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.069782:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997598.069835:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704507392:12345-192.168.204.4@tcp:101:rm.0 Request processed in 226us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997598.069842:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 480 00000100:00100000:3.0:1789997598.074924:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.078990:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704507648 00000100:00100000:1.0:1789997598.079008:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704507648 00000100:00100000:1.0:1789997598.079169:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 910 00000100:00100000:1.0:1789997598.079181:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50513:x1876946704507648:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997598.079233:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997598.079260:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee6a expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079285:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d26d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee63 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079297:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:1.0:1789997598.079308:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997598.079332:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079345:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079355:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079370:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079377:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079384:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079508:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079516:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.079526:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997598.080125:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].29, 64 off10048 00000004:00080000:1.0:1789997598.080135:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1786772481229ns, next at 1787772478217ns, rc = 0 00010000:00010000:1.0:1789997598.080193:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080203:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080212:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080219:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080225:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080231:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080245:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997598.080264:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080270:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080277:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080284:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997598.080288:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080294:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080302:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:1.0:1789997598.080305:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997598.080310:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080315:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d2a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080330:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080336:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080342:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080346:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997598.080349:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080355:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080366:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:1.0:1789997598.080369:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997598.080372:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.080378:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d297 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997598.080387:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2a96cd6 reply state 00000000546591f2 transno 4294967649 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997598.080396:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997598.080470:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50513:x1876946704507648:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1289us (5553us total) trans 4294967649 rc 0/0 00000100:00100000:1.0:1789997598.080478:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 910 00010000:00010000:0.0:1789997598.080557:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997598.080565:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997598.080571:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997598.080574:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997598.080581:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997598.080591:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff8a38e062d000) 00010000:00010000:0.0:1789997598.080593:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997598.080595:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997598.080601:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d2ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997598.080615:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997598.080617:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997598.080619:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997598.084397:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.084413:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.084425:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.084432:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997598.084436:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.084443:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.084472:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38e062d200) 00010000:00010000:2.0:1789997598.084475:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997598.084479:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.084485:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d29e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.476420:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997598.689368:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.689453:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704507776 00000100:00100000:1.0:1789997598.689464:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704507776 00000100:00100000:1.0:1789997598.689587:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 911 00000100:00100000:1.0:1789997598.689597:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50527:x1876946704507776:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997598.689628:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997598.689644:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d2b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee78 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.689770:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d2ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.689789:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d2ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.689806:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d2ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997598.689843:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:1.0:1789997598.689848:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997598.689867:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d2ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.689892:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d2b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee78 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.689909:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d2ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee78 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.689919:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:1.0:1789997598.689922:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997598.689925:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997598.689988:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50527:x1876946704507776:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 392us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997598.689995:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 911 00000100:00100000:3.0:1789997598.692193:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997598.692229:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704508032 00000100:00100000:3.0:1789997598.692237:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704508032 00000100:00100000:3.0:1789997598.692281:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 912 00000100:00100000:3.0:1789997598.692292:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50527:x1876946704508032:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997598.692336:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997598.692358:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d2ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee78 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.692378:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d23c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee55 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.692388:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:3.0:1789997598.692397:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997598.692419:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.692431:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.692441:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997598.692690:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3c6b36b reply state 000000003ad32686 transno 4294967650 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997598.692700:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997598.692707:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000100:00100000:3.0:1789997598.692776:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50527:x1876946704508032:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 486us (587us total) trans 4294967650 rc 0/0 00000100:00100000:3.0:1789997598.692784:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 912 00010000:00010000:3.0:1789997598.696351:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.696368:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.696376:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.696382:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997598.696387:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.696394:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.696410:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997598.696414:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997598.696419:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.696425:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997598.780114:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997598.780288:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704508160 00000100:00100000:2.0:1789997598.780300:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704508160 00000100:00100000:2.0:1789997598.780362:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 913 00000100:00100000:2.0:1789997598.780373:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50539:x1876946704508160:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997598.780470:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50539:x1876946704508160:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 99us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997598.780477:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 913 00000100:00100000:2.0:1789997598.782817:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.782928:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704508288 00000100:00100000:1.0:1789997598.782937:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704508288 00000100:00100000:1.0:1789997598.782988:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 481 00000100:00100000:1.0:1789997598.782999:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50539:x1876946704508288:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997598.783587:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50539:x1876946704508288:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 588us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997598.783596:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 481 00000100:00100000:3.0:1789997598.785027:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.785201:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704508416 00000100:00100000:1.0:1789997598.785207:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704508416 00000100:00100000:1.0:1789997598.785297:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 482 00000100:00100000:1.0:1789997598.785307:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50539:x1876946704508416:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997598.785715:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50539:x1876946704508416:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 408us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997598.785723:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 482 00000100:00100000:3.0:1789997598.788438:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997598.788527:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704508544 00000100:00100000:2.0:1789997598.788536:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704508544 00000100:00100000:2.0:1789997598.788632:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 914 00000100:00100000:2.0:1789997598.788640:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50539:x1876946704508544:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997598.789081:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50539:x1876946704508544:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 440us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997598.789089:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 914 00000100:00100000:2.0:1789997598.791633:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997598.791916:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704508672 00000100:00100000:0.0:1789997598.791925:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704508672 00000100:00100000:0.0:1789997598.791975:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 915 00000100:00100000:0.0:1789997598.791985:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50539:x1876946704508672:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997598.792080:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50539:x1876946704508672:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 96us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997598.792088:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 915 00000100:00100000:3.0:1789997598.793418:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997598.793518:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704508800 00000100:00100000:0.0:1789997598.793524:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704508800 00000100:00100000:0.0:1789997598.793593:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 483 00000100:00100000:0.0:1789997598.793600:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50539:x1876946704508800:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997598.794044:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50539:x1876946704508800:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 442us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997598.794052:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 483 00000100:00100000:3.0:1789997598.795793:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997598.795878:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704508928 00000100:00100000:0.0:1789997598.795886:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704508928 00000100:00100000:0.0:1789997598.795937:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 484 00000100:00100000:0.0:1789997598.795947:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50539:x1876946704508928:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997598.796293:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50539:x1876946704508928:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 346us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997598.796309:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 484 00000100:00100000:2.0:1789997598.797953:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.798240:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704509056 00000100:00100000:1.0:1789997598.798248:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704509056 00000100:00100000:1.0:1789997598.798585:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 916 00000100:00100000:1.0:1789997598.798596:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50539:x1876946704509056:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997598.799121:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50539:x1876946704509056:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 527us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997598.799126:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 916 00000100:00100000:3.0:1789997598.838390:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.839120:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704509184 00000100:00100000:1.0:1789997598.839131:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704509184 00000100:00100000:1.0:1789997598.839205:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 917 00000100:00100000:1.0:1789997598.839216:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50543:x1876946704509184:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997598.839236:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997598.839261:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d2c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee7f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839318:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839332:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839350:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839364:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839370:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839374:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839561:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d2dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839567:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839571:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997598.839594:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:1.0:1789997598.839596:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997598.839618:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839630:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839637:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839648:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839696:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997598.839700:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839707:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839719:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:1.0:1789997598.839722:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997598.839727:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839733:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592d2cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839744:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839750:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839756:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839761:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997598.839764:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839774:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839782:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38e062d500) 00010000:00010000:1.0:1789997598.839785:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997598.839787:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839792:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d2d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839823:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d2c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee7f expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839836:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d2dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee7f expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.839843:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:1.0:1789997598.839845:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997598.839847:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:2.0:1789997598.840999:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50543:x1876946704509184:12345-192.168.204.4@tcp:101:dd.0 Request processed in 1772us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997598.841012:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 917 00000100:00100000:0.0:1789997598.846799:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997598.847005:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704509440 00000100:00100000:3.0:1789997598.847027:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704509440 00000100:00100000:3.0:1789997598.847283:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 918 00000100:00100000:3.0:1789997598.847294:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:50543:x1876946704509440:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:3.0:1789997598.847312:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997598.847331:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee86 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.847580:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.847595:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.847606:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.847620:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.847627:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.847633:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997598.848713:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:3.0:1789997598.848880:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d2f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.848896:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.848904:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849520:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849530:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849537:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849543:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997598.849547:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849554:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849566:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:3.0:1789997598.849570:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997598.849575:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849582:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d2eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997598.849597:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa76b674 reply state 00000000be548677 transno 4294967651 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997598.849606:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997598.849640:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d2e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee86 expref: 15 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849754:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee86 expref: 14 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.849762:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997598.849764:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997598.849767:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ba00, rc 0) 00000100:00100000:3.0:1789997598.849847:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+15:50543:x1876946704509440:12345-192.168.204.4@tcp:101:dd.0 Request processed in 2555us (3057us total) trans 4294967651 rc 0/0 00000100:00100000:3.0:1789997598.849856:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 918 00010000:00010000:2.0:1789997598.852030:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.852047:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.852055:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.852061:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997598.852066:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.852074:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.852101:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38ee49e100) 00010000:00010000:2.0:1789997598.852104:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997598.852109:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.852116:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d2f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997598.855826:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.855972:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704509568 00000100:00100000:1.0:1789997598.855983:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704509568 00000100:00100000:1.0:1789997598.856087:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 485 00000100:00100000:1.0:1789997598.856099:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50543:x1876946704509568:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997598.856117:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997598.856138:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee8d expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997598.856169:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789997598.856189:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=1787s v=(0 0) 00010000:00010000:1.0:1789997598.856193:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997598.856202:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 7 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.856220:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 7 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.856233:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997598.856306:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50543:x1876946704509568:12345-192.168.204.4@tcp:101:dd.0 Request processed in 209us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997598.856314:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 485 00000100:00100000:0.0:1789997598.873849:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997598.877155:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704509696 00000100:00100000:3.0:1789997598.877172:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704509696 00002000:00100000:2.0:1789997598.877505:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (0->1048575) req@ffff8a38fad0e680 x1876946704509696/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:574/0 lens 488/0 e 0 to 0 dl 1789997609 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997598.877519:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fad0e680 with x1876946704509696 ext(0->1048575) 00002000:00010000:2.0:1789997598.877525:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fad0e680 00000100:00100000:2.0:1789997598.877558:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:2.0:1789997598.877568:0:6663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704509696:12345-192.168.204.4@tcp:4:dd.0 00000100:00100000:0.0:1789997598.907815:0:6663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:2353:x1876946704509696:12345-192.168.204.4@tcp:4:dd.0 Request processed in 30238us (33979us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789997598.907830:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00002000:00100000:0.0:1789997598.907843:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (0->1048575) req@ffff8a38fad0e680 x1876946704509696/t4294967354(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:574/0 lens 488/448 e 0 to 0 dl 1789997609 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789997598.907854:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fad0e680 with x1876946704509696 ext(0->1048575) 00002000:00010000:0.0:1789997598.907862:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fad0e680 00000100:00100000:3.0:1789997598.910741:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997598.910952:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704509824 00000100:00100000:2.0:1789997598.910963:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704509824 00000100:00100000:2.0:1789997598.911082:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 919 00000100:00100000:2.0:1789997598.911094:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:50543:x1876946704509824:12345-192.168.204.4@tcp:44:dd.0 00000100:00100000:2.0:1789997598.937038:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:50543:x1876946704509824:12345-192.168.204.4@tcp:44:dd.0 Request processed in 25924us (26282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997598.937051:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 919 00000001:00080000:0.0:1789997598.937217:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967649 is committed 00000004:00080000:0.0:1789997598.937225:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 81 committed 00000100:00100000:1.0:1789997598.937486:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997598.937503:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712994560:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997598.937558:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997598.937673:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712994560 00000100:00100000:3.0:1789997598.937681:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712994560 00000100:00100000:3.0:1789997598.937726:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1789997598.937735:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7417850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712994560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789997598.937758:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:29 count 1 00010000:00010000:3.0:1789997598.937781:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.937801:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.937814:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789997598.937818:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997598.937823:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.937848:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 6 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997598.937861:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 6 pid: 6658 timeout: 1887 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997598.937872:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712994688:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997598.937911:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e0d99600 going to sleep for 11 seconds 00000001:00080000:0.0:1789997598.938103:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967651 is committed 00000100:00100000:2.0:1789997598.944738:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997598.944820:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997598.944945:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712994688:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997598.944970:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997598.945051:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704510080 00000100:00100000:1.0:1789997598.945058:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704510080 00010000:00010000:1.0:1789997598.945091:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 7 pid: 6658 timeout: 1887 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997598.945128:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 379 00000100:00100000:1.0:1789997598.945136:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704510080:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997598.945149:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997598.945155:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 7 pid: 6658 timeout: 1887 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.945168:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 7 pid: 6658 timeout: 1887 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.945190:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592d290 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee71 expref: 7 pid: 6658 timeout: 1887 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.945205:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997598.945209:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997598.945215:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.945225:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.945254:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997598.945295:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704510080:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 159us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997598.945303:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 379 00010000:00010000:2.0:1789997598.945527:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.945537:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.945548:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.945556:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997598.945580:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789997598.946098:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7417850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712994560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8363us (8539us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789997598.946106:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1789997598.946243:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704509952 00000100:00100000:2.0:1789997598.946249:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704509952 00000100:00100000:2.0:1789997598.946274:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 487 00000100:00100000:2.0:1789997598.946282:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:2352:x1876946704509952:12345-192.168.204.4@tcp:16:dd.0 00000004:00080000:3.0:1789997598.946466:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c6125f80/2, rc 0, transno 4294967355 00000100:00100000:3.0:1789997598.946474:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712994560:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789997598.946554:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997598.946561:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.946570:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997598.946574:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.946586:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.946601:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.946608:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d30e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997598.946626:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997598.946628:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997598.946629:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997598.979690:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00000001:00080000:1.0:1789997598.979707:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00000001:00080000:1.0:1789997598.979714:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00000100:00100000:0.0:1789997598.979921:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704509952:12345-192.168.204.4@tcp:16:dd.0 Request processed in 33632us (35184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997598.979933:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 487 00000100:00100000:2.0:1789997598.983904:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.983964:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704510336 00000100:00100000:1.0:1789997598.983974:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704510336 00000100:00100000:1.0:1789997598.984057:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:1.0:1789997598.984069:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50543:x1876946704510336:12345-192.168.204.4@tcp:35:dd.0 00000100:00100000:1.0:1789997598.984544:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50543:x1876946704510336:12345-192.168.204.4@tcp:35:dd.0 Request processed in 476us (648us total) trans 4294967652 rc 0/0 00000100:00100000:1.0:1789997598.984553:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 95 00000100:00100000:1.0:1789997598.999370:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.999489:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997598.999524:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997598.999612:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704510592 00000100:00100000:2.0:1789997598.999622:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704510592 00000100:00100000:2.0:1789997598.999696:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704510720 00000100:00100000:2.0:1789997598.999700:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704510720 00000100:00100000:2.0:1789997598.999722:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 842 00000100:00100000:2.0:1789997598.999732:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704510592:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997598.999804:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704510592:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997598.999929:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 842 00000100:00100000:0.0:1789997598.999983:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704510464 00000100:00100000:0.0:1789997598.999997:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704510464 00000100:00100000:0.0:1789997599.000040:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1080 00000100:00100000:0.0:1789997599.000048:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704510464:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997599.000077:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704510464:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997599.000084:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1080 00000100:00100000:1.0:1789997599.000323:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 843 00000100:00100000:1.0:1789997599.000334:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704510720:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997599.000364:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704510720:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997599.000371:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 843 00000100:00100000:3.0:1789997599.178954:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997599.180413:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712994944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997599.180494:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997599.180671:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712994816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997599.180698:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997599.180759:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712994944 00000100:00100000:1.0:1789997599.180769:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712994944 00000100:00100000:2.0:1789997599.180776:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712994816 00000100:00100000:2.0:1789997599.180783:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712994816 00000100:00100000:1.0:1789997599.180846:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1789997599.180856:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712994944:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997599.180859:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997599.180865:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789997599.180896:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997599.181214:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712994944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 358us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997599.181222:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:3.0:1789997599.181373:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712994944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997599.183629:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1789997599.183646:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712994816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997599.183692:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789997599.183772:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712994816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997599.183779:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:2.0:1789997599.183825:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:2.0:1789997599.183831:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38f94d9880, transno 4294967353 00000100:00100000:2.0:1789997599.183852:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712994816:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789997599.208066:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00000001:00080000:2.0:1789997599.208083:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967355 is committed 00010000:00010000:0.0:1789997599.499092:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997599.934016:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967652 is committed 00010000:00010000:1.0:1789997600.524175:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997600.911619:0:85821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1789603962662ns, next at 1786854605087ns, rc = 0 00000004:00080000:1.0:1789997600.911848:0:85821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1789604193794ns, next at 1787772478217ns, rc = 0 00000004:00080000:0.0:1789997600.917848:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 82 committed 00000004:00080000:0.0:1789997600.917876:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 79 committed 00010000:00010000:1.0:1789997601.546865:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997601.910832:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997601.911248:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704510848 00000100:00100000:2.0:1789997601.911259:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704510848 00000100:00100000:2.0:1789997601.911364:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 920 00000100:00100000:2.0:1789997601.911375:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50735:x1876946704510848:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997601.911461:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50735:x1876946704510848:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 89us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997601.911467:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 920 00000100:00080000:3.0:1789997601.911511:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997601.915096:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997601.915136:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704510976 00000100:00100000:0.0:1789997601.915145:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704510976 00000100:00100000:0.0:1789997601.915204:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 488 00000100:00100000:0.0:1789997601.915215:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50735:x1876946704510976:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997601.915528:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50735:x1876946704510976:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 314us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997601.915536:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 488 00000100:00080000:0.0:1789997601.915558:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997601.917531:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997601.917775:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704511104 00000100:00100000:0.0:1789997601.917783:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704511104 00000100:00080000:2.0:1789997601.917831:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997601.917848:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 489 00000100:00100000:0.0:1789997601.917857:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50735:x1876946704511104:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997601.918179:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50735:x1876946704511104:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 323us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997601.918186:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 489 00000100:00100000:0.0:1789997601.919920:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997601.919974:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704511232 00000100:00100000:2.0:1789997601.919982:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704511232 00000100:00100000:2.0:1789997601.920145:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 921 00000100:00100000:2.0:1789997601.920156:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50735:x1876946704511232:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997601.920725:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50735:x1876946704511232:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 570us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997601.920734:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 921 00000100:00100000:2.0:1789997601.923728:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997601.923805:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704511360 00000100:00100000:1.0:1789997601.923814:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704511360 00000100:00100000:1.0:1789997601.923865:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 922 00000100:00100000:1.0:1789997601.923874:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50735:x1876946704511360:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997601.923970:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50735:x1876946704511360:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 97us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997601.923978:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 922 00000100:00100000:1.0:1789997601.928501:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997601.928713:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704511488 00000100:00100000:2.0:1789997601.928724:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704511488 00000100:00100000:2.0:1789997601.928774:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 490 00000100:00100000:2.0:1789997601.928785:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50735:x1876946704511488:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997601.929168:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50735:x1876946704511488:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 384us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997601.929176:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 490 00000100:00100000:0.0:1789997601.931244:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997601.931287:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704511616 00000100:00100000:2.0:1789997601.931295:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704511616 00000100:00100000:2.0:1789997601.931345:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 491 00000100:00100000:2.0:1789997601.931354:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50735:x1876946704511616:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997601.931695:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50735:x1876946704511616:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 341us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997601.931703:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 491 00000100:00100000:1.0:1789997601.934280:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997601.934361:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704511744 00000100:00100000:2.0:1789997601.934370:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704511744 00000100:00100000:0.0:1789997601.934469:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 923 00000100:00100000:0.0:1789997601.934483:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50735:x1876946704511744:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997601.935023:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50735:x1876946704511744:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 543us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997601.935033:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 923 00000100:00100000:1.0:1789997601.972788:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997601.972977:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704512000 00000100:00100000:3.0:1789997601.972988:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704512000 00000100:00100000:3.0:1789997601.973046:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 924 00000100:00100000:3.0:1789997601.973057:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50739:x1876946704512000:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997601.973108:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997601.973136:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d2f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee86 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973351:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997601.973365:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997601.973389:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973403:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973413:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973425:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973432:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973439:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973923:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973933:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.973942:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997601.975285:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].29, 64 off10048 00000004:00080000:3.0:1789997601.975299:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1790667643905ns, next at 1791667641211ns, rc = 0 00010000:00010000:3.0:1789997601.975392:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975406:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975416:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975425:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975431:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975437:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975466:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997601.975494:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975501:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975507:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975513:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997601.975518:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975526:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997601.975531:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997601.975537:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997601.975541:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997601.975541:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975547:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997601.975553:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997601.975556:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d323 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997601.975559:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997601.975575:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975577:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975591:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997601.975595:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:0.0:1789997601.975600:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997601.975603:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997601.975618:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592d32a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975625:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975632:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997601.975635:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997601.975639:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997601.975641:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997601.975643:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997601.975646:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997601.975678:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:3.0:1789997601.975681:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997601.975684:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.975690:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d315 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997601.975702:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017ec5dd1 reply state 000000000b3df11e transno 4294967653 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997601.975710:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997601.975807:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50739:x1876946704512000:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2749us (3026us total) trans 4294967653 rc 0/0 00000100:00100000:3.0:1789997601.975817:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 924 00010000:00010000:3.0:1789997601.978442:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.978455:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.978464:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.978467:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997601.978470:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.978475:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.978612:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997601.978615:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997601.978620:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997601.978632:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d31c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997602.250923:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712995456:0@lo:400:kworker.0 00000100:00100000:2.0:1789997602.250988:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712995200:0@lo:400:kworker.0 00000100:00100000:0.0:1789997602.251009:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997602.251073:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712995072:0@lo:400:kworker.0 00000100:00100000:3.0:1789997602.251087:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712995328:0@lo:400:kworker.0 00000100:00100000:0.0:1789997602.253431:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712995456 00000100:00100000:0.0:1789997602.253445:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712995456 00000100:00100000:0.0:1789997602.253517:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1789997602.253528:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712995456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997602.253603:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712995456:12345-0@lo:400:kworker.0 Request processed in 77us (2594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997602.253611:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00080000:0.0:1789997602.253634:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997602.253683:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712995456:0@lo:400:kworker.0 00000100:00100000:2.0:1789997602.255721:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997602.255787:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712995712:0@lo:400:kworker.0 00000100:00100000:2.0:1789997602.255839:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997602.255883:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712995200 00000100:00100000:2.0:1789997602.255890:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712995200 00000100:00100000:2.0:1789997602.255930:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712995712 00000100:00100000:2.0:1789997602.255934:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712995712 00000100:00100000:2.0:1789997602.255981:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1789997602.255989:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712995200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997602.256039:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946712995200:12345-0@lo:400:kworker.0 Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997602.256047:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1789997602.256065:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:2.0:1789997602.256071:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712995712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997602.256096:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946712995712:12345-0@lo:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997602.256101:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:2.0:1789997602.256148:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946712995200:0@lo:400:kworker.0 00000100:00100000:2.0:1789997602.256158:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946712995712:0@lo:400:kworker.0 00000100:00100000:1.0:1789997602.256306:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997602.256334:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712995584:0@lo:400:kworker.0 00000100:00100000:1.0:1789997602.256427:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997602.256445:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997602.256489:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712995328 00000100:00100000:1.0:1789997602.256494:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712995328 00000100:00100000:1.0:1789997602.256791:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1789997602.256800:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712995328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997602.256855:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946712995328:12345-0@lo:400:kworker.0 Request processed in 57us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997602.256861:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00080000:1.0:1789997602.256881:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997602.256903:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712995072 00000100:00100000:1.0:1789997602.256907:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712995072 00000100:00100000:0.0:1789997602.256918:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712995584 00000100:00100000:0.0:1789997602.256923:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712995584 00000100:00100000:1.0:1789997602.256940:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1789997602.256962:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712995072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997602.256979:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1789997602.256990:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712995584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997602.257004:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712995072:12345-0@lo:400:kworker.0 Request processed in 57us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997602.257011:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1789997602.257031:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712995584:12345-0@lo:400:kworker.0 Request processed in 44us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997602.257038:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1789997602.257055:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712995072:0@lo:400:kworker.0 00000100:00080000:0.0:1789997602.257063:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997602.257069:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:1.0:1789997602.257075:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c6125f80, transno 4294967355 00000100:00100000:1.0:1789997602.257091:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712995584:0@lo:400:kworker.0 00000100:00100000:3.0:1789997602.257358:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946712995328:0@lo:400:kworker.0 00010000:00010000:1.0:1789997602.570838:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997603.333897:0:85965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1792026239742ns, next at 1791667641211ns, rc = 0 00000004:00080000:0.0:1789997603.361863:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 81 committed 00000001:00080000:0.0:1789997603.361897:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967653 is committed 00000004:00080000:0.0:1789997603.361902:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 80 committed 00000100:00100000:0.0:1789997603.362147:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712995840:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997603.362233:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997603.362308:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712995840 00000100:00100000:0.0:1789997603.362316:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712995840 00000100:00100000:0.0:1789997603.362361:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1789997603.362371:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712995840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997603.362398:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:29 count 1 00010000:00010000:0.0:1789997603.362425:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997603.362450:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 5 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997603.362460:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d:0x0].0x0 since=5s v=(0 0) 00010000:00010000:0.0:1789997603.362464:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997603.362469:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997603.362506:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 5 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997603.362520:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 5 pid: 8169 timeout: 1892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997603.362533:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712995968:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997603.362591:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c1359780 going to sleep for 11 seconds 00000100:00100000:0.0:1789997603.366736:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946712995968:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997603.366781:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997603.367467:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997603.367978:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704512128 00000100:00100000:3.0:1789997603.367988:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704512128 00000100:00080000:0.0:1789997603.368109:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789997603.368124:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 6 pid: 8169 timeout: 1892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997603.368170:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 380 00000100:00100000:3.0:1789997603.368181:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704512128:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997603.368196:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997603.368201:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 6 pid: 8169 timeout: 1892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997603.368214:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 6 pid: 8169 timeout: 1892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997603.368239:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a83402/0x65b43101d592d307 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee8d expref: 6 pid: 8169 timeout: 1892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997603.368256:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997603.368260:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997603.368265:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997603.368275:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997603.368308:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997603.368367:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704512128:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 188us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997603.368375:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 380 00010000:00010000:0.0:1789997603.368446:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997603.368456:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997603.368466:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997603.368474:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997603.368494:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997603.368520:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997603.368530:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997603.368539:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997603.368543:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997603.368553:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997603.368567:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997603.368573:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592d331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997603.368598:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997603.368600:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997603.368602:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997603.369214:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946712995840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6842us (6979us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789997603.369222:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000004:00080000:3.0:1789997603.369526:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c6125f80/2, rc 0, transno 4294967355 00000100:00100000:3.0:1789997603.369548:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712995840:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789997603.369829:0:85965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1792062173957ns, next at 1787772478217ns, rc = 0 00000004:00080000:0.0:1789997603.376636:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 83 committed 00010000:00010000:0.0:1789997603.594885:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997604.118958:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997604.119033:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997604.119076:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997604.119105:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997604.119133:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704512256 00000100:00100000:1.0:1789997604.119143:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704512256 00000100:00100000:1.0:1789997604.119187:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1082 00000100:00100000:1.0:1789997604.119198:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704512256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997604.119265:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704512256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997604.119272:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1082 00000100:00100000:1.0:1789997604.119302:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704512640 00000100:00100000:1.0:1789997604.119306:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704512640 00000100:00100000:1.0:1789997604.119339:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704512512 00000100:00100000:1.0:1789997604.119342:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704512512 00000100:00100000:1.0:1789997604.119361:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 846 00000100:00100000:1.0:1789997604.119368:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704512640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997604.119395:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704512640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997604.119401:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 846 00000100:00100000:1.0:1789997604.119413:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 847 00000100:00100000:1.0:1789997604.119419:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704512512:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997604.119442:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704512512:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 23us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997604.119447:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 847 00000100:00080000:1.0:1789997604.119576:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997604.119961:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704512384 00000100:00100000:2.0:1789997604.119966:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704512384 00000100:00100000:2.0:1789997604.120012:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1305 00000100:00100000:2.0:1789997604.120020:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704512384:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997604.120064:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704512384:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 46us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997604.120072:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1305 00000100:00080000:1.0:1789997604.121292:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997604.298924:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712996096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997604.298932:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712996224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997604.299012:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997604.299048:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712996224 00000100:00100000:1.0:1789997604.299057:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712996224 00000100:00100000:1.0:1789997604.299131:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1789997604.299143:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712996224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997604.299148:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789997604.299183:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997604.299186:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712996096 00000100:00100000:3.0:1789997604.299192:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712996096 00000100:00100000:3.0:1789997604.299233:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00080000:0.0:1789997604.299278:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997604.299282:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997604.299409:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712996096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997604.299432:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997604.299477:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946712996096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 237us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997604.299485:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1789997604.299608:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712996096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997604.299770:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712996224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 629us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997604.299778:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1789997604.299817:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712996224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997604.619632:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997605.644132:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997606.667681:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997606.902080:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00000100:00100000:2.0:1789997607.377099:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997607.377121:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712996352:0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.377194:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997607.377257:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712996352 00000100:00100000:2.0:1789997607.377266:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712996352 00000100:00100000:2.0:1789997607.377306:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1789997607.377315:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712996352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.377361:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946712996352:12345-0@lo:400:kworker.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997607.377368:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1789997607.377429:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946712996352:0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.377872:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997607.377882:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712996480:0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.377916:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997607.377946:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712996480 00000100:00100000:2.0:1789997607.377950:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712996480 00000100:00100000:2.0:1789997607.377978:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1789997607.377986:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712996480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.378224:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712996480:12345-0@lo:400:kworker.0 Request processed in 238us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997607.378231:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:2.0:1789997607.378262:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712996480:0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.378297:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712996608:0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.378321:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997607.378348:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712996608 00000100:00100000:2.0:1789997607.378352:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712996608 00000100:00100000:2.0:1789997607.378385:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:2.0:1789997607.378391:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712996608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.378419:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712996608:12345-0@lo:400:kworker.0 Request processed in 29us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997607.378425:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00080000:2.0:1789997607.378437:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997607.378453:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712996608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997607.378891:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712996736:0@lo:400:kworker.0 00000100:00100000:1.0:1789997607.378926:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997607.384221:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997607.384240:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712996864:0@lo:400:kworker.0 00000100:00100000:1.0:1789997607.384303:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997607.384353:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712996736 00000100:00100000:1.0:1789997607.384360:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712996736 00000100:00100000:1.0:1789997607.384404:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712996864 00000100:00100000:1.0:1789997607.384407:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712996864 00000100:00100000:1.0:1789997607.384426:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1789997607.384434:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712996736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997607.384492:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712996736:12345-0@lo:400:kworker.0 Request processed in 59us (5565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997607.384509:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1789997607.384523:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1789997607.384528:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712996864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997607.384550:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712996864:12345-0@lo:400:kworker.0 Request processed in 22us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997607.384556:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1789997607.384594:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712996864:0@lo:400:kworker.0 00000100:00100000:1.0:1789997607.384603:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:1.0:1789997607.384608:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c6125f80, transno 4294967355 00000100:00100000:1.0:1789997607.384617:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712996736:0@lo:400:kworker.0 00000100:00080000:2.0:1789997607.390690:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997607.390701:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997607.390912:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712996992:0@lo:400:kworker.0 00000100:00100000:2.0:1789997607.392308:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997607.392755:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712996992 00000100:00100000:3.0:1789997607.392764:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712996992 00000100:00100000:3.0:1789997607.392821:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1789997607.392831:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712996992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997607.392906:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712996992:12345-0@lo:400:kworker.0 Request processed in 77us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997607.392914:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00080000:2.0:1789997607.392979:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997607.393156:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712996992:0@lo:400:kworker.0 00010000:00010000:1.0:1789997607.692681:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997608.714859:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997609.238448:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997609.238500:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997609.238535:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997609.238753:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704512896 00000100:00100000:2.0:1789997609.238763:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704512896 00000100:00100000:2.0:1789997609.238839:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1309 00000100:00100000:2.0:1789997609.238850:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704512896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997609.238930:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704512896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997609.238939:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1309 00000100:00080000:2.0:1789997609.238962:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997609.239094:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704512768 00000100:00100000:0.0:1789997609.239100:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704512768 00000100:00100000:0.0:1789997609.239139:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1084 00000100:00100000:0.0:1789997609.239150:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704512768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997609.239162:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997609.239195:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704512768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997609.239204:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1084 00000100:00100000:0.0:1789997609.241237:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704513152 00000100:00100000:0.0:1789997609.241250:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704513152 00000100:00100000:0.0:1789997609.241311:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704513024 00000100:00100000:0.0:1789997609.241314:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704513024 00000100:00080000:2.0:1789997609.241319:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997609.241325:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997609.241347:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 850 00000100:00100000:0.0:1789997609.241356:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704513152:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997609.241399:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 851 00000100:00100000:1.0:1789997609.241408:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704513024:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997609.241426:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704513152:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 70us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997609.241437:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 850 00000100:00100000:1.0:1789997609.241445:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704513024:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997609.241452:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 851 00000100:00100000:0.0:1789997609.419049:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997609.419071:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712997120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997609.419132:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997609.419177:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712997120 00000100:00100000:3.0:1789997609.419185:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712997120 00000100:00080000:1.0:1789997609.419219:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997609.419254:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1789997609.419269:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712997120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997609.419295:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:3.0:1789997609.419306:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997609.419307:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712997248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997609.419345:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997609.419376:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946712997120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997609.419384:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1789997609.419401:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712997248 00000100:00100000:3.0:1789997609.419403:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712997248 00000100:00100000:3.0:1789997609.419481:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1789997609.419486:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712997248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997609.419505:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997609.419538:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712997248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997609.419543:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1789997609.419583:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712997248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997609.419698:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946712997120:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997609.419905:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997609.738846:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997610.762896:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997611.786847:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997612.490905:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712997376:0@lo:400:kworker.0 00000100:00100000:2.0:1789997612.490999:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997612.491065:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712997376 00000100:00100000:1.0:1789997612.491075:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712997376 00000100:00100000:1.0:1789997612.491121:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1789997612.491130:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712997376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491223:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712997632:0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491256:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997612.491288:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997612.491294:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712997504:0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491314:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997612.491337:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712997760:0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491361:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997612.491398:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712997632 00000100:00100000:0.0:1789997612.491402:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712997632 00000100:00100000:0.0:1789997612.491435:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712997504 00000100:00100000:0.0:1789997612.491438:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712997504 00000100:00100000:0.0:1789997612.491461:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1789997612.491467:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712997632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491500:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712997632:12345-0@lo:400:kworker.0 Request processed in 34us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997612.491507:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1789997612.491521:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:0.0:1789997612.491539:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712997504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491561:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712997504:12345-0@lo:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997612.491567:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00080000:0.0:1789997612.491581:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997612.491609:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712997504:0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491619:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712997632:0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491678:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712997760 00000100:00100000:0.0:1789997612.491681:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712997760 00000100:00100000:0.0:1789997612.491704:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1789997612.491709:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712997760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.491737:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712997760:12345-0@lo:400:kworker.0 Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997612.491743:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00080000:0.0:1789997612.491769:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997612.491782:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712997760:0@lo:400:kworker.0 00000100:00100000:3.0:1789997612.492785:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712998016:0@lo:400:kworker.0 00000100:00100000:3.0:1789997612.492824:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997612.492865:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712998016 00000100:00100000:3.0:1789997612.492869:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712998016 00000100:00100000:3.0:1789997612.492904:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1789997612.492910:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712998016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997612.492963:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946712998016:12345-0@lo:400:kworker.0 Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997612.492969:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1789997612.493013:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946712998016:0@lo:400:kworker.0 00000100:00080000:3.0:1789997612.493028:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997612.493505:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997612.493516:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712997888:0@lo:400:kworker.0 00000100:00100000:0.0:1789997612.493561:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997612.493690:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712997888 00000100:00100000:3.0:1789997612.493694:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712997888 00000100:00100000:3.0:1789997612.493735:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1789997612.493742:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712997888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997612.493795:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712997888:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997612.493802:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1789997612.493829:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712997888:0@lo:400:kworker.0 00000100:00080000:0.0:1789997612.494606:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997612.495401:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712997376:0@lo:400:kworker.0 00000100:00100000:1.0:1789997612.495466:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712997376:12345-0@lo:400:kworker.0 Request processed in 4336us (4465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997612.495476:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00010000:00010000:0.0:1789997612.811352:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997613.834906:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997614.359014:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997614.359058:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997614.359083:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997614.359113:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997614.359142:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704513536 00000100:00100000:0.0:1789997614.359152:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704513536 00000100:00100000:0.0:1789997614.359206:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704513664 00000100:00100000:0.0:1789997614.359210:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704513664 00000100:00100000:0.0:1789997614.359232:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 854 00000100:00100000:0.0:1789997614.359242:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704513536:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997614.359319:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704513536:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997614.359326:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 854 00000100:00100000:0.0:1789997614.359346:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 855 00000100:00100000:0.0:1789997614.359353:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704513664:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997614.359380:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704513664:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997614.359386:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 855 00000100:00080000:0.0:1789997614.359403:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997614.359406:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997614.359492:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704513408 00000100:00100000:2.0:1789997614.359496:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704513408 00000100:00100000:2.0:1789997614.359541:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1313 00000100:00100000:2.0:1789997614.359548:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704513408:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997614.359578:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704513408:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997614.359584:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1313 00000100:00080000:0.0:1789997614.359704:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997614.359822:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704513280 00000100:00100000:1.0:1789997614.359827:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704513280 00000100:00100000:1.0:1789997614.359864:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1086 00000100:00100000:1.0:1789997614.359873:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704513280:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997614.359898:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704513280:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997614.359904:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1086 00000100:00100000:1.0:1789997614.538884:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712998144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997614.538951:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997614.539074:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712998144 00000100:00100000:2.0:1789997614.539083:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712998144 00000100:00080000:0.0:1789997614.539112:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997614.539143:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1789997614.539155:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712998144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997614.539193:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997614.539358:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712998272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997614.539389:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997614.539488:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712998272 00000100:00100000:0.0:1789997614.539492:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712998272 00000100:00100000:0.0:1789997614.539534:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1789997614.539541:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712998272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997614.539561:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997614.539600:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712998272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997614.539606:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00080000:3.0:1789997614.539677:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997614.539726:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712998272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997614.540285:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712998144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1130us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997614.540289:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712998144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997614.540296:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00010000:00010000:1.0:1789997614.858898:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997615.882988:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997616.906986:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997617.612750:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712998400:0@lo:400:kworker.0 00000100:00100000:3.0:1789997617.612829:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997617.612915:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712998912:0@lo:400:kworker.0 00000100:00100000:3.0:1789997617.612945:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997617.612972:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997617.612978:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712998784:0@lo:400:kworker.0 00000100:00100000:3.0:1789997617.613001:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997617.613114:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712998656:0@lo:400:kworker.0 00000100:00100000:1.0:1789997617.613151:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997617.613184:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789997617.613197:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712998528:0@lo:400:kworker.0 00000100:00100000:1.0:1789997617.613221:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997617.613229:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712998400 00000100:00100000:0.0:1789997617.613239:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712998400 00000100:00100000:1.0:1789997617.613242:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712999040:0@lo:400:kworker.0 00000100:00100000:1.0:1789997617.613265:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997617.613291:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1789997617.613301:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712998400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997617.613308:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712998656 00000100:00100000:1.0:1789997617.613314:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712998656 00000100:00100000:0.0:1789997617.613362:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946712998400:12345-0@lo:400:kworker.0 Request processed in 62us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.613369:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1789997617.613400:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712998912 00000100:00100000:0.0:1789997617.613404:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712998912 00000100:00100000:0.0:1789997617.613430:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712998784 00000100:00100000:0.0:1789997617.613433:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712998784 00000100:00100000:0.0:1789997617.613455:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1789997617.613462:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712998912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997617.613494:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712998912:12345-0@lo:400:kworker.0 Request processed in 32us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.613499:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1789997617.613511:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1789997617.613518:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712998784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997617.613546:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712998784:12345-0@lo:400:kworker.0 Request processed in 29us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.613552:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:1.0:1789997617.613584:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712998528 00000100:00100000:1.0:1789997617.613589:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712998528 00000100:00100000:0.0:1789997617.613604:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712998784:0@lo:400:kworker.0 00000100:00100000:1.0:1789997617.613613:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712999040 00000100:00100000:1.0:1789997617.613618:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712999040 00000100:00100000:0.0:1789997617.613618:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946712998400:0@lo:400:kworker.0 00000100:00100000:1.0:1789997617.613644:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1789997617.613691:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712998656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997617.613741:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712998912:0@lo:400:kworker.0 00000100:00100000:3.0:1789997617.613759:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:3.0:1789997617.613772:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712998528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997617.613799:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:0.0:1789997617.613809:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712999040:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789997617.613828:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997617.613834:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997617.613837:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997617.617168:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946712998656:0@lo:400:kworker.0 00000100:00100000:1.0:1789997617.617332:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946712998656:12345-0@lo:400:kworker.0 Request processed in 3344us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997617.617346:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1789997617.617437:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712998528:12345-0@lo:400:kworker.0 Request processed in 3669us (4214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997617.617445:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1789997617.617932:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712998528:0@lo:400:kworker.0 00000100:00100000:0.0:1789997617.619042:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946712999040:12345-0@lo:400:kworker.0 Request processed in 5230us (5771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.619070:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1789997617.619251:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946712999040:0@lo:400:kworker.0 00000100:00100000:2.0:1789997617.656416:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997617.656492:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704513792 00000100:00100000:3.0:1789997617.656503:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704513792 00000100:00080000:2.0:1789997617.656552:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997617.656585:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 925 00000100:00100000:3.0:1789997617.656595:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50957:x1876946704513792:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997617.656736:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50957:x1876946704513792:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 142us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997617.656743:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 925 00000100:00100000:1.0:1789997617.659335:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997617.659419:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704513920 00000100:00100000:0.0:1789997617.659428:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704513920 00000100:00100000:0.0:1789997617.659501:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 493 00000100:00100000:0.0:1789997617.659512:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50957:x1876946704513920:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:2.0:1789997617.659536:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997617.659909:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50957:x1876946704513920:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 398us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.659917:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 493 00000100:00100000:0.0:1789997617.663642:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997617.663810:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704514048 00000100:00100000:3.0:1789997617.663820:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704514048 00000100:00100000:3.0:1789997617.664010:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 494 00000100:00100000:3.0:1789997617.664022:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50957:x1876946704514048:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:2.0:1789997617.664932:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997617.665079:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50957:x1876946704514048:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1056us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997617.665088:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 494 00000100:00100000:2.0:1789997617.667996:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997617.668360:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704514176 00000100:00100000:0.0:1789997617.668370:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704514176 00000100:00100000:0.0:1789997617.668439:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 926 00000100:00100000:0.0:1789997617.668450:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50957:x1876946704514176:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997617.668932:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50957:x1876946704514176:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 482us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.668941:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 926 00000100:00100000:1.0:1789997617.675408:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997617.675484:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704514304 00000100:00100000:3.0:1789997617.675494:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704514304 00000100:00100000:3.0:1789997617.675554:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 927 00000100:00100000:3.0:1789997617.675564:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50957:x1876946704514304:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997617.675682:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50957:x1876946704514304:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 119us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997617.675689:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 927 00000100:00100000:2.0:1789997617.679769:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997617.679868:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704514432 00000100:00100000:0.0:1789997617.679878:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704514432 00000100:00100000:0.0:1789997617.679936:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 495 00000100:00100000:0.0:1789997617.679949:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50957:x1876946704514432:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997617.680348:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50957:x1876946704514432:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 400us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.680356:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 495 00000100:00100000:2.0:1789997617.682303:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997617.682423:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704514560 00000100:00100000:0.0:1789997617.682431:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704514560 00000100:00100000:0.0:1789997617.682905:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 496 00000100:00100000:0.0:1789997617.682917:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50957:x1876946704514560:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997617.683693:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:50957:x1876946704514560:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 776us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.683702:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 496 00000100:00100000:2.0:1789997617.685943:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997617.686050:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704514688 00000100:00100000:0.0:1789997617.686059:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704514688 00000100:00100000:0.0:1789997617.686152:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 928 00000100:00100000:0.0:1789997617.686163:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50957:x1876946704514688:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997617.686599:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50957:x1876946704514688:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 437us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997617.686606:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 928 00010000:00010000:3.0:1789997617.931159:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997618.795318:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997618.795528:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704514816 00000100:00100000:0.0:1789997618.795540:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704514816 00000100:00100000:0.0:1789997618.795607:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 929 00000100:00100000:0.0:1789997618.795620:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50971:x1876946704514816:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997618.795667:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997618.795689:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee94 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997618.795758:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d33f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997618.795774:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997618.795789:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997618.795824:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:0.0:1789997618.795828:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997618.795847:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997618.795872:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee94 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997618.795900:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d33f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee94 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997618.795909:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:0.0:1789997618.795912:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997618.795916:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997618.795975:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50971:x1876946704514816:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 357us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997618.795982:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 929 00000100:00100000:0.0:1789997618.801108:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997618.801560:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704515072 00000100:00100000:3.0:1789997618.801572:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704515072 00000100:00100000:3.0:1789997618.801725:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 930 00000100:00100000:3.0:1789997618.801736:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50971:x1876946704515072:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997618.801783:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997618.801808:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d33f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee94 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.801830:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d2dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee7f expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.801840:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:3.0:1789997618.801852:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997618.801886:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.801899:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.801909:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997618.830856:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967654 is committed 00000004:00010000:0.0:1789997618.831203:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067cc1097 reply state 00000000e7075ca7 transno 4294967654 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997618.831219:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997618.831235:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00080000:0.0:1789997618.831348:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997618.831374:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50971:x1876946704515072:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 29636us (30269us total) trans 4294967654 rc 0/0 00000100:00100000:0.0:1789997618.831384:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 930 00010000:00010000:1.0:1789997618.831513:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997618.831524:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997618.831533:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997618.831540:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997618.831545:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997618.831554:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997618.831572:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997618.831576:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997618.831580:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997618.831587:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592d346 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997618.881187:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997618.881247:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704515200 00000100:00100000:3.0:1789997618.881258:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704515200 00000100:00100000:3.0:1789997618.881319:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 931 00000100:00100000:3.0:1789997618.881330:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50975:x1876946704515200:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997618.881355:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997618.881374:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d34d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaee9b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.881438:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.881453:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.881465:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.881479:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.881487:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.881493:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882140:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882152:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882159:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997618.882180:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:3.0:1789997618.882184:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997618.882204:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882215:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882221:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882284:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882291:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997618.882296:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882303:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882314:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997618.882318:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997618.882322:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882328:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882341:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882348:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882354:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882359:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997618.882361:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882367:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882374:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997618.882376:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997618.882379:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882385:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d35b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882415:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d34d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee9b expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882435:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee9b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997618.882442:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997618.882445:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997618.882447:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997618.882576:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50975:x1876946704515200:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1247us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997618.882584:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 931 00010000:00010000:0.0:1789997618.955160:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997619.479001:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997619.479082:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997619.479119:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997619.479151:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997619.479205:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704515328 00000100:00100000:0.0:1789997619.479216:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704515328 00000100:00100000:1.0:1789997619.479231:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704515584 00000100:00100000:1.0:1789997619.479239:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704515584 00000100:00100000:0.0:1789997619.479273:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1088 00000100:00100000:0.0:1789997619.479286:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704515328:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997619.479293:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704515712 00000100:00100000:1.0:1789997619.479298:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704515712 00000100:00100000:1.0:1789997619.479323:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 858 00000100:00100000:1.0:1789997619.479332:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704515584:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997619.479359:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704515328:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997619.479369:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1088 00000100:00100000:1.0:1789997619.479371:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704515584:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997619.479381:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 858 00000100:00100000:1.0:1789997619.479400:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 859 00000100:00100000:1.0:1789997619.479409:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704515712:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997619.479434:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704515712:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997619.479441:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 859 00000100:00100000:1.0:1789997619.479466:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704515456 00000100:00100000:1.0:1789997619.479469:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704515456 00000100:00080000:2.0:1789997619.479576:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997619.479580:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997619.480076:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997619.480093:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1317 00000100:00100000:1.0:1789997619.480102:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704515456:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997619.480558:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704515456:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 456us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997619.480567:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1317 00000100:00100000:2.0:1789997619.512757:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997619.512853:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704515840 00000100:00100000:0.0:1789997619.512862:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704515840 00000100:00100000:0.0:1789997619.513002:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 932 00000100:00100000:0.0:1789997619.513012:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50994:x1876946704515840:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997619.513031:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997619.513047:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeea2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.513105:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.513122:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.513136:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997619.513167:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:0.0:1789997619.513170:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997619.513183:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.513203:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeea2 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.513222:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeea2 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.513231:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:0.0:1789997619.513314:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997619.513320:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789997619.513386:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50994:x1876946704515840:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 374us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997619.513393:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 932 00000100:00100000:2.0:1789997619.516212:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997619.516260:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704516096 00000100:00100000:3.0:1789997619.516268:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704516096 00000100:00100000:3.0:1789997619.516324:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 933 00000100:00100000:3.0:1789997619.516334:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:50994:x1876946704516096:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997619.516388:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997619.516414:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeea2 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.516501:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee9b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.516509:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997619.516517:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997619.516536:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.516546:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.516553:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997619.537030:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c816e58d reply state 00000000d899b3d0 transno 4294967655 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997619.537054:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997619.537070:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000001:00080000:0.0:1789997619.537169:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967655 is committed 00010000:00080000:3.0:1789997619.537179:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997619.537202:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50994:x1876946704516096:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 20863us (20987us total) trans 4294967655 rc 0/0 00000100:00100000:3.0:1789997619.537211:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 933 00010000:00010000:0.0:1789997619.537481:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.537490:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.537499:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.537505:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997619.537510:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.537517:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.537539:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:0.0:1789997619.537542:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997619.539920:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.539942:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592d377 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997619.574808:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997619.574888:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704516224 00000100:00100000:1.0:1789997619.574898:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704516224 00000100:00100000:1.0:1789997619.574958:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 934 00000100:00100000:1.0:1789997619.574969:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:50998:x1876946704516224:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997619.574993:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997619.575013:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d37e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeea9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575095:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575109:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575120:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575134:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575141:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575148:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575416:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d393 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575425:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575431:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997619.575451:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:1.0:1789997619.575454:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997619.575473:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575488:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575494:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575501:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575506:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997619.575510:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575517:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575536:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:1.0:1789997619.575540:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997619.575545:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575551:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d385 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575563:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575569:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575575:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575581:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997619.575584:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575589:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575597:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38e062d300) 00010000:00010000:1.0:1789997619.575599:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997619.575602:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575607:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d38c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575649:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d37e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeea9 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575699:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d393 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeea9 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.575705:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997619.575707:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997619.575709:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997619.575767:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50998:x1876946704516224:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 801us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997619.575774:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 934 00000100:00100000:0.0:1789997619.579348:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997619.579437:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704516480 00000100:00100000:1.0:1789997619.579448:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704516480 00000100:00100000:1.0:1789997619.579516:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 935 00000100:00100000:1.0:1789997619.579537:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:50998:x1876946704516480:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997619.579557:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997619.579575:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d39a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeeb0 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.580126:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.580153:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.580167:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.580184:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.580192:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.580199:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997619.581255:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00010000:00010000:1.0:1789997619.581602:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d3af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581626:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d3af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581641:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d3af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581698:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581707:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581713:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581719:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997619.581723:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581730:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581744:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997619.581747:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997619.581752:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581758:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d3a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997619.581771:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036523f81 reply state 000000008e0ce927 transno 4294967656 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997619.581779:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997619.581824:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d39a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeb0 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581840:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d3af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeb0 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.581848:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997619.581850:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997619.581853:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997619.581925:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50998:x1876946704516480:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 2399us (2585us total) trans 4294967656 rc 0/0 00000100:00100000:1.0:1789997619.581934:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 935 00000100:00100000:3.0:1789997619.584945:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:2.0:1789997619.584963:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.584978:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.584988:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.584995:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997619.585000:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997619.585003:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704516736 00010000:00010000:2.0:1789997619.585012:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997619.585015:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704516736 00010000:00010000:2.0:1789997619.585032:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38e062d100) 00010000:00010000:2.0:1789997619.585036:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997619.585041:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.585049:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d3a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997619.585082:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 936 00000100:00100000:3.0:1789997619.585096:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50998:x1876946704516736:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:3.0:1789997619.585225:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997619.585257:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d3af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeb0 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.585269:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:3.0:1789997619.585290:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997619.585330:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.585342:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.585357:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997619.585520:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b79ba9d1 reply state 00000000a86c4d93 transno 4294967657 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997619.585537:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997619.585646:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50998:x1876946704516736:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 553us (708us total) trans 4294967657 rc 0/0 00000100:00100000:3.0:1789997619.585690:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 936 00010000:00010000:3.0:1789997619.589486:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.589504:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.589512:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.589518:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997619.589523:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.589531:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997619.589545:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:3.0:1789997619.589548:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997619.589553:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997619.589558:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.589569:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997619.589577:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704516864 00000100:00100000:1.0:1789997619.589587:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704516864 00000100:00100000:1.0:1789997619.589650:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 937 00000100:00100000:1.0:1789997619.589681:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:50998:x1876946704516864:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997619.589702:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997619.589720:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d3c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeeb7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.589784:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d3c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeb7 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.589798:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d3c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeb7 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.589817:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997619.589821:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789997619.589824:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997619.589876:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50998:x1876946704516864:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 197us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997619.589883:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 937 00000100:00100000:1.0:1789997619.597462:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997619.597502:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704516992 00000100:00100000:0.0:1789997619.597513:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704516992 00000100:00100000:0.0:1789997619.597568:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 497 00000100:00100000:0.0:1789997619.597580:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704516992:12345-192.168.204.4@tcp:2:touch.60003 00000100:00100000:0.0:1789997619.598288:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704516992:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 708us (833us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789997619.598297:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 497 00000100:00100000:1.0:1789997619.607153:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997619.607407:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704517248 00000100:00100000:2.0:1789997619.607418:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704517248 00000100:00100000:2.0:1789997619.607962:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:2.0:1789997619.607974:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:50998:x1876946704517248:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:2.0:1789997619.608359:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:50998:x1876946704517248:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 386us (1211us total) trans 4294967658 rc 0/0 00000100:00100000:2.0:1789997619.608368:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 96 00000100:00100000:1.0:1789997619.655345:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997619.657473:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704517376 00000100:00100000:0.0:1789997619.657486:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704517376 00000100:00100000:0.0:1789997619.657562:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 938 00000100:00100000:0.0:1789997619.657574:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51002:x1876946704517376:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:0.0:1789997619.657597:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997619.657631:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d3cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeebe expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657749:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657770:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657781:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657797:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657805:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657811:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657891:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d3e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657900:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657907:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997619.657939:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 0 00000004:00200000:0.0:1789997619.657943:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997619.657962:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657975:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657988:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.657995:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658002:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658008:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997619.658013:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658021:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658033:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997619.658036:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997619.658041:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658047:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d3d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658070:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658077:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658082:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658088:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997619.658090:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658095:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658101:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997619.658103:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997619.658106:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658111:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d3d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658140:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d3cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeebe expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658154:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeebe expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997619.658167:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:0.0:1789997619.658170:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997619.658173:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997619.658242:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:51002:x1876946704517376:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 669us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997619.658250:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 938 00000100:00100000:2.0:1789997619.659847:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712999168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997619.659903:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997619.660059:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712999168 00000100:00100000:1.0:1789997619.660072:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712999168 00000100:00100000:1.0:1789997619.660135:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:1.0:1789997619.660145:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712999168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997619.660181:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997619.660227:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946712999168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997619.660236:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1789997619.660313:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997619.660326:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712999296:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997619.660387:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997619.660433:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946712999168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997619.661679:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997619.661769:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712999296 00000100:00100000:2.0:1789997619.661776:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712999296 00000100:00100000:2.0:1789997619.661839:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1789997619.661847:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712999296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997619.661876:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997619.661932:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946712999296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997619.661939:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:0.0:1789997619.662041:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946712999296:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997619.662734:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997619.663331:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997619.663409:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704517504 00000100:00100000:2.0:1789997619.663416:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704517504 00000100:00100000:2.0:1789997619.663462:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 498 00000100:00100000:2.0:1789997619.663471:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704517504:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:2.0:1789997619.663484:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997619.663505:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeec5 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997619.663549:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x6ab13233, atime: 0x6ab13233, ctime: 0x6ab13233, blocks: 0x1 00010000:00010000:2.0:1789997619.663568:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=1808s v=(0 0) 00010000:00010000:2.0:1789997619.663573:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997619.663583:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.663602:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.663625:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3000, rc 0) 00000100:00100000:2.0:1789997619.663857:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704517504:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 385us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997619.663864:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 498 00000100:00100000:1.0:1789997619.672769:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997619.673014:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704517760 00000100:00100000:3.0:1789997619.673026:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704517760 00000100:00100000:3.0:1789997619.673156:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 939 00000100:00100000:3.0:1789997619.673168:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:51002:x1876946704517760:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997619.673241:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997619.673269:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d3e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeebe expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673300:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d3c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeb7 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673320:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:3.0:1789997619.673332:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997619.673355:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673370:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673380:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673394:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673406:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673413:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673524:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673532:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.673539:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997619.674163:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 64 off10112 00000004:00080000:3.0:1789997619.674173:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1808366518719ns, next at 1809366516658ns, rc = 0 00010000:00010000:3.0:1789997619.674223:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674233:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674242:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674249:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674256:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674266:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674279:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997619.674301:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674307:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674313:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674320:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997619.674324:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674331:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674340:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997619.674343:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997619.674347:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674353:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d3fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674375:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674382:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674388:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674393:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997619.674396:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674402:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674410:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:3.0:1789997619.674413:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997619.674416:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997619.674422:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d3ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997619.674431:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031d32262 reply state 000000008076056b transno 4294967659 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997619.674440:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997619.674522:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:51002:x1876946704517760:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1354us (1760us total) trans 4294967659 rc 0/0 00000100:00100000:3.0:1789997619.674531:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 939 00010000:00010000:1.0:1789997619.674925:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997619.674932:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.674939:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997619.674942:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.674948:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.674962:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:1.0:1789997619.674965:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997619.674968:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.674974:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.674988:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997619.674990:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997619.674991:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997619.676537:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.676551:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.676571:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.676578:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997619.676584:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.676595:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.676606:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38ee49ee00) 00010000:00010000:2.0:1789997619.676619:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997619.676624:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997619.676629:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d3f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997619.981440:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997620.279687:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997620.279749:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704517888 00000100:00100000:2.0:1789997620.279760:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704517888 00000100:00100000:2.0:1789997620.279818:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 940 00000100:00100000:2.0:1789997620.279829:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51020:x1876946704517888:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997620.279856:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997620.279879:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d40a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeecc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997620.279953:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d411 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997620.279969:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997620.279982:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997620.280025:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:2.0:1789997620.280029:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997620.280048:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d411 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997620.280074:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d40a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeecc expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997620.280091:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d411 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeecc expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997620.280100:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:2.0:1789997620.280103:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997620.280106:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2a00, rc 0) 00000100:00100000:2.0:1789997620.280175:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:51020:x1876946704517888:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 347us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997620.280183:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 940 00000100:00100000:0.0:1789997620.286104:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997620.286205:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704518144 00000100:00100000:1.0:1789997620.286218:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704518144 00000100:00100000:1.0:1789997620.286305:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 941 00000100:00100000:1.0:1789997620.286315:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:51020:x1876946704518144:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997620.286365:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997620.286391:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d411 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeecc expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.286411:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d393 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeea9 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.286421:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997620.286433:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997620.286458:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.286475:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.286484:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997620.286755:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008b84cba reply state 00000000ae55c0dc transno 4294967660 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997620.286765:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997620.286773:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000100:00100000:1.0:1789997620.286909:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:51020:x1876946704518144:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 594us (814us total) trans 4294967660 rc 0/0 00000100:00100000:1.0:1789997620.286916:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 941 00010000:00010000:1.0:1789997620.291109:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.291125:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.291133:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.291139:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997620.291143:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.291150:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.291166:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997620.291170:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997620.291175:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.291181:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d418 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997620.375066:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997620.375206:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704518272 00000100:00100000:3.0:1789997620.375216:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704518272 00000100:00100000:3.0:1789997620.375279:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 942 00000100:00100000:3.0:1789997620.375290:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51032:x1876946704518272:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997620.375401:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51032:x1876946704518272:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 113us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997620.375408:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 942 00000100:00100000:0.0:1789997620.376936:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997620.377364:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704518400 00000100:00100000:2.0:1789997620.377374:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704518400 00000100:00100000:2.0:1789997620.377425:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 499 00000100:00100000:2.0:1789997620.377434:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51032:x1876946704518400:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997620.377860:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51032:x1876946704518400:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 424us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997620.377868:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 499 00000100:00100000:1.0:1789997620.381633:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997620.381755:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704518528 00000100:00100000:2.0:1789997620.381914:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704518528 00000100:00100000:2.0:1789997620.381995:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 500 00000100:00100000:2.0:1789997620.382007:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51032:x1876946704518528:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997620.383342:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51032:x1876946704518528:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1333us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997620.383353:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 500 00000100:00100000:3.0:1789997620.385532:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997620.385684:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704518656 00000100:00100000:1.0:1789997620.385695:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704518656 00000100:00100000:1.0:1789997620.385748:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 943 00000100:00100000:1.0:1789997620.385759:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51032:x1876946704518656:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997620.386174:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51032:x1876946704518656:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 417us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997620.386181:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 943 00000100:00100000:0.0:1789997620.389205:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997620.389263:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704518784 00000100:00100000:1.0:1789997620.389271:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704518784 00000100:00100000:1.0:1789997620.389321:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 944 00000100:00100000:1.0:1789997620.389332:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51032:x1876946704518784:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997620.389434:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51032:x1876946704518784:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997620.389440:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 944 00000100:00100000:3.0:1789997620.391007:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997620.391171:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704518912 00000100:00100000:0.0:1789997620.391178:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704518912 00000100:00100000:0.0:1789997620.391294:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 501 00000100:00100000:0.0:1789997620.391305:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51032:x1876946704518912:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997620.391717:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51032:x1876946704518912:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 413us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997620.391724:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 501 00000100:00100000:3.0:1789997620.393568:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997620.393723:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704519040 00000100:00100000:2.0:1789997620.393731:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704519040 00000100:00100000:2.0:1789997620.393782:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 502 00000100:00100000:2.0:1789997620.393792:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51032:x1876946704519040:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997620.394205:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51032:x1876946704519040:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 413us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997620.394220:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 502 00000100:00100000:3.0:1789997620.402871:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997620.403354:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704519168 00000100:00100000:2.0:1789997620.403365:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704519168 00000100:00100000:2.0:1789997620.403426:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 945 00000100:00100000:2.0:1789997620.403437:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51032:x1876946704519168:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997620.403965:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51032:x1876946704519168:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 528us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997620.403972:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 945 00000100:00100000:3.0:1789997620.438169:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997620.438258:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704519296 00000100:00100000:1.0:1789997620.438269:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704519296 00000100:00100000:1.0:1789997620.438351:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 946 00000100:00100000:1.0:1789997620.438363:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:51036:x1876946704519296:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789997620.438387:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997620.438410:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d41f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeed3 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438481:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438496:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438511:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438526:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438533:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438542:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438862:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438873:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438881:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997620.438905:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:1.0:1789997620.438908:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997620.438929:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438942:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438948:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438955:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438962:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997620.438966:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438973:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438984:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:1.0:1789997620.438987:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997620.438991:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.438998:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439011:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439019:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439023:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439029:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997620.439032:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439037:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439044:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38e062d400) 00010000:00010000:1.0:1789997620.439047:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997620.439049:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439055:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d42d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439088:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d41f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeed3 expref: 13 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439102:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeed3 expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.439110:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997620.439112:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997620.439115:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997620.439313:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:51036:x1876946704519296:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 951us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997620.439321:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 946 00000100:00100000:0.0:1789997620.442884:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997620.442980:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704519552 00000100:00100000:1.0:1789997620.442991:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704519552 00000100:00100000:1.0:1789997620.443052:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 947 00000100:00100000:1.0:1789997620.443064:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:51036:x1876946704519552:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789997620.443085:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997620.443106:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d43b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeeda expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.443239:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.443255:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.443267:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.443282:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.443290:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.443297:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997620.443816:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:1.0:1789997620.443973:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.443985:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.443998:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444030:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444038:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444045:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444051:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997620.444055:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444062:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444073:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997620.444076:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997620.444081:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444087:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d442 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997620.444100:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6f4efe2 reply state 00000000426d2043 transno 4294967661 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997620.444109:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997620.444137:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d43b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeda expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444151:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeda expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.444158:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789997620.444161:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997620.444163:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997620.444233:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+15:51036:x1876946704519552:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 1172us (1360us total) trans 4294967661 rc 0/0 00000100:00100000:1.0:1789997620.444241:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 947 00010000:00010000:0.0:1789997620.446520:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.446535:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.446543:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.446551:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997620.446555:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.446562:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.446578:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38e062d800) 00010000:00010000:0.0:1789997620.446581:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997620.446585:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.446604:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d449 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997620.450969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997620.451193:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704519680 00000100:00100000:2.0:1789997620.451203:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704519680 00000100:00100000:2.0:1789997620.451243:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 503 00000100:00100000:2.0:1789997620.451254:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51036:x1876946704519680:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:2.0:1789997620.451314:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997620.451332:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeee1 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997620.451354:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789997620.451372:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=1809s v=(0 0) 00010000:00010000:2.0:1789997620.451376:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997620.451383:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997620.451396:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997620.451405:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997620.451457:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:51036:x1876946704519680:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 203us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997620.451461:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 503 00000100:00100000:2.0:1789997620.463567:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997620.463813:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704519808 00000100:00100000:0.0:1789997620.463822:0:6664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704519808 00002000:00100000:0.0:1789997620.463873:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1e:0x0] (0->1048575) req@ffff8a38fd86df80 x1876946704519808/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:596/0 lens 488/0 e 0 to 0 dl 1789997631 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997620.463884:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fd86df80 with x1876946704519808 ext(0->1048575) 00002000:00010000:0.0:1789997620.463890:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fd86df80 00000100:00100000:0.0:1789997620.463921:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:0.0:1789997620.463930:0:6664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704519808:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:0.0:1789997620.477436:0:6664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704519808:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 13496us (13868us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789997620.477451:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00002000:00100000:0.0:1789997620.477465:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1e:0x0] (0->1048575) req@ffff8a38fd86df80 x1876946704519808/t4294967356(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:596/0 lens 488/448 e 0 to 0 dl 1789997631 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997620.477475:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fd86df80 with x1876946704519808 ext(0->1048575) 00002000:00010000:0.0:1789997620.477482:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fd86df80 00000100:00100000:2.0:1789997620.479901:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997620.480311:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704519936 00000100:00100000:3.0:1789997620.480322:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704519936 00000100:00100000:3.0:1789997620.480510:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 948 00000100:00100000:3.0:1789997620.480648:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:51036:x1876946704519936:12345-192.168.204.4@tcp:44:dd.60003 00000001:00080000:0.0:1789997620.511411:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967661 is committed 00000004:00080000:0.0:1789997620.511440:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 84 committed 00000100:00100000:3.0:1789997620.511620:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997620.511640:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712999424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789997620.511739:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997620.511811:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712999424 00000100:00100000:3.0:1789997620.511819:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712999424 00000100:00100000:3.0:1789997620.511864:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1789997620.511873:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946712999424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789997620.511900:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:30 count 1 00010000:00010000:3.0:1789997620.511926:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.511949:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.511964:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789997620.511968:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997620.511972:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.512000:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.512013:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 6 pid: 6656 timeout: 1909 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997620.512025:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712999552:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997620.512082:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60480 going to sleep for 11 seconds 00000100:00100000:2.0:1789997620.512975:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51036:x1876946704519936:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 32453us (33079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997620.512985:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 948 00000100:00100000:2.0:1789997620.521036:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997620.521162:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997620.521266:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704520064 00000100:00100000:1.0:1789997620.521276:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704520064 00010000:00010000:1.0:1789997620.521320:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 7 pid: 6656 timeout: 1909 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997620.521323:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704520192 00000100:00100000:0.0:1789997620.521332:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704520192 00000100:00100000:1.0:1789997620.521373:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 381 00000100:00100000:0.0:1789997620.521379:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 505 00000100:00100000:1.0:1789997620.521387:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704520064:12345-192.168.204.4@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789997620.521393:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704520192:12345-192.168.204.4@tcp:16:dd.60003 00010000:00010000:1.0:1789997620.521406:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997620.521414:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 7 pid: 6656 timeout: 1909 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.521427:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 7 pid: 6656 timeout: 1909 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.521456:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997620.521462:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997620.521468:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.521478:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997620.521500:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997620.521563:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704520064:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 179us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997620.521572:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 381 00010000:00010000:3.0:1789997620.524931:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000011701aa/0x65b43101d592d3e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeec5 expref: 6 pid: 6656 timeout: 1909 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997620.524953:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad04700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946712999552:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997620.524977:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.524989:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.524996:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.525008:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.525016:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997620.525033:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997620.525695:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997620.525703:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.525712:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997620.525716:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.525724:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.525742:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.525749:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb59f214/0x65b43101d592d465 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997620.525766:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997620.525768:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997620.525769:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997620.525793:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946712999424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13919us (14052us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1789997620.525802:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000004:00080000:2.0:1789997620.525902:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fad07800/2, rc 0, transno 4294967357 00000100:00100000:2.0:1789997620.525910:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946712999424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997620.551195:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704520192:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 29798us (30024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997620.551212:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 505 00000001:00080000:2.0:1789997620.551297:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00000100:00100000:2.0:1789997620.553239:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997620.553313:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704520448 00000100:00100000:3.0:1789997620.553323:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704520448 00000100:00100000:3.0:1789997620.553378:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 97 00000100:00100000:3.0:1789997620.553387:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51036:x1876946704520448:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:3.0:1789997620.553903:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:51036:x1876946704520448:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 517us (671us total) trans 4294967662 rc 0/0 00000100:00100000:3.0:1789997620.553909:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 97 00010000:00010000:1.0:1789997621.003070:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997621.379229:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967662 is committed 00010000:00010000:1.0:1789997622.027752:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997622.257224:0:86379:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1810949568171ns, next at 1791667641211ns, rc = 0 00000004:00080000:1.0:1789997622.257316:0:86379:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1810949661734ns, next at 1809366516658ns, rc = 0 00000004:00080000:0.0:1789997622.259057:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 85 committed 00000004:00080000:0.0:1789997622.259083:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 82 committed 00000001:00080000:2.0:1789997622.265220:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967356 is committed 00000001:00080000:2.0:1789997622.265237:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967357 is committed 00000100:00100000:3.0:1789997622.731582:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997622.731618:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712999808:0@lo:400:kworker.0 00000100:00100000:1.0:1789997622.731648:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712999936:0@lo:400:kworker.0 00000100:00100000:1.0:1789997622.731717:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997622.731865:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712999936 00000100:00100000:3.0:1789997622.731873:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712999936 00000100:00100000:1.0:1789997622.731881:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997622.731887:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713000064:0@lo:400:kworker.0 00000100:00100000:1.0:1789997622.731911:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997622.731927:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1789997622.731936:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712999936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.731995:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946712999936:12345-0@lo:400:kworker.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997622.732003:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00080000:3.0:1789997622.732025:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997622.732039:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713000064 00000100:00100000:3.0:1789997622.732043:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713000064 00000100:00100000:3.0:1789997622.732072:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1789997622.732079:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713000064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732110:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713000064:12345-0@lo:400:kworker.0 Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997622.732116:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00080000:3.0:1789997622.732133:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997622.732142:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997622.732181:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712999680:0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732210:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997622.732238:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713000320:0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732260:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997622.732278:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997622.732285:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713000192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732304:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997622.732327:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712999808 00000100:00100000:3.0:1789997622.732330:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712999808 00000100:00100000:3.0:1789997622.732350:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713000320 00000100:00100000:3.0:1789997622.732353:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713000320 00000100:00100000:3.0:1789997622.732374:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1789997622.732380:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712999808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732411:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946712999808:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997622.732417:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1789997622.732429:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1789997622.732435:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713000320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732462:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713000320:12345-0@lo:400:kworker.0 Request processed in 27us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997622.732467:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1789997622.732485:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946712999680 00000100:00100000:3.0:1789997622.732488:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946712999680 00000100:00100000:3.0:1789997622.732511:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:3.0:1789997622.732517:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712999680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732546:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946712999680:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997622.732546:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713000064:0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732564:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1789997622.732570:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946712999936:0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732591:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713000192 00000100:00100000:3.0:1789997622.732595:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713000192 00000100:00100000:3.0:1789997622.732627:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1789997622.732634:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713000192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732685:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713000192:12345-0@lo:400:kworker.0 Request processed in 52us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997622.732692:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00080000:3.0:1789997622.732714:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997622.732717:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997622.732731:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:3.0:1789997622.732736:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fad07800, transno 4294967357 00000100:00100000:3.0:1789997622.732758:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713000192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732769:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713000320:0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732777:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946712999808:0@lo:400:kworker.0 00000100:00100000:3.0:1789997622.732785:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946712999680:0@lo:400:kworker.0 00010000:00010000:3.0:1789997623.050809:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997623.303899:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997623.304014:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704520576 00000100:00100000:1.0:1789997623.304026:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704520576 00000100:00080000:2.0:1789997623.304082:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997623.304206:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 949 00000100:00100000:1.0:1789997623.304218:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51228:x1876946704520576:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997623.304331:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51228:x1876946704520576:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 115us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997623.304339:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 949 00000100:00100000:2.0:1789997623.314874:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997623.315196:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704520704 00000100:00100000:3.0:1789997623.315208:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704520704 00000100:00100000:3.0:1789997623.315292:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 506 00000100:00100000:3.0:1789997623.315305:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:51228:x1876946704520704:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:1.0:1789997623.315510:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997623.315756:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:51228:x1876946704520704:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 454us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997623.315766:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 506 00000100:00100000:2.0:1789997623.318640:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997623.318765:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704520832 00000100:00100000:1.0:1789997623.318786:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704520832 00000100:00100000:1.0:1789997623.318857:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 507 00000100:00100000:1.0:1789997623.318868:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51228:x1876946704520832:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:3.0:1789997623.318906:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997623.319251:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51228:x1876946704520832:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 384us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997623.319260:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 507 00000100:00100000:1.0:1789997623.326272:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997623.326590:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704520960 00000100:00100000:2.0:1789997623.326601:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704520960 00000100:00100000:2.0:1789997623.326679:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 950 00000100:00100000:2.0:1789997623.326690:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51228:x1876946704520960:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997623.327377:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51228:x1876946704520960:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 686us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997623.327387:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 950 00000100:00100000:0.0:1789997623.331163:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997623.331626:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704521088 00000100:00100000:1.0:1789997623.331636:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704521088 00000100:00100000:1.0:1789997623.331725:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 951 00000100:00100000:1.0:1789997623.331737:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51228:x1876946704521088:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997623.331845:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51228:x1876946704521088:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 110us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997623.331855:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 951 00000100:00100000:1.0:1789997623.336838:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997623.338947:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704521216 00000100:00100000:2.0:1789997623.338962:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704521216 00000100:00100000:2.0:1789997623.339025:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 508 00000100:00100000:2.0:1789997623.339035:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:51228:x1876946704521216:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997623.339409:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:51228:x1876946704521216:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 373us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997623.339417:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 508 00000100:00100000:0.0:1789997623.342482:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997623.343807:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704521344 00000100:00100000:2.0:1789997623.343887:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704521344 00000100:00100000:3.0:1789997623.344613:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 509 00000100:00100000:3.0:1789997623.344626:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51228:x1876946704521344:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997623.345223:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51228:x1876946704521344:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 598us (2748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997623.345233:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 509 00000100:00100000:0.0:1789997623.349675:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997623.350189:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704521472 00000100:00100000:1.0:1789997623.350200:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704521472 00000100:00100000:1.0:1789997623.350260:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 952 00000100:00100000:1.0:1789997623.350272:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51228:x1876946704521472:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997623.352002:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51228:x1876946704521472:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 1727us (2346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997623.352014:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 952 00000100:00100000:1.0:1789997623.407842:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997623.408044:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704521728 00000100:00100000:2.0:1789997623.408055:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704521728 00000100:00100000:2.0:1789997623.408161:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 953 00000100:00100000:2.0:1789997623.408171:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51232:x1876946704521728:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:2.0:1789997623.408229:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997623.408297:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeda expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408334:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:2.0:1789997623.408345:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997623.408379:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408394:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408403:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408430:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408439:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408446:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408882:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408892:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.408899:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997623.409813:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].30, 64 off10112 00000004:00080000:2.0:1789997623.409824:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1812102170146ns, next at 1813102167917ns, rc = 0 00010000:00010000:2.0:1789997623.409914:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.409926:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.409936:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.409943:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.409949:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.409955:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.410803:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997623.410815:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997623.410825:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997623.410834:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997623.410838:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.410840:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.410854:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.410860:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997623.410862:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.410870:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997623.411027:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997623.411028:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:1.0:1789997623.411034:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997623.411042:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997623.411042:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997623.411059:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d481 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.411062:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997623.411068:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997623.411072:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997623.411078:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997623.411079:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d47a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997623.411083:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997623.411086:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997623.411107:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.411113:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.411119:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.411124:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997623.411126:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.411132:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.411140:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:2.0:1789997623.411142:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997623.411145:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997623.411150:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d46c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997623.411163:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000902028a9 reply state 0000000006200712 transno 4294967663 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997623.411172:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997623.411276:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:51232:x1876946704521728:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 3101us (3438us total) trans 4294967663 rc 0/0 00000100:00100000:2.0:1789997623.411285:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 953 00010000:00010000:3.0:1789997623.418000:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997623.418019:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997623.418027:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997623.418034:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997623.418039:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997623.418053:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997623.418070:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x1c2d2f2 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997623.418073:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997623.418078:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997623.418084:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d473 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997624.074924:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997624.599614:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997624.599712:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997624.599749:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997624.599780:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997624.599819:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704522112 00000100:00100000:3.0:1789997624.599820:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704521984 00000100:00100000:1.0:1789997624.599831:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704522112 00000100:00100000:3.0:1789997624.599832:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704521984 00000100:00100000:2.0:1789997624.599855:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704522240 00000100:00100000:2.0:1789997624.599861:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704522240 00000100:00100000:1.0:1789997624.599886:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 862 00000100:00100000:1.0:1789997624.599897:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704522112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997624.599960:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1321 00000100:00100000:1.0:1789997624.599973:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704522112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997624.599974:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704521984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997624.600019:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704521984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 51us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997624.600027:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1321 00000100:00100000:0.0:1789997624.600040:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704521856 00000100:00100000:0.0:1789997624.600046:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704521856 00000100:00100000:0.0:1789997624.600082:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1090 00000100:00100000:0.0:1789997624.600090:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704521856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997624.600119:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704521856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997624.600127:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1090 00000100:00100000:2.0:1789997624.601128:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 863 00000100:00100000:2.0:1789997624.601141:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704522240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997624.603578:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 862 00000100:00100000:3.0:1789997624.605253:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704522240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 4108us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997624.605281:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 863 00000100:00100000:2.0:1789997624.779399:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713000448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997624.779479:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997624.779600:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713000448 00000100:00100000:3.0:1789997624.779609:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713000448 00000100:00100000:3.0:1789997624.779702:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1789997624.779713:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713000448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997624.779758:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789997624.779872:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997624.783246:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713000448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3527us (3759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997624.783260:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000004:00080000:3.0:1789997624.783366:0:7602:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1813475711103ns, next at 1814475708606ns, rc = 0 00000100:00100000:0.0:1789997624.783600:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713000576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997624.783690:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997624.784116:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713000576 00000100:00100000:3.0:1789997624.784136:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713000576 00000100:00100000:3.0:1789997624.784191:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1789997624.784200:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713000576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997624.784235:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997624.784285:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713000576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997624.784292:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00080000:0.0:1789997624.784418:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997624.784454:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713000576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997624.787274:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713000448:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789997625.017352:0:86525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1813709695721ns, next at 1814475708606ns, rc = 0 00000004:00080000:0.0:1789997625.047588:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 85 committed 00000001:00080000:0.0:1789997625.047610:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967663 is committed 00000004:00080000:0.0:1789997625.047615:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 83 committed 00000004:00080000:0.0:1789997625.047620:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 84 committed 00000100:00100000:2.0:1789997625.047937:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713000704:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789997625.048011:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997625.048255:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713000704 00000100:00100000:0.0:1789997625.048264:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713000704 00000100:00100000:0.0:1789997625.048374:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1789997625.048383:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713000704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997625.048409:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:30 count 1 00010000:00010000:0.0:1789997625.048435:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997625.048456:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997625.048465:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e:0x0].0x0 since=4s v=(0 0) 00010000:00010000:0.0:1789997625.048469:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997625.048474:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997625.048502:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997625.048526:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 5 pid: 6658 timeout: 1913 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997625.048538:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946713000832:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997625.048601:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e09a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1789997625.051063:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946713000832:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997625.051097:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997625.052054:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997625.052141:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704522368 00000100:00100000:1.0:1789997625.052149:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704522368 00000100:00080000:0.0:1789997625.052287:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997625.052366:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 6 pid: 6658 timeout: 1913 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997625.052418:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 382 00000100:00100000:1.0:1789997625.052428:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704522368:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997625.052444:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997625.052450:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 6 pid: 6658 timeout: 1913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052463:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 6 pid: 6658 timeout: 1913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052488:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0e1bf39/0x65b43101d592d45e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee1 expref: 6 pid: 6658 timeout: 1913 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052516:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997625.052521:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997625.052526:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052537:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052569:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997625.052630:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704522368:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 203us (580us total) trans 0 rc 0/0 00010000:00010000:0.0:1789997625.052636:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997625.052637:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 382 00010000:00010000:0.0:1789997625.052646:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997625.052674:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997625.052682:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997625.052757:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997625.052871:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997625.052877:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052886:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997625.052890:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052900:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052922:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052928:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060becebf/0x65b43101d592d488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997625.052947:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997625.052949:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997625.052951:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997625.054041:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713000704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5650us (6020us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789997625.054051:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000004:00080000:2.0:1789997625.054308:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c6dec700/2, rc 0, transno 4294967357 00000100:00100000:2.0:1789997625.054330:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713000704:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789997625.055182:0:86525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1813747527067ns, next at 1809366516658ns, rc = 0 00000004:00080000:1.0:1789997625.062099:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 86 committed 00010000:00010000:1.0:1789997625.100689:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997626.122848:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997627.147053:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997627.853744:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713001344:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.853810:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997627.853862:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789997627.853868:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713000960:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.853895:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997627.853915:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713001472:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.853934:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997627.853958:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713001088:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.853982:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997627.853999:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713001600:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.854032:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997627.854050:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997627.854055:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713001216:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.854076:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997627.854106:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713001088 00000100:00100000:2.0:1789997627.854113:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713001088 00000100:00100000:2.0:1789997627.854151:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713001600 00000100:00100000:2.0:1789997627.854154:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713001600 00000100:00100000:2.0:1789997627.854177:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713001216 00000100:00100000:2.0:1789997627.854180:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713001216 00000100:00100000:2.0:1789997627.854196:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1789997627.854204:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713001088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.854266:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713001088:12345-0@lo:400:kworker.0 Request processed in 62us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997627.854274:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1789997627.854290:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1789997627.854295:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713001600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.854321:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713001600:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997627.854327:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1789997627.854338:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1789997627.854344:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713001216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.854370:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713001216:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997627.854376:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00080000:2.0:1789997627.854398:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997627.854423:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713001344 00000100:00100000:3.0:1789997627.854427:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713001344 00000100:00100000:2.0:1789997627.854432:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713001216:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.854442:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713001088:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.854464:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713001600:0@lo:400:kworker.0 00000100:00100000:3.0:1789997627.854470:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713001472 00000100:00100000:3.0:1789997627.854473:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713001472 00000100:00100000:3.0:1789997627.854492:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1789997627.854496:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1789997627.854499:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713001344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.854502:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713001472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997627.854541:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713001344:12345-0@lo:400:kworker.0 Request processed in 42us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997627.854546:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1789997627.854579:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713000960 00000100:00100000:2.0:1789997627.854800:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713001472:12345-0@lo:400:kworker.0 Request processed in 297us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997627.854806:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00080000:1.0:1789997627.854975:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997627.854978:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997627.856643:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713001472:0@lo:400:kworker.0 00000100:00100000:2.0:1789997627.856701:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713001344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997627.857517:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713000960 00000100:00100000:3.0:1789997627.857582:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1789997627.857592:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713000960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997627.857685:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713000960:12345-0@lo:400:kworker.0 Request processed in 94us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997627.857692:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1789997627.857856:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713000960:0@lo:400:kworker.0 00010000:00010000:1.0:1789997628.172940:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997628.401147:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00010000:00010000:1.0:1789997629.194866:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997629.718454:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997629.718497:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997629.718522:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997629.718543:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997629.718568:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704522752 00000100:00100000:3.0:1789997629.718578:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704522752 00000100:00100000:3.0:1789997629.718635:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704522880 00000100:00100000:3.0:1789997629.718639:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704522880 00000100:00100000:0.0:1789997629.718742:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704522496 00000100:00100000:0.0:1789997629.718747:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704522496 00000100:00100000:0.0:1789997629.718785:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1092 00000100:00100000:0.0:1789997629.718797:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704522496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997629.718895:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704522496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 99us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997629.718908:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1092 00000100:00100000:3.0:1789997629.719389:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 866 00000100:00100000:3.0:1789997629.719400:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704522752:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997629.719456:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704522752:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 59us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997629.719463:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 866 00000100:00100000:3.0:1789997629.719476:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 867 00000100:00100000:3.0:1789997629.719483:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704522880:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997629.719507:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704522880:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997629.719513:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 867 00000100:00080000:3.0:1789997629.719530:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997629.719534:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997629.719561:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704522624 00000100:00100000:3.0:1789997629.719565:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704522624 00000100:00100000:3.0:1789997629.719596:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1325 00000100:00100000:3.0:1789997629.719602:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704522624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997629.719632:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704522624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997629.719717:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1325 00000100:00080000:3.0:1789997629.719735:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997629.899061:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713001728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997629.899142:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997629.899310:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713001728 00000100:00100000:3.0:1789997629.899318:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713001728 00000100:00100000:3.0:1789997629.899384:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1789997629.899393:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713001728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997629.899438:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997629.899486:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713001728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997629.899493:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00080000:2.0:1789997629.899557:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997629.899598:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713001728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997629.899756:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713001856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997629.899783:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997629.899900:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713001856 00000100:00100000:1.0:1789997629.899905:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713001856 00000100:00100000:1.0:1789997629.899948:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1789997629.899956:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713001856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997629.899977:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997629.900025:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713001856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997629.900032:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00080000:2.0:1789997629.900176:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997629.901201:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:0.0:1789997629.901209:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c6dec700, transno 4294967357 00000100:00100000:0.0:1789997629.901236:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713001856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997630.219560:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997631.244504:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997632.267013:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997632.970953:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997632.970969:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713002112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997632.970973:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713001984:0@lo:400:kworker.0 00000100:00100000:3.0:1789997632.971179:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713002496:0@lo:400:kworker.0 00000100:00100000:0.0:1789997632.971202:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997632.971225:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997632.971277:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713002368:0@lo:400:kworker.0 00000100:00100000:1.0:1789997632.971291:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713001984 00000100:00100000:1.0:1789997632.971301:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713001984 00000100:00100000:0.0:1789997632.971305:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997632.971364:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1789997632.971371:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713002496 00000100:00100000:1.0:1789997632.971377:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713001984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997632.971378:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713002496 00000100:00100000:0.0:1789997632.971421:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713002368 00000100:00100000:0.0:1789997632.971424:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713002368 00000100:00100000:1.0:1789997632.971449:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713001984:12345-0@lo:400:kworker.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997632.971453:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1789997632.971466:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1789997632.971467:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1789997632.971467:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713002496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997632.971477:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713002368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997632.971508:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713002368:12345-0@lo:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997632.971508:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713002496:12345-0@lo:400:kworker.0 Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997632.971514:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1789997632.971526:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1789997632.971547:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713002368:0@lo:400:kworker.0 00000100:00100000:0.0:1789997632.971553:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713002240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997632.971555:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713002496:0@lo:400:kworker.0 00000100:00100000:1.0:1789997632.971568:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713001984:0@lo:400:kworker.0 00000100:00080000:3.0:1789997632.971586:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997632.971591:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997632.971597:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997632.971618:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997632.971624:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713002624:0@lo:400:kworker.0 00000100:00100000:0.0:1789997632.971646:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997632.971806:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713002240 00000100:00100000:3.0:1789997632.971913:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713002240 00000100:00100000:3.0:1789997632.971965:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713002624 00000100:00100000:3.0:1789997632.971969:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713002624 00000100:00100000:3.0:1789997632.971998:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1789997632.972016:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713002240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997632.972056:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713002240:12345-0@lo:400:kworker.0 Request processed in 52us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997632.972066:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1789997632.972077:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1789997632.972083:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713002624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997632.972109:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713002624:12345-0@lo:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997632.972114:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1789997632.972170:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713002624:0@lo:400:kworker.0 00000100:00100000:3.0:1789997632.972181:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713002240:0@lo:400:kworker.0 00000100:00100000:2.0:1789997632.972274:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997632.972744:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713002112 00000100:00100000:3.0:1789997632.972749:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713002112 00000100:00100000:3.0:1789997632.972834:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1789997632.972841:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713002112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997632.972911:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713002112:12345-0@lo:400:kworker.0 Request processed in 71us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997632.972917:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1789997632.972981:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713002112:0@lo:400:kworker.0 00000100:00080000:0.0:1789997632.973022:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789997633.293559:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997634.314826:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997634.838136:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997634.838186:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997634.838236:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704523008 00000100:00100000:0.0:1789997634.838251:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704523008 00000100:00100000:2.0:1789997634.838280:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704523136 00000100:00100000:2.0:1789997634.838286:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704523136 00000100:00100000:0.0:1789997634.838333:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1094 00000100:00100000:0.0:1789997634.838344:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704523008:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997634.838399:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1329 00000100:00100000:2.0:1789997634.838408:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704523136:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997634.838495:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704523136:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997634.838495:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704523008:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 149us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997634.838516:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1329 00000100:00100000:0.0:1789997634.838516:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1094 00000100:00080000:3.0:1789997634.838883:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997634.843432:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997634.843486:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997634.843595:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704523264 00000100:00100000:0.0:1789997634.843605:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704523264 00000100:00100000:0.0:1789997634.843705:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704523392 00000100:00100000:0.0:1789997634.843709:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704523392 00000100:00100000:0.0:1789997634.843736:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 870 00000100:00100000:0.0:1789997634.843748:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704523264:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997634.843824:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704523264:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997634.843831:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 870 00000100:00100000:1.0:1789997634.843972:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 871 00000100:00100000:1.0:1789997634.843985:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704523392:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997634.844019:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704523392:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997634.844026:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 871 00000100:00080000:3.0:1789997634.844068:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997634.844074:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997635.019129:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997635.019155:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713002752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997635.019231:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997635.019328:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713002752 00000100:00100000:1.0:1789997635.019333:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713002880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997635.019339:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713002752 00000100:00100000:1.0:1789997635.019370:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997635.019404:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713002880 00000100:00100000:2.0:1789997635.019408:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713002880 00000100:00100000:2.0:1789997635.019430:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1789997635.019441:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1789997635.019442:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713002752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997635.019456:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713002880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997635.019478:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00002000:00000024:1.0:1789997635.019491:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997635.019530:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713002752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997635.019539:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1789997635.019558:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713002880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997635.019566:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00080000:2.0:1789997635.019570:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997635.019576:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997635.019638:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713002752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997635.020797:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713002880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997635.339260:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997636.362869:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997637.386952:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997638.091174:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713003264:0@lo:400:kworker.0 00000100:00100000:2.0:1789997638.091260:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997638.091327:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789997638.091334:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713003136:0@lo:400:kworker.0 00000100:00100000:2.0:1789997638.091358:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997638.091379:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713003648:0@lo:400:kworker.0 00000100:00100000:2.0:1789997638.091400:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997638.091430:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713003264 00000100:00100000:2.0:1789997638.091437:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713003264 00000100:00100000:2.0:1789997638.091571:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713003136 00000100:00100000:2.0:1789997638.091575:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713003136 00000100:00100000:2.0:1789997638.091593:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713003648 00000100:00100000:2.0:1789997638.091596:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713003648 00000100:00100000:2.0:1789997638.091619:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1789997638.091628:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713003264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997638.091712:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713003264:12345-0@lo:400:kworker.0 Request processed in 85us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997638.091719:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1789997638.091736:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1789997638.091742:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713003136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997638.091769:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713003136:12345-0@lo:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997638.091775:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1789997638.091785:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1789997638.091791:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713003648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.092532:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713003392:0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.092577:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997638.092614:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789997638.092621:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713003008:0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.092648:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997638.092690:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713003520:0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.092711:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997638.092747:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713003392 00000100:00100000:1.0:1789997638.092753:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713003392 00000100:00100000:1.0:1789997638.092786:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713003520 00000100:00100000:1.0:1789997638.092789:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713003520 00000100:00100000:1.0:1789997638.092950:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1789997638.092958:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713003392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.092995:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713003392:12345-0@lo:400:kworker.0 Request processed in 39us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997638.093001:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1789997638.093013:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:1.0:1789997638.093018:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713003520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.093040:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713003520:12345-0@lo:400:kworker.0 Request processed in 22us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997638.093045:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:1.0:1789997638.093061:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713003008 00000100:00100000:1.0:1789997638.093064:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713003008 00000100:00100000:1.0:1789997638.093083:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1789997638.093088:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713003008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.093112:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713003008:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997638.093117:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1789997638.093178:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713003008:0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.093193:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713003520:0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.093201:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713003392:0@lo:400:kworker.0 00000100:00080000:1.0:1789997638.093246:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997638.093261:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997638.093264:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997638.093331:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713003136:0@lo:400:kworker.0 00000100:00100000:1.0:1789997638.093344:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713003264:0@lo:400:kworker.0 00000100:00100000:2.0:1789997638.093644:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713003648:12345-0@lo:400:kworker.0 Request processed in 1852us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997638.093670:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1789997638.093930:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713003648:0@lo:400:kworker.0 00010000:00010000:1.0:1789997638.410966:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997639.437117:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997639.963426:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997639.963863:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704523520 00000100:00100000:0.0:1789997639.963875:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704523520 00000100:00100000:0.0:1789997639.963966:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1096 00000100:00100000:0.0:1789997639.963978:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704523520:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997639.964094:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704523520:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 117us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997639.964103:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1096 00000100:00100000:3.0:1789997639.965585:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997639.965761:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997639.967338:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704523776 00000100:00100000:0.0:1789997639.967352:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704523776 00000100:00100000:0.0:1789997639.967419:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 874 00000100:00100000:0.0:1789997639.967430:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704523776:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997639.967890:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704523648 00000100:00100000:2.0:1789997639.967896:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704523648 00000100:00100000:2.0:1789997639.967944:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1333 00000100:00100000:2.0:1789997639.967952:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704523648:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997639.968453:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704523776:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1021us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997639.968463:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 874 00000100:00080000:0.0:1789997639.968510:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997639.968515:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997639.968576:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704523648:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 623us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997639.968584:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1333 00000100:00100000:3.0:1789997639.970400:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997639.970480:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704523904 00000100:00100000:1.0:1789997639.970489:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704523904 00000100:00100000:1.0:1789997639.970560:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 875 00000100:00100000:1.0:1789997639.970571:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704523904:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1789997639.970683:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997639.970902:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704523904:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 332us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997639.970910:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 875 00000100:00100000:3.0:1789997640.138969:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997640.138990:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713003776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997640.139204:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997640.139394:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713003776 00000100:00100000:2.0:1789997640.139403:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713003776 00000100:00080000:3.0:1789997640.139451:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997640.139696:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1789997640.139708:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713003776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997640.139741:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997640.139810:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713003776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997640.139818:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1789997640.140363:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713003776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997640.141864:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713003904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997640.141928:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997640.142041:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713003904 00000100:00100000:0.0:1789997640.142050:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713003904 00000100:00100000:0.0:1789997640.142112:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1789997640.142124:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713003904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997640.142156:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997640.142289:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713003904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997640.142296:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1789997640.142348:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713003904:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997640.143368:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997640.459713:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997641.442560:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997641.445867:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704524032 00000100:00100000:1.0:1789997641.445881:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704524032 00000100:00100000:1.0:1789997641.445982:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 954 00000100:00100000:1.0:1789997641.446001:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51490:x1876946704524032:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997641.446122:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51490:x1876946704524032:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 126us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997641.446131:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 954 00000100:00080000:2.0:1789997641.447608:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997641.450415:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997641.450522:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704524160 00000100:00100000:1.0:1789997641.450533:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704524160 00000100:00100000:1.0:1789997641.450693:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 511 00000100:00100000:1.0:1789997641.450705:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51490:x1876946704524160:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997641.451159:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51490:x1876946704524160:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 455us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997641.451168:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 511 00000100:00080000:2.0:1789997641.452677:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997641.455377:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997641.455486:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704524288 00000100:00100000:1.0:1789997641.455498:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704524288 00000100:00100000:1.0:1789997641.455632:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 512 00000100:00100000:1.0:1789997641.455643:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51490:x1876946704524288:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:2.0:1789997641.455918:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997641.456333:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51490:x1876946704524288:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 690us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997641.456342:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 512 00000100:00100000:3.0:1789997641.459116:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997641.459224:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704524416 00000100:00100000:2.0:1789997641.459235:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704524416 00000100:00100000:2.0:1789997641.459301:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 955 00000100:00100000:2.0:1789997641.459312:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51490:x1876946704524416:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997641.460012:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51490:x1876946704524416:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 699us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997641.460021:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 955 00000100:00100000:0.0:1789997641.463997:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997641.464116:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704524544 00000100:00100000:1.0:1789997641.464127:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704524544 00000100:00100000:1.0:1789997641.464240:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 956 00000100:00100000:1.0:1789997641.464252:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51490:x1876946704524544:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997641.464366:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51490:x1876946704524544:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 116us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997641.464381:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 956 00000100:00100000:3.0:1789997641.466114:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997641.466355:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704524672 00000100:00100000:1.0:1789997641.466364:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704524672 00000100:00100000:1.0:1789997641.466482:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 513 00000100:00100000:1.0:1789997641.466493:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51490:x1876946704524672:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997641.466892:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51490:x1876946704524672:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 401us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997641.466900:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 513 00000100:00100000:3.0:1789997641.468143:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997641.468347:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704524800 00000100:00100000:1.0:1789997641.468355:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704524800 00000100:00100000:1.0:1789997641.468406:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 514 00000100:00100000:1.0:1789997641.468426:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51490:x1876946704524800:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997641.469039:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:51490:x1876946704524800:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 624us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997641.469048:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 514 00000100:00100000:0.0:1789997641.471905:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997641.472074:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704524928 00000100:00100000:1.0:1789997641.472084:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704524928 00000100:00100000:1.0:1789997641.472139:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 957 00000100:00100000:1.0:1789997641.472159:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51490:x1876946704524928:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997641.473297:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51490:x1876946704524928:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 1144us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997641.473307:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 957 00010000:00010000:1.0:1789997641.488553:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997641.499720:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997641.499899:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704525056 00000100:00100000:2.0:1789997641.499910:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704525056 00000100:00100000:2.0:1789997641.499968:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 958 00000100:00100000:2.0:1789997641.499978:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:51491:x1876946704525056:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997641.499997:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997641.500057:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d48f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeee8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.500132:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.500150:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.500162:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997641.500207:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00000004:00200000:2.0:1789997641.500212:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997641.500236:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.500262:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d48f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee8 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.500285:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee8 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.500293:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:2.0:1789997641.500296:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997641.500299:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997641.500353:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51491:x1876946704525056:12345-192.168.204.4@tcp:101:rm.0 Request processed in 376us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997641.500360:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 958 00000100:00100000:3.0:1789997641.504787:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997641.504950:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704525312 00000100:00100000:2.0:1789997641.504959:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704525312 00000100:00100000:2.0:1789997641.505012:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 959 00000100:00100000:2.0:1789997641.505023:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:51491:x1876946704525312:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997641.505043:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997641.505064:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d49d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeeef expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997641.505145:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00010000:2.0:1789997641.505389:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d49d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeef expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.505403:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:2.0:1789997641.505406:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789997641.505412:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d49d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeeef expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.505430:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2200, rc 0) 00000100:00100000:2.0:1789997641.505853:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:51491:x1876946704525312:12345-192.168.204.4@tcp:101:rm.0 Request processed in 831us (1071us total) trans 4294967664 rc 301/301 00000100:00100000:2.0:1789997641.505861:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 959 00000100:00100000:1.0:1789997641.509022:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997641.509131:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704525440 00000100:00100000:3.0:1789997641.509140:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704525440 00000100:00100000:3.0:1789997641.509233:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:3.0:1789997641.509244:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:51491:x1876946704525440:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:3.0:1789997641.513298:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:51491:x1876946704525440:12345-192.168.204.4@tcp:37:rm.0 Request processed in 4046us (4274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997641.513312:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 98 00000100:00100000:0.0:1789997641.519068:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997641.519238:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704525696 00000100:00100000:2.0:1789997641.519249:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704525696 00000100:00100000:2.0:1789997641.519349:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:2.0:1789997641.519360:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de230450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:51491:x1876946704525696:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:2.0:1789997641.519606:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de230450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:51491:x1876946704525696:12345-192.168.204.4@tcp:35:rm.0 Request processed in 247us (547us total) trans 4294967665 rc 0/0 00000100:00100000:2.0:1789997641.519614:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 99 00000100:00100000:1.0:1789997641.522546:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997641.522670:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704525952 00000100:00100000:3.0:1789997641.522679:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704525952 00000100:00100000:3.0:1789997641.522777:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 960 00000100:00100000:3.0:1789997641.522788:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:51491:x1876946704525952:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997641.522854:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789997641.522881:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeee8 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.522904:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeed3 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.522915:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:3.0:1789997641.522931:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d155 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaee1d expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.522940:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997641.522946:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997641.522968:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.522981:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.523002:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.523050:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.523058:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.523065:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.523365:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.523375:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.523382:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997641.524368:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 16384 00010000:00010000:3.0:1789997641.524387:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524395:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524403:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524560:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997641.524566:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524575:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524588:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997641.524590:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997641.524595:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524602:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d4b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524625:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524631:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524637:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524646:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997641.524649:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524685:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524694:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997641.524696:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997641.524700:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997641.524706:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d4ab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997641.524718:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004290957f reply state 00000000a9279956 transno 4294967666 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997641.524727:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997641.524827:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:51491:x1876946704525952:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2038us (2286us total) trans 4294967666 rc 0/0 00000100:00100000:3.0:1789997641.524836:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 960 00010000:00010000:2.0:1789997641.529167:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.529197:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.529206:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.529214:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997641.529218:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.529226:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.529248:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff8a38ee49ea00) 00010000:00010000:2.0:1789997641.529251:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997641.529256:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997641.529262:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d4b2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997642.507578:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997642.537080:0:86792:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd8dde720 20000000:00000080:0.0:1789997642.537096:0:86792:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9b17c00 uarg=0000000000000000 00010000:00010000:0.0:1789997642.539944:0:86792:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997642.539966:0:86792:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997642.540010:0:86792:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997642.540030:0:86792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997642.540049:0:86792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d140 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997642.540058:0:86792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997642.540096:0:86792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d140 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997642.540112:0:86792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d140 expref: 18 pid: 5804 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997642.540126:0:86792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86792:1876946713004032:0@lo:104: 00000100:00100000:0.0:1789997642.540205:0:86792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997642.540306:0:86792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789997642.540353:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713004032 00000100:00100000:3.0:1789997642.540360:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713004032 00000100:00100000:3.0:1789997642.540439:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789997642.540449:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:86792:x1876946713004032:12345-0@lo:104: 00010000:00010000:3.0:1789997642.540461:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997642.540586:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997642.540594:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:86792:x1876946713004032:12345-0@lo:104: Request processed in 146us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997642.540602:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789997642.540723:0:86792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86792:1876946713004032:0@lo:104: 00010000:00010000:0.0:1789997642.540740:0:86792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.540846:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997642.540855:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.540863:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997642.540867:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.540876:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997642.540883:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997642.540889:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997642.540960:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.540967:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997642.540998:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541010:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d140 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d147 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541032:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997642.541034:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997642.541036:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997642.541043:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997642.541053:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713004160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997642.541085:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997642.541115:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713004160 00000100:00100000:2.0:1789997642.541120:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713004160 00010000:00010000:2.0:1789997642.541140:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d140 expref: 19 pid: 5804 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997642.541172:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789997642.541180:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713004160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997642.541191:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997642.541196:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d140 expref: 19 pid: 5804 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541205:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d140 expref: 19 pid: 5804 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541218:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d147 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d140 expref: 19 pid: 5804 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541229:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541242:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541255:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541263:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541269:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541276:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541281:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997642.541285:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541292:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541306:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997642.541314:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997642.541342:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713004160:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997642.541348:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789997642.541416:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713004160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997642.541502:0:86792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997642.541510:0:86792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997642.541516:0:86792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d4c0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789997643.201553:0:86840:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd21bc7800 20000000:00000080:0.0:1789997643.201572:0:86840:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd793400 uarg=0000000000000000 00010000:00010000:0.0:1789997643.201941:0:86840:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997643.201956:0:86840:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997643.201975:0:86840:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997643.201996:0:86840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202011:0:86840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202022:0:86840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202029:0:86840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202036:0:86840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202043:0:86840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202049:0:86840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997643.202053:0:86840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202061:0:86840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202078:0:86840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202085:0:86840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.202091:0:86840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d4c7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997643.213647:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713004288:0@lo:400:kworker.0 00000100:00100000:2.0:1789997643.213727:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997643.213743:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713004416:0@lo:400:kworker.0 00000100:00100000:2.0:1789997643.213778:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713004800:0@lo:400:kworker.0 00000100:00100000:3.0:1789997643.213786:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997643.213805:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997643.213841:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713004544:0@lo:400:kworker.0 00000100:00100000:3.0:1789997643.213861:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713004288 00000100:00100000:2.0:1789997643.213867:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997643.213871:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713004288 00000100:00100000:2.0:1789997643.213890:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997643.213898:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713004672:0@lo:400:kworker.0 00000100:00100000:2.0:1789997643.213919:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997643.213929:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713004416 00000100:00100000:3.0:1789997643.213934:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713004416 00000100:00100000:2.0:1789997643.213947:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713004800 00000100:00100000:2.0:1789997643.213952:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713004800 00000100:00100000:3.0:1789997643.213977:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1789997643.213990:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1789997643.213991:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713004288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997643.214001:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713004416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997643.214051:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713004416:12345-0@lo:400:kworker.0 Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997643.214060:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1789997643.214061:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713004288:12345-0@lo:400:kworker.0 Request processed in 73us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997643.214070:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1789997643.214080:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1789997643.214088:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713004800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997643.214114:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713004800:12345-0@lo:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997643.214120:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:2.0:1789997643.214491:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713004544 00000100:00100000:2.0:1789997643.214496:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713004544 00000100:00100000:2.0:1789997643.214529:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713004672 00000100:00100000:2.0:1789997643.214532:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713004672 00000100:00100000:2.0:1789997643.214551:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:2.0:1789997643.214558:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713004544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997643.214595:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713004544:12345-0@lo:400:kworker.0 Request processed in 38us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997643.214601:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:2.0:1789997643.214613:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:2.0:1789997643.214619:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713004672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997643.214647:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713004672:12345-0@lo:400:kworker.0 Request processed in 28us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997643.214669:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00080000:2.0:1789997643.214691:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997643.214695:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997643.214698:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997643.214728:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713004416:0@lo:400:kworker.0 00000100:00100000:3.0:1789997643.215453:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713004288:0@lo:400:kworker.0 00000100:00100000:3.0:1789997643.215471:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713004800:0@lo:400:kworker.0 00000100:00100000:3.0:1789997643.215512:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713004672:0@lo:400:kworker.0 00000100:00100000:3.0:1789997643.215525:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713004544:0@lo:400:kworker.0 00010000:00010000:1.0:1789997643.531243:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997643.914870:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997643.914879:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997643.914886:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997643.914948:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.914962:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.914976:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997643.915008:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713004928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997643.915239:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997643.915311:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997643.915424:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713004928 00000100:00100000:1.0:1789997643.915437:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713004928 00000100:00100000:1.0:1789997643.915520:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1789997643.915544:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713004928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997643.915563:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997643.915583:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d4ce expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997643.915614:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d4ce expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997643.915626:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d4ce expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997643.915637:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997643.915725:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713004928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997643.915734:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1789997643.915765:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713004928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997643.915788:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.915798:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997643.915829:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997643.915835:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.915844:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789997643.969997:0:86888:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf9d85ef0 20000000:00000080:2.0:1789997643.970023:0:86888:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fa5ad400 uarg=0000000000000000 00010000:00010000:2.0:1789997643.970341:0:86888:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997643.970359:0:86888:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997643.970381:0:86888:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997643.970404:0:86888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997643.970425:0:86888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d4ce expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997643.970434:0:86888:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997643.970487:0:86888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d4ce expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997643.970507:0:86888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d4ce expref: 18 pid: 5803 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997643.970525:0:86888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86888:1876946713005056:0@lo:104: 00000100:00100000:2.0:1789997643.972903:0:86888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997643.973250:0:86888:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789997643.973326:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713005056 00000100:00100000:0.0:1789997643.973338:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713005056 00000100:00100000:0.0:1789997643.973430:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789997643.973441:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:86888:x1876946713005056:12345-0@lo:104: 00010000:00010000:0.0:1789997643.973461:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997643.973568:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997643.973574:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:86888:x1876946713005056:12345-0@lo:104: Request processed in 136us (2923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997643.973582:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789997643.973687:0:86888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86888:1876946713005056:0@lo:104: 00010000:00010000:2.0:1789997643.973727:0:86888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.973858:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997643.973868:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.973877:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997643.973882:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.973891:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997643.973898:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997643.973905:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997643.973946:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.973952:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997643.973977:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.973983:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592d4ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4d5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974014:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997643.974015:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997643.974017:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997643.974033:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713005184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997643.974078:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997643.974131:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713005184 00000100:00100000:3.0:1789997643.974146:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713005184 00010000:00010000:3.0:1789997643.974173:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d4ce expref: 19 pid: 5803 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997643.974197:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789997643.974206:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713005184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997643.974218:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997643.974224:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d4ce expref: 19 pid: 5803 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974236:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d4ce expref: 19 pid: 5803 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974252:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d4d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d4ce expref: 19 pid: 5803 timeout: 1982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974266:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974274:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974291:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974300:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974307:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974314:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974319:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997643.974323:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974332:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974343:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997643.974352:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997643.974384:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713005184:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997643.974390:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789997643.974421:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713005184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997643.974525:0:86888:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997643.974534:0:86888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997643.974541:0:86888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592d4dc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997644.556793:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997645.081109:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997645.081155:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997645.081188:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997645.081208:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704526464 00000100:00100000:2.0:1789997645.081220:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704526464 00000100:00100000:1.0:1789997645.081224:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997645.081254:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704526080 00000100:00100000:1.0:1789997645.081259:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704526080 00000100:00100000:2.0:1789997645.081280:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704526336 00000100:00100000:2.0:1789997645.081284:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704526336 00000100:00100000:1.0:1789997645.081298:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1098 00000100:00100000:2.0:1789997645.081315:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 878 00000100:00100000:1.0:1789997645.081316:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704526080:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997645.081328:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704526464:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997645.081392:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704526464:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997645.081403:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 878 00000100:00100000:0.0:1789997645.081418:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704526208 00000100:00100000:0.0:1789997645.081424:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704526208 00000100:00100000:2.0:1789997645.081426:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 879 00000100:00100000:2.0:1789997645.081435:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704526336:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997645.081494:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1337 00000100:00100000:0.0:1789997645.081503:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704526208:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1789997645.082712:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997645.082719:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997645.082722:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997645.083109:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704526080:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1794us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997645.083132:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1098 00000100:00100000:2.0:1789997645.083250:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704526336:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1814us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997645.083261:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 879 00000100:00100000:0.0:1789997645.085290:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704526208:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3777us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997645.085320:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1337 00000100:00100000:0.0:1789997645.259688:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997645.259713:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713005312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997645.259792:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997645.259866:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713005312 00000100:00100000:0.0:1789997645.259874:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713005312 00000100:00100000:0.0:1789997645.259946:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1789997645.259955:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713005312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997645.259992:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997645.260041:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713005312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997645.260049:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00080000:0.0:1789997645.260069:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997645.260123:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713005312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997645.261102:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997645.261268:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713005440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997645.261487:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997645.261624:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713005440 00000100:00100000:2.0:1789997645.261632:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713005440 00000100:00100000:2.0:1789997645.261749:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:2.0:1789997645.261758:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713005440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997645.261787:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997645.261889:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713005440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997645.261896:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00080000:0.0:1789997645.262040:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997645.262094:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713005440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997645.582871:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997645.706774:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997645.706782:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997645.706787:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997645.706838:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997645.706850:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997645.706862:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997645.706888:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713005568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997645.706970:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997645.707044:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c33956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997645.707139:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713005568 00000100:00100000:1.0:1789997645.707147:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713005568 00000100:00100000:1.0:1789997645.707196:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1789997645.707205:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713005568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997645.707229:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997645.707244:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d4e3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997645.707267:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997645.707278:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997645.707286:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997645.707329:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713005568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997645.707336:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1789997645.707472:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713005568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997645.707487:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997645.707496:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997645.707517:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997645.707522:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997645.707529:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997645.821676:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967665 is committed 00000001:00080000:0.0:1789997645.821786:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967666 is committed 00010000:00010000:0.0:1789997646.604759:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997646.664246:0:87085:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff68c8b3e0 20000000:00000080:1.0:1789997646.664263:0:87085:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c12a9c00 uarg=0000000000000000 00010000:00010000:1.0:1789997646.664778:0:87085:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997646.664795:0:87085:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997646.664814:0:87085:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997646.664834:0:87085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997646.664855:0:87085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997646.664863:0:87085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997646.664905:0:87085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997646.664920:0:87085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 18 pid: 5803 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997646.664934:0:87085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87085:1876946713005696:0@lo:104: 00000100:00100000:1.0:1789997646.664997:0:87085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997646.665043:0:87085:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae100c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997646.665132:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789997646.665145:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713005696 00000100:00100000:0.0:1789997646.665152:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713005696 00000100:00100000:0.0:1789997646.665189:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789997646.665197:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:87085:x1876946713005696:12345-0@lo:104: 00010000:00010000:0.0:1789997646.665209:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997646.665264:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997646.665270:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:87085:x1876946713005696:12345-0@lo:104: Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997646.665276:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789997646.665363:0:87085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87085:1876946713005696:0@lo:104: 00010000:00010000:1.0:1789997646.665378:0:87085:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665446:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997646.665454:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665462:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997646.665466:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665474:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997646.665486:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997646.665492:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997646.665525:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665531:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997646.665556:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665564:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592d4e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665579:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997646.665581:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997646.665583:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997646.665590:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997646.665599:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713005824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997646.665628:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997646.665681:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713005824 00000100:00100000:3.0:1789997646.665685:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713005824 00010000:00010000:3.0:1789997646.665703:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 19 pid: 5803 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997646.665722:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789997646.665727:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713005824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997646.665737:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997646.665742:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 19 pid: 5803 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665752:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 19 pid: 5803 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665764:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d4ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d4e3 expref: 19 pid: 5803 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665776:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665784:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665796:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665803:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665811:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665817:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665822:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997646.665826:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665834:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665844:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997646.665852:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997646.665875:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713005824:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997646.665881:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789997646.665902:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713005824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997646.666012:0:87085:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997646.666020:0:87085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997646.666027:0:87085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d4f1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997647.628181:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997647.819851:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997647.819858:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997647.819862:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997647.819906:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997647.819984:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997647.819996:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997647.820022:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713005952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997647.820247:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997647.820297:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c33956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997647.820367:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713005952 00000100:00100000:1.0:1789997647.820375:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713005952 00000100:00100000:1.0:1789997647.820765:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1789997647.820776:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713005952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997647.820791:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997647.820808:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d4f8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997647.820830:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997647.820842:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997647.820851:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997647.820899:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713005952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997647.820905:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1789997647.821256:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713005952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997647.821280:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997647.821622:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997647.821646:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997647.822105:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997647.822115:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997648.332399:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713006080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.332474:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997648.332521:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713006592:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.332547:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997648.332573:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997648.332579:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713006464:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.332603:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997648.332632:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713006208:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.332679:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997648.332696:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713006720:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.332716:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997648.332731:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997648.332736:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713006336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.332756:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997648.332787:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713006080 00000100:00100000:1.0:1789997648.332795:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713006080 00000100:00100000:1.0:1789997648.332837:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1789997648.332845:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713006080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.332893:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713006080:12345-0@lo:400:kworker.0 Request processed in 48us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997648.332900:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1789997648.332931:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713006592 00000100:00100000:1.0:1789997648.332935:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713006592 00000100:00100000:1.0:1789997648.332967:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713006464 00000100:00100000:1.0:1789997648.332970:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713006464 00000100:00100000:1.0:1789997648.332988:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1789997648.332995:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713006592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333027:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713006592:12345-0@lo:400:kworker.0 Request processed in 32us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997648.333033:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:1.0:1789997648.333045:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1789997648.333064:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713006464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333093:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713006464:12345-0@lo:400:kworker.0 Request processed in 43us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997648.333098:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:1.0:1789997648.333120:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713006208 00000100:00100000:1.0:1789997648.333124:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713006208 00000100:00100000:1.0:1789997648.333147:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713006720 00000100:00100000:1.0:1789997648.333150:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713006720 00000100:00100000:1.0:1789997648.333174:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713006336 00000100:00100000:1.0:1789997648.333177:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713006336 00000100:00100000:1.0:1789997648.333195:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1789997648.333201:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713006208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333237:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713006208:12345-0@lo:400:kworker.0 Request processed in 36us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997648.333243:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1789997648.333255:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1789997648.333261:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713006720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333287:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713006720:12345-0@lo:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997648.333293:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1789997648.333303:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1789997648.333308:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713006336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333331:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713006336:12345-0@lo:400:kworker.0 Request processed in 23us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997648.333336:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00080000:1.0:1789997648.333354:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997648.333359:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997648.333361:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997648.333394:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713006336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333405:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713006208:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333414:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713006720:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333448:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713006464:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333456:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713006080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997648.333465:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713006592:0@lo:400:kworker.0 00010000:00010000:0.0:1789997648.651205:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997649.674755:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997650.200119:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997650.200171:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997650.200213:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997650.200238:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704526976 00000100:00100000:3.0:1789997650.200241:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997650.200249:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704526976 00000100:00100000:3.0:1789997650.200283:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704526592 00000100:00100000:3.0:1789997650.200287:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704526592 00000100:00100000:2.0:1789997650.200304:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704526848 00000100:00100000:2.0:1789997650.200306:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704526848 00000100:00100000:3.0:1789997650.200312:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1102 00000100:00100000:3.0:1789997650.200321:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704526592:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997650.200339:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 882 00000100:00100000:2.0:1789997650.200347:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704526976:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997650.200408:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704526592:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997650.200411:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704526720 00000100:00100000:3.0:1789997650.200415:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1102 00000100:00100000:1.0:1789997650.200415:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704526720 00000100:00100000:1.0:1789997650.200444:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1341 00000100:00100000:3.0:1789997650.200448:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 883 00000100:00100000:1.0:1789997650.200451:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704526720:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997650.200462:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704526848:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997650.200807:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704526976:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 459us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997650.200826:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 882 00000100:00080000:2.0:1789997650.200847:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997650.200852:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997650.200854:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997650.201450:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704526720:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 996us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997650.201459:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1341 00000100:00100000:3.0:1789997650.201475:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704526848:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1013us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997650.201483:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 883 00000100:00100000:1.0:1789997650.378862:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997650.378885:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713006848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997650.378954:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997650.380188:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713006848 00000100:00100000:0.0:1789997650.380199:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713006848 00000100:00100000:0.0:1789997650.380274:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1789997650.380285:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713006848:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997650.380314:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1789997650.380321:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997650.380392:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713006848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997650.380398:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1789997650.381108:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997650.381125:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713006976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997650.381165:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997650.381281:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713006976 00000100:00100000:3.0:1789997650.381287:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713006976 00000100:00100000:3.0:1789997650.381339:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1789997650.381347:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713006976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997650.381372:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997650.381410:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713006976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997650.381416:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1789997650.381527:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713006976:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997650.381548:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997650.381909:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713006848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997650.700501:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997651.724574:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997652.747789:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789997652.935721:0:87429:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 21: test nodemap mapped_trusted_noadmin fileops ========================================================== 09:34:11 (1789997651) 00000100:00100000:2.0:1789997653.453390:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713007104:0@lo:400:kworker.0 00000100:00100000:2.0:1789997653.453471:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997653.453568:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713007104 00000100:00100000:3.0:1789997653.453577:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713007104 00000100:00100000:3.0:1789997653.453621:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1789997653.453642:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713007104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997653.456157:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713007104:12345-0@lo:400:kworker.0 Request processed in 2509us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997653.456172:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1789997653.459535:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713007232:0@lo:400:kworker.0 00000100:00100000:1.0:1789997653.459608:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997653.459673:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997653.459682:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713007360:0@lo:400:kworker.0 00000100:00100000:1.0:1789997653.459707:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997653.459739:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713007488:0@lo:400:kworker.0 00000100:00100000:1.0:1789997653.459765:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997653.459883:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713007104:0@lo:400:kworker.0 00000100:00100000:2.0:1789997653.459916:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713007232 00000100:00100000:2.0:1789997653.459921:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713007232 00000100:00100000:2.0:1789997653.459981:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1789997653.459991:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713007232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997653.460043:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713007232:12345-0@lo:400:kworker.0 Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997653.460050:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1789997653.460068:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713007360 00000100:00100000:2.0:1789997653.460071:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713007360 00000100:00100000:2.0:1789997653.460102:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1789997653.460108:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713007360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997653.460135:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713007360:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997653.460141:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1789997653.460162:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713007488 00000100:00100000:2.0:1789997653.460165:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713007488 00000100:00100000:2.0:1789997653.460189:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:2.0:1789997653.460195:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713007488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997653.460226:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713007488:12345-0@lo:400:kworker.0 Request processed in 31us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997653.460232:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:2.0:1789997653.460246:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997653.460251:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997653.460317:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713007488:0@lo:400:kworker.0 00000100:00100000:1.0:1789997653.460345:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713007360:0@lo:400:kworker.0 00000100:00100000:1.0:1789997653.460355:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713007232:0@lo:400:kworker.0 00000100:00100000:1.0:1789997653.460469:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997653.460513:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997653.460523:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713007744:0@lo:400:kworker.0 00000100:00100000:0.0:1789997653.460552:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997653.460579:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713007744 00000100:00100000:0.0:1789997653.460582:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713007744 00000100:00100000:0.0:1789997653.460612:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1789997653.460618:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713007744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997653.460650:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713007744:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997653.460684:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1789997653.460709:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713007744:0@lo:400:kworker.0 00000100:00080000:2.0:1789997653.460825:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997653.462320:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713007616:0@lo:400:kworker.0 00000100:00100000:1.0:1789997653.462376:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997653.467132:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713007616 00000100:00100000:3.0:1789997653.467147:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713007616 00000100:00100000:3.0:1789997653.467221:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1789997653.467232:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713007616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997653.467329:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713007616:12345-0@lo:400:kworker.0 Request processed in 99us (4952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997653.467336:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1789997653.467390:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713007616:0@lo:400:kworker.0 00000100:00080000:1.0:1789997653.467459:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000400:1.0:1789997653.717881:0:87477:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1789997653.726578:0:87477:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:1.0:1789997653.771162:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997654.348280:0:87525:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc207e520 20000000:00000080:3.0:1789997654.348299:0:87525:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c3e6ac00 uarg=0000000000000000 10000000:01000000:3.0:1789997654.348888:0:87525:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997654.348910:0:87525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997654.348929:0:87525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997654.348954:0:87525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997654.348994:0:87525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997654.349008:0:87525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 18 pid: 5805 timeout: 1993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997654.349025:0:87525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87525:1876946713007872:0@lo:104: 00000100:00100000:3.0:1789997654.349088:0:87525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997654.349153:0:87525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e0d99600 going to sleep for 11 seconds 00000100:00100000:0.0:1789997654.349226:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713007872 00000100:00100000:0.0:1789997654.349235:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713007872 00000100:00100000:0.0:1789997654.349292:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789997654.349303:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:87525:x1876946713007872:12345-0@lo:104: 00010000:00010000:0.0:1789997654.349316:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349381:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997654.349389:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:87525:x1876946713007872:12345-0@lo:104: Request processed in 87us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997654.349396:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789997654.349414:0:87525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87525:1876946713007872:0@lo:104: 00010000:00010000:0.0:1789997654.349420:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997654.349428:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997654.349435:0:87525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349436:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997654.349443:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349453:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997654.349461:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997654.349467:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997654.349496:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349504:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997654.349523:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349531:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2a00/0x65b43101d592d4f8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d4ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349546:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997654.349548:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997654.349550:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997654.349568:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713008000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997654.349598:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997654.349635:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713008000 00000100:00100000:0.0:1789997654.349640:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713008000 00010000:00010000:0.0:1789997654.349691:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 19 pid: 5805 timeout: 1993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997654.349718:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789997654.349725:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713008000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997654.349734:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997654.349740:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 19 pid: 5805 timeout: 1993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349751:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 19 pid: 5805 timeout: 1993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349763:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d4ff lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d4f8 expref: 19 pid: 5805 timeout: 1993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349776:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349789:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349802:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349809:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349816:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349822:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349827:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997654.349831:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349839:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349849:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.349857:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997654.349888:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713008000:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997654.349894:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789997654.349920:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713008000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997654.349950:0:87525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997654.349960:0:87525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997654.349966:0:87525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d506 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997654.795396:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997654.863638:0:87573:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe636ddd00 20000000:00000080:0.0:1789997654.863717:0:87573:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd790800 uarg=0000000000000000 10000000:01000000:0.0:1789997654.864003:0:87573:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997654.864037:0:87573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864064:0:87573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864076:0:87573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864083:0:87573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864090:0:87573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864097:0:87573:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864102:0:87573:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997654.864107:0:87573:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864115:0:87573:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864128:0:87573:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864137:0:87573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997654.864144:0:87573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d50d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997655.319952:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997655.319997:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997655.320030:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997655.320058:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997655.320092:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704527488 00000100:00100000:3.0:1789997655.320104:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704527488 00000100:00080000:1.0:1789997655.320135:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997655.320165:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704527360 00000100:00100000:3.0:1789997655.320170:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704527360 00000100:00100000:1.0:1789997655.320191:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 886 00000100:00100000:1.0:1789997655.320205:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704527488:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997655.320323:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704527232 00000100:00100000:0.0:1789997655.320328:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704527232 00000100:00100000:0.0:1789997655.320369:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1345 00000100:00100000:1.0:1789997655.320399:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704527488:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 197us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997655.320405:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 886 00000100:00100000:0.0:1789997655.320829:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704527232:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997655.320880:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704527232:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 59us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997655.320887:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1345 00000100:00100000:3.0:1789997655.321833:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 887 00000100:00100000:3.0:1789997655.321847:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704527360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997655.321903:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704527360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 60us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997655.321925:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 887 00000100:00100000:3.0:1789997655.322321:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704527104 00000100:00100000:3.0:1789997655.322328:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704527104 00000100:00100000:3.0:1789997655.322404:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1104 00000100:00100000:3.0:1789997655.322413:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704527104:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997655.322650:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704527104:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 236us (2618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997655.322681:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1104 00000100:00080000:3.0:1789997655.323561:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997655.323882:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789997655.387993:0:87622:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc6033470 20000000:00000080:2.0:1789997655.388009:0:87622:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faae0000 uarg=0000000000000000 10000000:01000000:2.0:1789997655.388198:0:87622:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997655.388219:0:87622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388234:0:87622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388243:0:87622:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388270:0:87622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388277:0:87622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388284:0:87622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388291:0:87622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997655.388295:0:87622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388303:0:87622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388317:0:87622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388325:0:87622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997655.388331:0:87622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2e00/0x65b43101d592d514 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997655.499147:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713008128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997655.499335:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997655.499406:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997655.499414:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713008256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997655.499440:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997655.499615:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713008128 00000100:00100000:1.0:1789997655.499624:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713008128 00000100:00100000:0.0:1789997655.499718:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713008256 00000100:00100000:0.0:1789997655.499723:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713008256 00000100:00100000:1.0:1789997655.499850:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1789997655.499861:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713008128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997655.499900:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997655.499960:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713008128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997655.499968:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00080000:1.0:1789997655.499993:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997655.500029:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713008128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997655.500239:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1789997655.500247:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713008256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997655.500274:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997655.500312:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713008256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997655.500319:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00080000:1.0:1789997655.500614:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997655.500643:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713008256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997655.818857:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997655.956334:0:87670:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe68efafb0 20000000:00000080:0.0:1789997655.956352:0:87670:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb169000 uarg=0000000000000000 10000000:01000000:0.0:1789997655.956545:0:87670:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997655.956566:0:87670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956581:0:87670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956592:0:87670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956599:0:87670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956605:0:87670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956612:0:87670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956618:0:87670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997655.956622:0:87670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956629:0:87670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956642:0:87670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956650:0:87670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997655.956793:0:87670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d51b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997656.202756:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997656.202765:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997656.202771:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997656.202817:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.202830:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.202842:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997656.202869:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713008384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997656.202949:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997656.202999:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713008384 00000100:00100000:0.0:1789997656.203005:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789997656.203009:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713008384 00000100:00100000:1.0:1789997656.203064:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:1.0:1789997656.203074:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713008384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997656.203087:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997656.203101:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d522 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997656.203125:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d522 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997656.203135:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d522 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997656.203144:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997656.203189:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713008384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997656.203197:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1789997656.203696:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713008384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997656.203714:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.203724:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997656.203746:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997656.203751:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.203764:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789997656.490351:0:87720:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd210121f0 20000000:00000080:3.0:1789997656.490368:0:87720:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c5c0f000 uarg=0000000000000000 10000000:01000000:3.0:1789997656.490815:0:87720:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997656.490837:0:87720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997656.490855:0:87720:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d522 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997656.490863:0:87720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997656.490916:0:87720:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d522 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997656.490932:0:87720:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d522 expref: 18 pid: 7594 timeout: 1995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997656.490946:0:87720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6067100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87720:1876946713008512:0@lo:104: 00000100:00100000:3.0:1789997656.491012:0:87720:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997656.491074:0:87720:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789997656.491213:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713008512 00000100:00100000:0.0:1789997656.491221:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713008512 00000100:00100000:0.0:1789997656.491274:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1789997656.491284:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:87720:x1876946713008512:12345-0@lo:104: 00010000:00010000:0.0:1789997656.491297:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491358:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997656.491363:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:87720:x1876946713008512:12345-0@lo:104: Request processed in 82us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997656.491371:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:0.0:1789997656.491391:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997656.491397:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491404:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997656.491407:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491417:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997656.491425:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997656.491436:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997656.491464:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491471:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997656.491489:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491496:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d522 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d529 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491518:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997656.491520:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997656.491521:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997656.491538:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713008640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997656.491568:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997656.491605:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713008640 00000100:00100000:0.0:1789997656.491609:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713008640 00010000:00010000:0.0:1789997656.491626:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d522 expref: 19 pid: 7594 timeout: 1995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997656.491649:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789997656.491678:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713008640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997656.491689:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997656.491694:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d522 expref: 19 pid: 7594 timeout: 1995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491704:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d522 expref: 19 pid: 7594 timeout: 1995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491721:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491728:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491740:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491747:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491754:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491760:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491765:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997656.491769:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491776:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491785:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997656.491793:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997656.491822:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713008640:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997656.491832:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789997656.491869:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713008640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997656.492063:0:87720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592d529 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d522 expref: 18 pid: 7594 timeout: 1995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997656.492073:0:87720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6067100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87720:1876946713008512:0@lo:104: 00010000:00010000:3.0:1789997656.492087:0:87720:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997656.492095:0:87720:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997656.492101:0:87720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997656.492107:0:87720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b400/0x65b43101d592d530 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997656.844694:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997657.138381:0:87768:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc234f18b0 20000000:00000080:0.0:1789997657.138399:0:87768:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb169c00 uarg=0000000000000000 10000000:01000000:0.0:1789997657.138596:0:87768:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997657.138616:0:87768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.138631:0:87768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.138642:0:87768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.138649:0:87768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.139064:0:87768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.139072:0:87768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.139078:0:87768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997657.139082:0:87768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.139090:0:87768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.139163:0:87768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.139263:0:87768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997657.139270:0:87768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592d537 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997657.866855:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997658.058777:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997658.058788:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997658.058794:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997658.058839:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997658.058851:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997658.058874:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997658.058903:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713008768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997658.058975:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997658.059041:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60900 going to sleep for 11 seconds 00000100:00100000:1.0:1789997658.059132:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713008768 00000100:00100000:1.0:1789997658.059141:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713008768 00000100:00100000:1.0:1789997658.059198:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1789997658.059208:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713008768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997658.059221:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997658.059236:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d53e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997658.059259:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d53e expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997658.059270:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d53e expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997658.059279:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997658.059317:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713008768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997658.059324:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1789997658.059425:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713008768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997658.059440:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997658.059449:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997658.059468:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997658.059473:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997658.059480:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997658.571123:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713009152:0@lo:400:kworker.0 00000100:00100000:2.0:1789997658.571123:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713009024:0@lo:400:kworker.0 00000100:00100000:1.0:1789997658.571129:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713009280:0@lo:400:kworker.0 00000100:00100000:0.0:1789997658.571132:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713008896:0@lo:400:kworker.0 00000100:00100000:3.0:1789997658.571264:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997658.571264:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997658.571264:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997658.571304:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713009152 00000100:00100000:2.0:1789997658.571312:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713009152 00000100:00100000:3.0:1789997658.571344:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997658.571380:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713009024 00000100:00100000:3.0:1789997658.571383:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713009536:0@lo:400:kworker.0 00000100:00100000:2.0:1789997658.571385:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713009024 00000100:00100000:1.0:1789997658.571403:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713009280 00000100:00100000:1.0:1789997658.571410:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713009280 00000100:00100000:3.0:1789997658.571419:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997658.571424:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1789997658.571436:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713009152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997658.571455:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1789997658.571461:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713009536 00000100:00100000:1.0:1789997658.571466:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713009280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997658.571467:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713009536 00000100:00100000:2.0:1789997658.571497:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713009152:12345-0@lo:400:kworker.0 Request processed in 62us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997658.571505:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1789997658.571512:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6defb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713009280:12345-0@lo:400:kworker.0 Request processed in 49us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997658.571518:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:1.0:1789997658.571553:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713009280:0@lo:400:kworker.0 00000100:00100000:3.0:1789997658.571575:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1789997658.571583:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1789997658.571587:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713009024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997658.571632:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713009024:12345-0@lo:400:kworker.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997658.571680:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713009024:0@lo:400:kworker.0 00000100:00100000:1.0:1789997658.571788:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713008896 00000100:00100000:1.0:1789997658.571792:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713008896 00000100:00100000:0.0:1789997658.571815:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713009408:0@lo:400:kworker.0 00000100:00100000:1.0:1789997658.571827:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1789997658.571833:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713008896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997658.571865:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997658.571873:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713009536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997658.571889:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713008896:12345-0@lo:400:kworker.0 Request processed in 54us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997658.571896:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1789997658.571911:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1789997658.571911:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713008896:0@lo:400:kworker.0 00000100:00100000:3.0:1789997658.571960:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713009408 00000100:00100000:3.0:1789997658.571964:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713009408 00000100:00100000:3.0:1789997658.571996:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:3.0:1789997658.572003:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713009408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997658.572796:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713009536:12345-0@lo:400:kworker.0 Request processed in 926us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997658.572806:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713009408:12345-0@lo:400:kworker.0 Request processed in 801us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997658.572810:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1789997658.572821:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1789997658.572832:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713009536:0@lo:400:kworker.0 00000100:00080000:2.0:1789997658.572842:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997658.572860:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997658.572865:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997658.572876:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713009152:0@lo:400:kworker.0 00000100:00100000:0.0:1789997658.572927:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713009408:0@lo:400:kworker.0 00010000:00010000:1.0:1789997658.894206:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997658.955694:0:87915:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe9af07c40 20000000:00000080:2.0:1789997658.955711:0:87915:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faae0000 uarg=0000000000000000 10000000:01000000:2.0:1789997658.956115:0:87915:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997658.956137:0:87915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997658.956157:0:87915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d53e expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997658.956165:0:87915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997658.956206:0:87915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d53e expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997658.956232:0:87915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d53e expref: 18 pid: 5805 timeout: 1997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997658.956247:0:87915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87915:1876946713009664:0@lo:104: 00000100:00100000:2.0:1789997658.956311:0:87915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997658.956445:0:87915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e432c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789997658.956747:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713009664 00000100:00100000:0.0:1789997658.956756:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713009664 00000100:00100000:0.0:1789997658.956800:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789997658.956810:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:87915:x1876946713009664:12345-0@lo:104: 00010000:00010000:0.0:1789997658.956824:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997658.956946:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997658.956960:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:87915:x1876946713009664:12345-0@lo:104: Request processed in 145us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997658.956967:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:3.0:1789997658.956970:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997658.956976:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.956984:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997658.956988:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.956996:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997658.957003:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997658.957009:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997658.957043:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957049:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997658.957080:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957087:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d53e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d545 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957110:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997658.957112:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997658.957114:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997658.957130:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713009792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997658.957166:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997658.957199:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713009792 00000100:00100000:3.0:1789997658.957204:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713009792 00010000:00010000:3.0:1789997658.957225:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d53e expref: 19 pid: 5805 timeout: 1997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997658.957248:0:87915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87915:1876946713009664:0@lo:104: 00000100:00100000:3.0:1789997658.957252:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789997658.957258:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713009792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997658.957267:0:87915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957268:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997658.957272:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d53e expref: 19 pid: 5805 timeout: 1997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957281:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d53e expref: 19 pid: 5805 timeout: 1997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957293:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d545 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d53e expref: 19 pid: 5805 timeout: 1997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957306:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957314:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957332:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957338:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957345:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957351:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957355:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997658.957360:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957366:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957385:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997658.957394:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997658.957400:0:87915:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997658.957407:0:87915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997658.957414:0:87915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592d54c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997658.957434:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713009792:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997658.957440:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1789997658.957697:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713009792:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1789997659.520943:0:87963:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfd573f60 20000000:00000080:1.0:1789997659.520960:0:87963:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c770d000 uarg=0000000000000000 10000000:01000000:1.0:1789997659.521163:0:87963:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997659.521184:0:87963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521201:0:87963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521211:0:87963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521217:0:87963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521223:0:87963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521230:0:87963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521236:0:87963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997659.521240:0:87963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521248:0:87963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521261:0:87963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521270:0:87963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997659.521277:0:87963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d553 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997659.915190:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997660.442121:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997660.442174:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997660.442216:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997660.442241:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704527872 00000100:00100000:0.0:1789997660.442249:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997660.442252:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704527872 00000100:00100000:0.0:1789997660.442274:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704528000 00000100:00100000:0.0:1789997660.442277:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704528000 00000100:00100000:1.0:1789997660.442362:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704527616 00000100:00100000:1.0:1789997660.442366:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704527616 00000100:00100000:1.0:1789997660.442401:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1108 00000100:00100000:1.0:1789997660.442410:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704527616:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997660.442482:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704527616:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997660.442490:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1108 00000100:00100000:3.0:1789997660.442810:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704527744 00000100:00100000:3.0:1789997660.442827:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704527744 00000100:00100000:3.0:1789997660.442865:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1349 00000100:00100000:3.0:1789997660.442873:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704527744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997660.443250:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704527744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 375us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997660.443259:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1349 00000100:00100000:0.0:1789997660.443283:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 890 00000100:00100000:2.0:1789997660.443291:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 891 00000100:00100000:0.0:1789997660.443295:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704528000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997660.443300:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704527872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997660.443331:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704528000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997660.443334:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704527872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997660.443338:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 890 00000100:00100000:2.0:1789997660.443341:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 891 00000100:00080000:0.0:1789997660.445680:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997660.445693:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997660.445697:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1789997660.491570:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997660.491579:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997660.491585:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997660.491636:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997660.491650:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997660.491677:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997660.491703:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713009920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997660.491774:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997660.491849:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d1b8c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997660.491924:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713009920 00000100:00100000:1.0:1789997660.491933:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713009920 00000100:00100000:1.0:1789997660.491992:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1789997660.492003:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713009920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997660.492017:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997660.492030:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d55a expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997660.492052:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d55a expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997660.492063:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d55a expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997660.492072:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997660.492120:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713009920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997660.492126:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1789997660.493010:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713009920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997660.493038:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997660.493050:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997660.493072:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997660.493078:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997660.493086:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997660.619872:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713010048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997660.619943:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997660.620002:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997660.620011:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713010176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997660.620035:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997660.620777:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713010048 00000100:00100000:2.0:1789997660.620786:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713010048 00000100:00100000:2.0:1789997660.620851:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713010176 00000100:00100000:2.0:1789997660.620854:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713010176 00000100:00100000:2.0:1789997660.620872:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1789997660.620882:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713010048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997660.620916:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997660.620971:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713010048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997660.620980:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1789997660.621004:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1789997660.621012:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713010176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997660.621030:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997660.621060:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713010176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997660.621067:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00080000:3.0:1789997660.621171:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997660.621176:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997660.621191:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713010176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997660.621209:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713010048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997660.940700:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997661.963841:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997662.135186:0:88159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc9ea0d20 20000000:00000080:1.0:1789997662.135533:0:88159:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e83000 uarg=0000000000000000 00010000:00010000:1.0:1789997662.136163:0:88159:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997662.136181:0:88159:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997662.137329:0:88159:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997662.137357:0:88159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997662.137383:0:88159:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d55a expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997662.137392:0:88159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997662.137557:0:88159:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d55a expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997662.137574:0:88159:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d55a expref: 18 pid: 7594 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997662.137589:0:88159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88159:1876946713010304:0@lo:104: 00000100:00100000:1.0:1789997662.137670:0:88159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997662.137723:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713010304 00000100:00100000:0.0:1789997662.137732:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713010304 00000100:00100000:1.0:1789997662.137774:0:88159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3f84c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789997662.137796:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1789997662.137807:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:88159:x1876946713010304:12345-0@lo:104: 00010000:00010000:0.0:1789997662.137820:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.137882:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997662.137888:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:88159:x1876946713010304:12345-0@lo:104: Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997662.137895:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:0.0:1789997662.137915:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997662.137921:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.137928:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997662.137931:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.137940:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997662.137947:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997662.137962:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997662.137990:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.137996:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997662.138013:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138020:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d55a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d561 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138035:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997662.138037:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997662.138038:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997662.138055:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713010432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997662.138080:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997662.138109:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713010432 00000100:00100000:0.0:1789997662.138113:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713010432 00010000:00010000:0.0:1789997662.138128:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d55a expref: 19 pid: 7594 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997662.138147:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789997662.138153:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713010432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997662.138162:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997662.138167:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d55a expref: 19 pid: 7594 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138176:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d55a expref: 19 pid: 7594 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138190:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138199:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138212:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138219:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138226:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138233:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138238:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997662.138242:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138249:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138257:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.138265:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997662.138303:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713010432:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997662.138311:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1789997662.138346:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713010432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997662.140009:0:88159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d561 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d55a expref: 18 pid: 7594 timeout: 2000 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997662.140033:0:88159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88159:1876946713010304:0@lo:104: 00010000:00010000:1.0:1789997662.140057:0:88159:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997662.140069:0:88159:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997662.140075:0:88159:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997662.140080:0:88159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d568 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997662.989015:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997663.630488:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997663.630496:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997663.630500:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997663.630546:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997663.630559:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997663.630572:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997663.630599:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713010560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997663.630689:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997663.630729:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b51000 going to sleep for 11 seconds 00000100:00100000:1.0:1789997663.630811:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713010560 00000100:00100000:1.0:1789997663.630819:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713010560 00000100:00100000:1.0:1789997663.630871:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1789997663.630880:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713010560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997663.630894:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997663.630906:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d56f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997663.630929:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d56f expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997663.630940:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d56f expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997663.630948:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:1.0:1789997663.630985:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713010560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997663.630993:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1789997663.631086:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713010560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997663.631101:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997663.631111:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997663.631131:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997663.631136:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997663.631145:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997663.692489:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713010688:0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.692561:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997663.692619:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713011200:0@lo:400:kworker.0 00000100:00100000:3.0:1789997663.692642:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713010688 00000100:00100000:0.0:1789997663.692648:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997663.692684:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713010688 00000100:00100000:0.0:1789997663.692712:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997663.692720:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713011072:0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.692759:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997663.692793:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713010816:0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.692815:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997663.693807:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713011200 00000100:00100000:3.0:1789997663.693818:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713011200 00000100:00100000:3.0:1789997663.694055:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713010816 00000100:00100000:3.0:1789997663.694059:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713010816 00000100:00100000:3.0:1789997663.694091:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1789997663.694101:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713010688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.694218:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997663.694230:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713010944:0@lo:400:kworker.0 00000100:00100000:3.0:1789997663.694237:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713010688:12345-0@lo:400:kworker.0 Request processed in 136us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997663.694244:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1789997663.694269:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1789997663.694277:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713011200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997663.694308:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713011200:12345-0@lo:400:kworker.0 Request processed in 32us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997663.694314:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1789997663.694326:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1789997663.694332:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713010816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997663.694360:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713010816:12345-0@lo:400:kworker.0 Request processed in 29us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997663.694363:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997663.694371:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00080000:3.0:1789997663.694395:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997663.694419:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713010816:0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.694458:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713011072 00000100:00100000:0.0:1789997663.694461:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713011072 00000100:00100000:0.0:1789997663.694495:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713010944 00000100:00100000:0.0:1789997663.694497:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713010944 00000100:00100000:0.0:1789997663.694514:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1789997663.694520:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713011072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.694550:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713011072:12345-0@lo:400:kworker.0 Request processed in 30us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997663.694555:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:0.0:1789997663.694565:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:0.0:1789997663.694570:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713010944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.694594:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713010944:12345-0@lo:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997663.694599:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:0.0:1789997663.694628:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713010944:0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.694647:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713011072:0@lo:400:kworker.0 00000100:00080000:3.0:1789997663.694701:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997663.694705:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997663.694728:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713010688:0@lo:400:kworker.0 00000100:00100000:0.0:1789997663.694738:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713011200:0@lo:400:kworker.0 00010000:00010000:0.0:1789997664.013254:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997664.876401:0:88355:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffee7adbf0 20000000:00000080:2.0:1789997664.876424:0:88355:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4d15000 uarg=0000000000000000 10000000:01000000:2.0:1789997664.876480:0:88355:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997664.876503:0:88355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997664.876521:0:88355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d56f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997664.876530:0:88355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997664.876821:0:88355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d56f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997664.876836:0:88355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d56f expref: 18 pid: 5805 timeout: 2003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997664.876853:0:88355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88355:1876946713011328:0@lo:104: 00000100:00100000:2.0:1789997664.876923:0:88355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997664.877034:0:88355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997664.877083:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713011328 00000100:00100000:0.0:1789997664.877091:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713011328 00000100:00100000:0.0:1789997664.877188:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789997664.877199:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:88355:x1876946713011328:12345-0@lo:104: 00010000:00010000:0.0:1789997664.877213:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997664.877294:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997664.877301:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:88355:x1876946713011328:12345-0@lo:104: Request processed in 105us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997664.877308:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00010000:3.0:1789997664.877352:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997664.877360:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877368:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997664.877372:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877382:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997664.877389:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997664.877395:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997664.877429:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877436:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997664.877460:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877467:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2800/0x65b43101d592d56f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d576 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877487:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997664.877489:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997664.877491:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997664.877519:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713011456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997664.877555:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997664.877612:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713011456 00000100:00100000:3.0:1789997664.877617:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713011456 00010000:00010000:3.0:1789997664.877637:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d56f expref: 19 pid: 5805 timeout: 2003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997664.877703:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789997664.877712:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713011456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997664.877733:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997664.877739:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d56f expref: 19 pid: 5805 timeout: 2003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877750:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d56f expref: 19 pid: 5805 timeout: 2003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877766:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877774:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877789:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877797:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877804:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877815:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877821:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997664.877826:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877834:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877842:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997664.877850:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997664.877879:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713011456:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997664.877886:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789997664.877953:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713011456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997664.878055:0:88355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592d576 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d56f expref: 18 pid: 5805 timeout: 2003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997664.878066:0:88355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88355:1876946713011328:0@lo:104: 00010000:00010000:2.0:1789997664.878081:0:88355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997664.878090:0:88355:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997664.878095:0:88355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997664.878101:0:88355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d57d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997665.046026:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997665.542508:0:88403:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe62946db0 20000000:00000080:0.0:1789997665.542528:0:88403:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c7d1e800 uarg=0000000000000000 00010000:00010000:0.0:1789997665.543140:0:88403:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997665.543158:0:88403:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997665.543174:0:88403:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997665.543201:0:88403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543219:0:88403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543234:0:88403:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543241:0:88403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543249:0:88403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543256:0:88403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543262:0:88403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997665.543267:0:88403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543275:0:88403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543290:0:88403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543299:0:88403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997665.543306:0:88403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592d584 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997665.566783:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997665.566824:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997665.566897:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704528256 00000100:00100000:3.0:1789997665.566907:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704528256 00000100:00100000:3.0:1789997665.566981:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1353 00000100:00100000:3.0:1789997665.566992:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704528256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997665.567070:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704528256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997665.567077:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1353 00000100:00080000:0.0:1789997665.567250:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997665.567332:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704528128 00000100:00100000:1.0:1789997665.567337:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704528128 00000100:00100000:1.0:1789997665.567503:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1111 00000100:00100000:1.0:1789997665.567511:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704528128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997665.567550:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704528128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997665.567558:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1111 00000100:00100000:0.0:1789997665.581026:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997665.581066:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997665.581129:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704528384 00000100:00100000:2.0:1789997665.581141:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704528384 00000100:00100000:2.0:1789997665.581197:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704528512 00000100:00100000:2.0:1789997665.581200:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704528512 00000100:00100000:2.0:1789997665.581220:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 515 00000100:00100000:2.0:1789997665.581229:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704528384:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:2.0:1789997665.581260:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592ce61 00000100:00080000:2.0:1789997665.581270:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a37c8048000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789997665.581309:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967357 00000100:00100000:2.0:1789997665.581557:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704528384:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 327us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997665.581565:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 515 00000100:00100000:2.0:1789997665.581579:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 516 00000100:00100000:2.0:1789997665.581587:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704528512:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:2.0:1789997665.581598:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592cdb2 00000100:00080000:2.0:1789997665.581604:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c859c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789997665.581620:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967357 00010000:00010000:0.0:1789997665.581729:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789997665.581737:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997665.581740:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789997665.581796:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997665.582044:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704528512:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 457us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997665.582052:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 516 00000100:00100000:3.0:1789997665.740775:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713011584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997665.740850:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997665.740979:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713011584 00000100:00100000:2.0:1789997665.740991:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713011584 00000100:00100000:2.0:1789997665.741053:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1789997665.741065:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713011584:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997665.741092:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789997665.741106:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997665.741163:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713011584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997665.741171:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1789997665.741472:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713011712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997665.741498:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997665.741618:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713011712 00000100:00100000:3.0:1789997665.741624:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713011712 00000100:00100000:3.0:1789997665.741685:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1789997665.741694:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713011712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997665.741727:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997665.745044:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713011712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3341us (3533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997665.745058:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00080000:3.0:1789997665.745097:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997665.745144:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713011584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997665.745773:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713011712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997666.060775:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997666.124953:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997666.124961:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997666.124967:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997666.125016:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997666.125028:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997666.125040:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997666.125066:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713011840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997666.125143:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997666.125201:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997666.125266:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713011840 00000100:00100000:1.0:1789997666.125275:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713011840 00000100:00100000:1.0:1789997666.125324:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1789997666.125333:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713011840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997666.125345:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997666.125357:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d58b expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997666.125378:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d58b expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997666.125389:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d58b expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997666.125400:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997666.125446:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713011840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997666.125454:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1789997666.125947:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713011840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997666.125965:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997666.125974:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997666.125992:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997666.125998:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997666.126005:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997667.087768:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997668.108897:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997668.812156:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713011968:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.812245:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997668.812304:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713012480:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.812333:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997668.812364:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997668.812371:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713012352:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.812394:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997668.812423:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713012096:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.812449:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997668.812468:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713012608:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.812488:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997668.812507:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997668.812513:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713012224:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.812535:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997668.812575:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713012480 00000100:00100000:3.0:1789997668.812585:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713012480 00000100:00100000:3.0:1789997668.812640:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713012352 00000100:00100000:3.0:1789997668.812643:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713012352 00000100:00100000:3.0:1789997668.812701:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1789997668.812711:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713012480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.812766:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713012480:12345-0@lo:400:kworker.0 Request processed in 56us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997668.812774:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1789997668.812955:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1789997668.812964:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713012352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.812996:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713012352:12345-0@lo:400:kworker.0 Request processed in 34us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997668.813003:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1789997668.813028:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713012096 00000100:00100000:3.0:1789997668.813032:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713012096 00000100:00100000:3.0:1789997668.813058:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713012608 00000100:00100000:3.0:1789997668.813061:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713012608 00000100:00100000:3.0:1789997668.813078:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713012224 00000100:00100000:3.0:1789997668.813081:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713012224 00000100:00100000:3.0:1789997668.813100:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1789997668.813107:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713012096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.813143:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713012096:12345-0@lo:400:kworker.0 Request processed in 36us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997668.813149:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1789997668.813162:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1789997668.813168:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713012608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.813197:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713012608:12345-0@lo:400:kworker.0 Request processed in 30us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997668.813203:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1789997668.813215:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1789997668.813221:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713012224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.813248:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713012224:12345-0@lo:400:kworker.0 Request processed in 27us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997668.813254:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00080000:3.0:1789997668.813277:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997668.813282:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997668.813284:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997668.813333:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713012224:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.813347:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713012096:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.813356:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713012608:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.813396:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713012352:0@lo:400:kworker.0 00000100:00100000:3.0:1789997668.813407:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713012480:0@lo:400:kworker.0 00000100:00100000:0.0:1789997668.813498:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713011968 00000100:00100000:0.0:1789997668.813502:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713011968 00000100:00100000:0.0:1789997668.813543:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1789997668.813551:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713011968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997668.813590:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713011968:12345-0@lo:400:kworker.0 Request processed in 40us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997668.813597:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:3.0:1789997668.813981:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713011968:0@lo:400:kworker.0 00010000:00010000:1.0:1789997669.131803:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789997669.348255:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997669.348262:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a37c804d000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997669.348290:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c804d000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:0.0:1789997669.348328:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c8048000 for lustre-OST0000 00000001:00100000:2.0:1789997669.352456:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:2.0:1789997669.352465:0:7614:0:(genops.c:885:class_export_put()) final put ffff8a38c859b800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997669.352513:0:40741:0:(genops.c:844:class_export_destroy()) destroying export ffff8a38c859b800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0001 00000020:00000080:0.0:1789997669.352554:0:40741:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a38c859c800 for lustre-OST0001 00000020:00000080:1.0:1789997669.643609:0:88698:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6814bfb0 20000000:00000080:1.0:1789997669.643627:0:88698:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd793400 uarg=0000000000000000 00010000:00010000:1.0:1789997669.644353:0:88698:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997669.644371:0:88698:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997669.644385:0:88698:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997669.644403:0:88698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997669.644419:0:88698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d58b expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997669.644427:0:88698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997669.644465:0:88698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d58b expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997669.644479:0:88698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d58b expref: 18 pid: 5805 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997669.644493:0:88698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88698:1876946713012736:0@lo:104: 00000100:00100000:1.0:1789997669.644554:0:88698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997669.644712:0:88698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d057b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789997669.644829:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713012736 00000100:00100000:0.0:1789997669.644837:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713012736 00000100:00100000:0.0:1789997669.644925:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789997669.644936:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:88698:x1876946713012736:12345-0@lo:104: 00010000:00010000:0.0:1789997669.644949:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997669.645020:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997669.645027:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:88698:x1876946713012736:12345-0@lo:104: Request processed in 94us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997669.645035:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789997669.645094:0:88698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88698:1876946713012736:0@lo:104: 00010000:00010000:1.0:1789997669.645111:0:88698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645168:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997669.645175:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645182:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997669.645186:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645198:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997669.645205:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997669.645211:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997669.645251:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645258:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997669.645278:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645286:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592d58b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d592 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645300:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997669.645302:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997669.645303:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997669.645316:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713012864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997669.645347:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997669.645386:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713012864 00000100:00100000:3.0:1789997669.645390:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713012864 00010000:00010000:3.0:1789997669.645409:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d58b expref: 19 pid: 5805 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997669.645431:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789997669.645437:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713012864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997669.645447:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997669.645453:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d58b expref: 19 pid: 5805 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645462:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d58b expref: 19 pid: 5805 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645474:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592d592 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d58b expref: 19 pid: 5805 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645486:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645494:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645507:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645514:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645521:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645527:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645532:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997669.645536:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645547:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645558:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997669.645567:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997669.645594:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713012864:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997669.645600:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789997669.645627:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713012864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997669.645751:0:88698:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997669.645760:0:88698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997669.645766:0:88698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592d599 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997670.158927:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997670.249202:0:88746:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3db1ee10 20000000:00000080:1.0:1789997670.249220:0:88746:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd792c00 uarg=0000000000000000 10000000:01000000:1.0:1789997670.249264:0:88746:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997670.249299:0:88746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249316:0:88746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249327:0:88746:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249333:0:88746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249341:0:88746:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249348:0:88746:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249355:0:88746:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997670.249360:0:88746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249368:0:88746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249382:0:88746:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249395:0:88746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.249402:0:88746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592d5a0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997670.683297:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997670.683345:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997670.683372:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704528640 00000100:00100000:3.0:1789997670.683381:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704528640 00000100:00100000:3.0:1789997670.683428:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1114 00000100:00100000:3.0:1789997670.683438:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704528640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997670.683506:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704528640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997670.683513:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1114 00000100:00100000:3.0:1789997670.683544:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704528768 00000100:00100000:3.0:1789997670.683547:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704528768 00000100:00100000:3.0:1789997670.683585:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1357 00000100:00100000:3.0:1789997670.683591:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704528768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997670.683634:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704528768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997670.683644:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1357 00000100:00080000:2.0:1789997670.683782:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997670.858929:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713012992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997670.859007:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997670.859138:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713013120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997670.859170:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997670.859215:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713012992 00000100:00100000:0.0:1789997670.859224:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713012992 00000100:00080000:3.0:1789997670.859271:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997670.859291:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713013120 00000100:00100000:0.0:1789997670.859296:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713013120 00000100:00100000:3.0:1789997670.859309:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1789997670.859321:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb2ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713012992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997670.859326:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1789997670.859337:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713013120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997670.859357:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00002000:00000024:0.0:1789997670.859362:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997670.859410:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb2ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713012992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997670.859418:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713013120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997670.859419:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1789997670.859430:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00080000:0.0:1789997670.859916:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997670.859957:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713013120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997670.859995:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713012992:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1789997670.924857:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997670.924865:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997670.924871:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997670.924936:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.924952:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997670.924964:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997670.924995:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713013248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997670.925083:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997670.925149:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb648a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789997670.925927:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713013248 00000100:00100000:0.0:1789997670.925936:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713013248 00000100:00100000:0.0:1789997670.925995:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1789997670.926004:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713013248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997670.926018:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997670.926032:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d5a7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997670.926056:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997670.926068:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997670.926078:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997670.926129:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713013248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997670.926135:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1789997670.926181:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713013248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997670.926198:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997670.926208:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997670.927406:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997670.927416:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997670.927426:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997671.179224:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997672.205611:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997672.723883:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997672.724142:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704528896 00000100:00100000:3.0:1789997672.724152:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704528896 00000100:00100000:3.0:1789997672.724245:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 961 00000100:00100000:3.0:1789997672.724256:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:52718:x1876946704528896:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997672.724276:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997672.724300:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d5b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeef6 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.724358:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d5bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.724371:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d5bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.724385:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d5bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997672.724434:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997672.724439:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997672.724463:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d5bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.724498:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d5b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeef6 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.724521:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d5bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeef6 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.724528:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997672.724530:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997672.724533:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ac00, rc 0) 00000100:00100000:3.0:1789997672.724610:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52718:x1876946704528896:12345-192.168.204.4@tcp:101:rm.0 Request processed in 357us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997672.724616:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 961 00000100:00080000:0.0:1789997672.725607:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997672.732776:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997672.732969:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704529024 00000100:00100000:0.0:1789997672.732979:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704529024 00000100:00100000:0.0:1789997672.733049:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 962 00000100:00100000:0.0:1789997672.733059:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52718:x1876946704529024:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997672.733079:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997672.733100:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeefd expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733173:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733198:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733210:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733270:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733279:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733287:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733482:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733491:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733498:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733504:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997672.733509:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733517:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733528:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:0.0:1789997672.733531:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997672.733535:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733540:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d5ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733553:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733559:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733565:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733584:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997672.733588:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733594:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733600:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997672.733603:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997672.733606:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733612:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733647:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeefd expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733923:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:0.0:1789997672.733926:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997672.733930:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeefd expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.733941:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997672.734012:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52718:x1876946704529024:12345-192.168.204.4@tcp:101:rm.0 Request processed in 954us (1245us total) trans 0 rc 301/301 00000100:00100000:0.0:1789997672.734031:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 962 00000100:00100000:1.0:1789997672.785732:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997672.785787:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997672.785924:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704529152 00000100:00100000:0.0:1789997672.785936:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704529152 00000100:00100000:0.0:1789997672.786000:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704529408 00000100:00100000:0.0:1789997672.786004:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704529408 00000100:00100000:0.0:1789997672.786033:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 963 00000100:00100000:0.0:1789997672.786043:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704529152:12345-192.168.204.4@tcp:41:mkdir.0 00000004:00000024:0.0:1789997672.786086:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789997672.786156:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704529152:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 115us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997672.786163:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 963 00000100:00100000:0.0:1789997672.786192:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 964 00000100:00100000:0.0:1789997672.786199:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52722:x1876946704529408:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:0.0:1789997672.786231:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997672.786255:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d5bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeef6 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.786277:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:0.0:1789997672.786288:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997672.786507:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.786521:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.786532:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.786544:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.786551:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.786562:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997672.789260:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:0.0:1789997672.789280:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.789290:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.789297:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.789302:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997672.789307:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.789314:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.789330:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997672.789332:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997672.789337:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997672.789343:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d5d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997672.789362:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077276fcc reply state 0000000060191107 transno 4294967667 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997672.789377:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997672.789523:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:52722:x1876946704529408:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 3320us (3732us total) trans 4294967667 rc 0/0 00000100:00100000:0.0:1789997672.789531:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 964 00010000:00010000:3.0:1789997672.804492:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.804512:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.804520:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.804527:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997672.804531:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.804538:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.804556:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38c28e9a00) 00010000:00010000:3.0:1789997672.804558:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997672.804562:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.804567:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d5df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997672.854270:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997672.855054:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704529536 00000100:00100000:0.0:1789997672.855065:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704529536 00000100:00100000:2.0:1789997672.855367:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 965 00000100:00100000:2.0:1789997672.855379:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52726:x1876946704529536:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1789997672.855404:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997672.855427:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d5e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef04 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.855500:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d5ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.855515:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d5ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.855530:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d5ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997672.855565:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789997672.855709:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997672.855739:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d5ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.855763:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d5e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef04 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.855781:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d5ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef04 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.855789:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997672.855791:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997672.855807:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997672.855875:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:52726:x1876946704529536:12345-192.168.204.4@tcp:101:chown.0 Request processed in 497us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997672.855882:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 965 00000100:00100000:1.0:1789997672.858851:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997672.858940:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704529664 00000100:00100000:3.0:1789997672.858950:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704529664 00000100:00100000:3.0:1789997672.859017:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 966 00000100:00100000:3.0:1789997672.859026:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:52726:x1876946704529664:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:3.0:1789997672.859047:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997672.859066:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d5f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef0b expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859392:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859409:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859420:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859435:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859441:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859447:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859705:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859714:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859722:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997672.859755:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:3.0:1789997672.859758:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997672.859777:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859787:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859793:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859810:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859815:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997672.859819:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859826:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859837:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:3.0:1789997672.859840:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997672.859844:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859850:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d5fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859869:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859876:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859881:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859885:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997672.859888:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859893:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859901:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38ee49e800) 00010000:00010000:3.0:1789997672.859903:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997672.859906:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859912:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d602 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859948:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d5f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef0b expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859962:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef0b expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997672.859970:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997672.859972:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997672.859974:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:3.0:1789997672.860032:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:52726:x1876946704529664:12345-192.168.204.4@tcp:101:chown.0 Request processed in 1007us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997672.860039:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 966 00000100:00100000:0.0:1789997672.863531:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997672.863700:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704529920 00000100:00100000:2.0:1789997672.863711:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704529920 00000100:00100000:2.0:1789997672.863758:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 967 00000100:00100000:2.0:1789997672.863768:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:52726:x1876946704529920:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:2.0:1789997672.863828:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997672.863855:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef0b expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.863883:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:2.0:1789997672.863894:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997672.863919:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.863932:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.863942:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997672.864387:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004074675e reply state 0000000000a9ffa0 transno 4294967668 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997672.864398:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997672.864407:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000100:00100000:2.0:1789997672.865119:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:52726:x1876946704529920:12345-192.168.204.4@tcp:36:chown.0 Request processed in 1348us (1594us total) trans 4294967668 rc 0/0 00000100:00100000:2.0:1789997672.865129:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 967 00010000:00010000:2.0:1789997672.870870:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.870890:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.870898:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.870904:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997672.870909:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.870917:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.870933:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997672.870936:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997672.870941:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997672.870947:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d610 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997673.228340:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997673.577464:0:88944:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc992dfea0 20000000:00000080:0.0:1789997673.577484:0:88944:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9ba2800 uarg=0000000000000000 00010000:00010000:0.0:1789997673.578259:0:88944:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997673.578305:0:88944:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:0.0:1789997673.578309:0:88944:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997673.578329:0:88944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d5ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef04 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997673.578350:0:88944:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997673.578373:0:88944:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997673.578387:0:88944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997673.578412:0:88944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997673.578420:0:88944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997673.578497:0:88944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997673.578523:0:88944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 18 pid: 5803 timeout: 2012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997673.578538:0:88944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88944:1876946713013376:0@lo:104: 00000100:00100000:0.0:1789997673.578827:0:88944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997673.578994:0:88944:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d10a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789997673.579040:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789997673.579052:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713013376 00000100:00100000:1.0:1789997673.579058:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713013376 00000100:00100000:1.0:1789997673.579133:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789997673.579142:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd791050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:88944:x1876946713013376:12345-0@lo:104: 00010000:00010000:1.0:1789997673.579154:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997673.579211:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997673.579217:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd791050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:88944:x1876946713013376:12345-0@lo:104: Request processed in 76us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997673.579223:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789997673.579301:0:88944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88944:1876946713013376:0@lo:104: 00010000:00010000:2.0:1789997673.579334:0:88944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.579472:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997673.579491:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.579499:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997673.579502:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.579511:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997673.579528:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997673.579533:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997673.579604:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.579611:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997673.579643:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.579694:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3c00/0x65b43101d592d5a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d5ae expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.579710:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997673.579712:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997673.579713:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997673.579725:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713013504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997673.579796:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997673.579862:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713013504 00000100:00100000:3.0:1789997673.579867:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713013504 00010000:00010000:3.0:1789997673.579900:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 19 pid: 5803 timeout: 2012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997673.579938:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789997673.579945:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713013504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997673.579972:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997673.579992:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 19 pid: 5803 timeout: 2012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580003:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 19 pid: 5803 timeout: 2012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580033:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d5ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d5a7 expref: 19 pid: 5803 timeout: 2012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580058:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580067:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580082:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580108:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580116:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580138:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580144:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997673.580163:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580185:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580196:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997673.580206:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997673.580313:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713013504:12345-0@lo:103:ldlm_bl.0 Request processed in 358us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997673.580320:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789997673.580367:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713013504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997673.580693:0:88944:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997673.580703:0:88944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997673.580709:0:88944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d617 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997673.932546:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997673.932581:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713013632:0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.932650:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997673.932743:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713013632 00000100:00100000:3.0:1789997673.932751:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713013632 00000100:00100000:3.0:1789997673.932872:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1789997673.932882:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713013632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.932936:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713013632:12345-0@lo:400:kworker.0 Request processed in 55us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997673.932944:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1789997673.932987:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713013632:0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.933028:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997673.933037:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713013760:0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.933062:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997673.933086:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713013760 00000100:00100000:3.0:1789997673.933089:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713013760 00000100:00100000:3.0:1789997673.933123:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1789997673.933129:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713013760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.933164:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713013760:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997673.933170:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00080000:3.0:1789997673.933186:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997673.933205:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713013760:0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.933233:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713013888:0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.933259:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997673.933286:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713013888 00000100:00100000:3.0:1789997673.933290:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713013888 00000100:00100000:3.0:1789997673.933320:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1789997673.933326:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713013888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.934504:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713013888:12345-0@lo:400:kworker.0 Request processed in 1174us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997673.934513:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00080000:3.0:1789997673.934536:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997673.934615:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713014016:0@lo:400:kworker.0 00000100:00100000:1.0:1789997673.934887:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997673.934975:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713014016 00000100:00100000:3.0:1789997673.934982:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713014016 00000100:00100000:3.0:1789997673.935020:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1789997673.935027:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713014016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997673.935123:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713013888:0@lo:400:kworker.0 00000100:00100000:3.0:1789997673.941856:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713014016:12345-0@lo:400:kworker.0 Request processed in 6749us (7122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997673.941871:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00080000:3.0:1789997673.941915:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997673.942010:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713014144:0@lo:400:kworker.0 00000100:00100000:0.0:1789997673.942073:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997673.942475:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713014016:0@lo:400:kworker.0 00000100:00100000:0.0:1789997673.942890:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713014144 00000100:00100000:0.0:1789997673.942900:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713014144 00000100:00100000:0.0:1789997673.942993:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1789997673.943002:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713014144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997673.943061:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713014144:12345-0@lo:400:kworker.0 Request processed in 61us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997673.943067:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1789997673.943111:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713014144:0@lo:400:kworker.0 00000100:00080000:3.0:1789997673.945033:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997674.251911:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997674.526562:0:88993:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd44c15c50 20000000:00000080:0.0:1789997674.526582:0:88993:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c5c0f400 uarg=0000000000000000 10000000:01000000:0.0:1789997674.526637:0:88993:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997674.526797:0:88993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.526813:0:88993:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.526828:0:88993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.526834:0:88993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.526841:0:88993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.526847:0:88993:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.526853:0:88993:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997674.526857:0:88993:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.526865:0:88993:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.526876:0:88993:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.527005:0:88993:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997674.527013:0:88993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d61e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88993 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997675.276133:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997675.280100:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997675.280109:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997675.280115:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997675.280165:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997675.280179:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997675.280190:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997675.280218:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713014272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997675.280288:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997675.280340:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61000 going to sleep for 11 seconds 00000100:00100000:1.0:1789997675.280399:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713014272 00000100:00100000:1.0:1789997675.280407:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713014272 00000100:00100000:1.0:1789997675.280455:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1789997675.280465:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713014272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997675.280478:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997675.280490:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d625 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997675.280511:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d625 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997675.280537:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d625 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997675.280545:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997675.280586:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713014272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997675.280593:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1789997675.283289:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713014272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997675.283317:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997675.283330:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997675.283353:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997675.283359:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997675.283368:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997675.804715:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997675.804760:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997675.804838:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704530176 00000100:00100000:2.0:1789997675.804849:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704530176 00000100:00100000:2.0:1789997675.804928:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1361 00000100:00100000:2.0:1789997675.804939:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704530176:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997675.805018:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704530176:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997675.805026:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1361 00000100:00080000:0.0:1789997675.805075:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997675.809036:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704530048 00000100:00100000:1.0:1789997675.809051:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704530048 00000100:00100000:1.0:1789997675.809111:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1117 00000100:00100000:1.0:1789997675.809121:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704530048:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997675.809195:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704530048:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997675.809202:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1117 00000100:00100000:1.0:1789997675.993474:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713014400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997675.993553:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997675.993736:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997675.993744:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713014528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997675.993770:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997675.993796:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713014400 00000100:00100000:3.0:1789997675.993802:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713014400 00000100:00100000:3.0:1789997675.993845:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713014528 00000100:00100000:3.0:1789997675.993847:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713014528 00000100:00100000:3.0:1789997675.993862:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1789997675.993869:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713014400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997675.993901:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997675.993941:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713014400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997675.993948:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1789997675.993962:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:3.0:1789997675.993967:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713014528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997675.993983:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997675.994005:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713014528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997675.994010:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00080000:3.0:1789997675.994023:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997675.994028:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997675.994059:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713014528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997675.994072:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713014400:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789997676.299184:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997676.615259:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967667 is committed 00000001:00080000:1.0:1789997676.615277:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967668 is committed 00010000:00010000:0.0:1789997677.326548:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997678.312380:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997678.312459:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704530304 00000100:00100000:3.0:1789997678.312482:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704530304 00000100:00100000:3.0:1789997678.312567:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00100000:3.0:1789997678.312577:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704530304:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997678.312592:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997678.312595:0:5797:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592d5ed) 00010000:00010000:3.0:1789997678.312598:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997678.312685:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704530304:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 109us (314us total) trans 0 rc 116/116 00000100:00100000:3.0:1789997678.312703:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 15 00000100:00080000:0.0:1789997678.313350:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997678.346940:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997679.056964:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713014656:0@lo:400:kworker.0 00000100:00100000:1.0:1789997679.057829:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997679.057901:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713014656 00000100:00100000:1.0:1789997679.057909:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713014656 00000100:00100000:1.0:1789997679.057952:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1789997679.057962:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713014656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997679.059063:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713014656:12345-0@lo:400:kworker.0 Request processed in 1099us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997679.059074:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1789997679.059134:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713014656:0@lo:400:kworker.0 00000100:00100000:1.0:1789997679.059200:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713014784:0@lo:400:kworker.0 00000100:00100000:1.0:1789997679.059238:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997679.059287:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713014784 00000100:00100000:1.0:1789997679.059292:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713014784 00000100:00100000:1.0:1789997679.059324:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1789997679.059330:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713014784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997679.059382:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713014784:12345-0@lo:400:kworker.0 Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997679.059388:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1789997679.059415:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713014784:0@lo:400:kworker.0 00000100:00100000:1.0:1789997679.059459:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713014912:0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060347:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713015040:0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060382:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997679.060416:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713015040 00000100:00100000:0.0:1789997679.060420:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713015040 00000100:00100000:0.0:1789997679.060469:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:0.0:1789997679.060477:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713015040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060511:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713015040:12345-0@lo:400:kworker.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997679.060516:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00080000:0.0:1789997679.060530:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997679.060553:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713015040:0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060574:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713015296:0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060597:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997679.060612:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997679.060618:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713015168:0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060634:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997679.060683:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713015296 00000100:00100000:0.0:1789997679.060686:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713015296 00000100:00100000:0.0:1789997679.060713:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1789997679.060718:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713015296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060748:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713015296:12345-0@lo:400:kworker.0 Request processed in 30us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997679.060757:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1789997679.060771:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713015168 00000100:00100000:0.0:1789997679.060775:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713015168 00000100:00100000:0.0:1789997679.060793:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:0.0:1789997679.060798:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713015168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060823:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713015168:12345-0@lo:400:kworker.0 Request processed in 25us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997679.060828:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00080000:0.0:1789997679.060839:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997679.060842:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997679.060859:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713015168:0@lo:400:kworker.0 00000100:00100000:0.0:1789997679.060869:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713015296:0@lo:400:kworker.0 00000100:00100000:1.0:1789997679.062712:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997679.062765:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713014912 00000100:00100000:1.0:1789997679.062771:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713014912 00000100:00100000:1.0:1789997679.062815:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:1.0:1789997679.062823:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713014912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997679.062873:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713014912:12345-0@lo:400:kworker.0 Request processed in 52us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997679.062880:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00080000:1.0:1789997679.062897:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997679.062924:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713014912:0@lo:400:kworker.0 00010000:00010000:3.0:1789997679.371827:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997680.398120:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997680.700340:0:89238:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd7b13c90 20000000:00000080:1.0:1789997680.700360:0:89238:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd793400 uarg=0000000000000000 00010000:00010000:1.0:1789997680.701030:0:89238:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997680.701048:0:89238:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997680.701062:0:89238:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997680.701082:0:89238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997680.701098:0:89238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d625 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997680.701107:0:89238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997680.701146:0:89238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d625 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997680.701162:0:89238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d625 expref: 18 pid: 5805 timeout: 2019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997680.701177:0:89238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89238:1876946713015424:0@lo:104: 00000100:00100000:1.0:1789997680.701242:0:89238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997680.701836:0:89238:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d057b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789997680.708139:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713015424 00000100:00100000:0.0:1789997680.708156:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713015424 00000100:00100000:0.0:1789997680.708231:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789997680.708868:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:89238:x1876946713015424:12345-0@lo:104: 00010000:00010000:0.0:1789997680.708891:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997680.709544:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997680.709553:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:89238:x1876946713015424:12345-0@lo:104: Request processed in 1313us (8310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997680.709562:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00010000:2.0:1789997680.709671:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997680.709680:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997680.709689:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997680.709694:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997680.709703:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997680.709710:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997680.709717:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997680.709761:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997680.709768:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997680.709790:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997680.709797:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592d625 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d62c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997680.709813:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997680.709815:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997680.709817:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997680.709831:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713015552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997680.709872:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997680.710604:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713015552 00000100:00100000:3.0:1789997680.710612:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713015552 00010000:00010000:3.0:1789997680.713690:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d625 expref: 19 pid: 5805 timeout: 2019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997680.713753:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789997680.713772:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713015552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997680.713790:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997680.713798:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d625 expref: 19 pid: 5805 timeout: 2019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713810:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d625 expref: 19 pid: 5805 timeout: 2019 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713832:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713840:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713857:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713864:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713871:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713877:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713885:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997680.713889:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713897:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713905:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997680.713915:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997680.713974:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713015552:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (4101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997680.713981:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00010000:1.0:1789997680.719058:0:89238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592d62c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d625 expref: 18 pid: 5805 timeout: 2019 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997680.719080:0:89238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89238:1876946713015424:0@lo:104: 00010000:00010000:1.0:1789997680.719105:0:89238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997680.719115:0:89238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997680.719122:0:89238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997680.719128:0:89238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592d633 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997680.721763:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713015552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997680.919183:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997680.919231:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997680.919301:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704530560 00000100:00100000:3.0:1789997680.919312:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704530560 00000100:00100000:3.0:1789997680.919424:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1365 00000100:00100000:3.0:1789997680.919435:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704530560:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997680.919535:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704530560:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 102us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997680.919543:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1365 00000100:00080000:2.0:1789997680.920140:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997680.923505:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704530432 00000100:00100000:1.0:1789997680.923520:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704530432 00000100:00100000:1.0:1789997680.923583:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1119 00000100:00100000:1.0:1789997680.923593:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704530432:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997680.923689:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704530432:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 97us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997680.923696:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1119 00000100:00100000:0.0:1789997681.099507:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713015680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997681.099583:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997681.100354:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713015808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997681.100390:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997681.100448:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713015680 00000100:00100000:3.0:1789997681.100454:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713015680 00000100:00100000:3.0:1789997681.100509:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713015808 00000100:00100000:3.0:1789997681.100512:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713015808 00000100:00100000:3.0:1789997681.100529:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1789997681.100536:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713015680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997681.100567:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997681.101935:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997681.101943:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997681.101964:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1789997681.101982:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713015808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997681.102010:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997681.102091:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713015808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997681.102098:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1789997681.102149:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713015808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997681.106162:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713015680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5619us (6571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997681.106176:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1789997681.108220:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713015680:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997681.425592:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997681.994793:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997681.994801:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997681.994806:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997681.994849:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997681.994861:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997681.994872:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997681.994897:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713015936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997681.994960:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997681.995018:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e973f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789997681.995134:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713015936 00000100:00100000:1.0:1789997681.995143:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713015936 00000100:00100000:1.0:1789997681.995201:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1789997681.995211:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713015936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997681.995224:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997681.995237:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d63a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997681.995259:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d63a expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997681.995270:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d63a expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997681.995283:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997681.995330:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713015936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997681.995336:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1789997681.995455:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713015936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997681.995482:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997681.995491:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997681.995521:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997681.995526:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997681.995534:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997682.454604:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997683.469325:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997684.171092:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713016448:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171173:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997684.171231:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789997684.171238:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713016064:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171268:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997684.171289:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713016576:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171310:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997684.171359:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713016192:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171386:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997684.171415:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713016704:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171438:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997684.171455:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997684.171460:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713016320:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171494:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997684.171525:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713016448 00000100:00100000:0.0:1789997684.171533:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713016448 00000100:00100000:0.0:1789997684.171580:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713016576 00000100:00100000:0.0:1789997684.171583:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713016576 00000100:00100000:0.0:1789997684.171605:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1789997684.171613:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713016448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171684:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713016448:12345-0@lo:400:kworker.0 Request processed in 72us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997684.171691:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:0.0:1789997684.171706:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1789997684.171711:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713016576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171736:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713016576:12345-0@lo:400:kworker.0 Request processed in 25us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997684.171741:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1789997684.171760:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713016192 00000100:00100000:0.0:1789997684.171764:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713016192 00000100:00100000:0.0:1789997684.171782:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713016704 00000100:00100000:0.0:1789997684.171784:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713016704 00000100:00100000:0.0:1789997684.171799:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713016320 00000100:00100000:0.0:1789997684.171801:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713016320 00000100:00100000:0.0:1789997684.171814:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1789997684.171819:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713016192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171850:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713016192:12345-0@lo:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997684.171872:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:0.0:1789997684.171885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1789997684.171890:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713016704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171918:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713016704:12345-0@lo:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997684.171923:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:0.0:1789997684.171934:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:0.0:1789997684.171939:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713016320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.171965:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713016320:12345-0@lo:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997684.171970:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00080000:0.0:1789997684.171989:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997684.171994:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997684.171996:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997684.172029:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713016320:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.172039:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713016192:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.172048:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713016704:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.172079:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713016576:0@lo:400:kworker.0 00000100:00100000:0.0:1789997684.172086:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713016448:0@lo:400:kworker.0 00000100:00100000:1.0:1789997684.173701:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713016064 00000100:00100000:1.0:1789997684.173710:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713016064 00000100:00100000:1.0:1789997684.173768:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789997684.173777:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713016064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997684.173842:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713016064:12345-0@lo:400:kworker.0 Request processed in 67us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997684.173848:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789997684.173911:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713016064:0@lo:400:kworker.0 00010000:00010000:1.0:1789997684.490949:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997684.909856:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997684.909937:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704530688 00000100:00100000:0.0:1789997684.909946:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704530688 00000100:00100000:0.0:1789997684.909998:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 968 00000100:00100000:0.0:1789997684.910007:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:52904:x1876946704530688:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997684.910028:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997684.910048:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef12 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997684.910104:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d64f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997684.910119:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997684.910155:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997684.910193:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789997684.910197:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997684.910219:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d64f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997684.910242:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef12 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997684.910266:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d64f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef12 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997684.910274:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997684.910277:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997684.910280:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789997684.910332:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52904:x1876946704530688:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 326us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997684.910353:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 968 00000100:00080000:0.0:1789997684.910375:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997684.918626:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997684.918970:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704530816 00000100:00100000:3.0:1789997684.918980:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704530816 00000100:00100000:3.0:1789997684.919041:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 969 00000100:00100000:3.0:1789997684.919051:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52904:x1876946704530816:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997684.919098:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997684.919142:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef19 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.919205:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.919236:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.919305:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.919415:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.919444:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.919479:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.920898:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d66b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.920980:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.920990:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997684.921023:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:3.0:1789997684.921027:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997684.921046:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d66b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921063:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921070:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921078:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921085:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997684.921089:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921097:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921109:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:3.0:1789997684.921112:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997684.921117:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921124:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d65d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921136:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921144:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921150:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921155:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997684.921158:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921164:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921172:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38ee49e900) 00010000:00010000:3.0:1789997684.921174:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997684.921177:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921183:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d664 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921216:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592d656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef19 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921230:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d66b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef19 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997684.921237:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997684.921240:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997684.921242:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b600, rc 0) 00000100:00100000:3.0:1789997684.921312:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:52904:x1876946704530816:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 2262us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997684.921320:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 969 00000100:00100000:3.0:1789997684.927518:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997684.933148:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704531072 00000100:00100000:2.0:1789997684.933163:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704531072 00000100:00100000:2.0:1789997684.933269:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 970 00000100:00100000:2.0:1789997684.933280:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:52904:x1876946704531072:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997684.933436:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997684.933463:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d66b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef19 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997684.933483:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:2.0:1789997684.933494:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997684.933519:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997684.933533:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997684.933543:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997685.041861:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967669 is committed 00000004:00010000:1.0:1789997685.041984:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f275cb0 reply state 0000000054d7c968 transno 4294967669 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997685.041999:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997685.042013:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00080000:1.0:1789997685.042110:0:5812:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789997685.042131:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:52904:x1876946704531072:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 108850us (114618us total) trans 4294967669 rc 0/0 00000100:00100000:1.0:1789997685.042140:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 970 00010000:00010000:0.0:1789997685.043044:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997685.043056:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997685.043065:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997685.043084:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997685.043088:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997685.043096:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997685.043129:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:0.0:1789997685.043133:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997685.043168:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997685.043176:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d672 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997685.515804:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997686.043593:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997686.043639:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997686.043820:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704531200 00000100:00100000:1.0:1789997686.043830:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704531200 00000100:00100000:1.0:1789997686.043886:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1122 00000100:00100000:1.0:1789997686.043896:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704531200:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997686.043962:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704531200:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 68us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997686.043969:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1122 00000100:00100000:0.0:1789997686.044064:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704531328 00000100:00100000:0.0:1789997686.044068:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704531328 00000100:00100000:0.0:1789997686.044117:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1369 00000100:00100000:0.0:1789997686.044124:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704531328:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997686.044155:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704531328:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997686.044161:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1369 00000100:00080000:1.0:1789997686.044396:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997686.219302:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997686.219335:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713016832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997686.219403:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997686.219465:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713016832 00000100:00100000:2.0:1789997686.219473:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713016832 00000100:00100000:2.0:1789997686.219521:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1789997686.219531:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713016832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997686.219563:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997686.219611:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713016832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997686.219619:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:2.0:1789997686.219694:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713016832:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997686.219997:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997686.226416:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997686.226438:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713016960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997686.226606:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997686.226682:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713016960 00000100:00100000:1.0:1789997686.226690:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713016960 00000100:00100000:1.0:1789997686.226743:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1789997686.226753:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713016960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997686.226785:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997686.226830:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713016960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997686.226837:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00080000:1.0:1789997686.226871:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997686.226905:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713016960:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789997686.285112:0:89434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe9009ef60 20000000:00000080:2.0:1789997686.285130:0:89434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb16b800 uarg=0000000000000000 00010000:00010000:2.0:1789997686.285620:0:89434:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789997686.285933:0:89434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:2.0:1789997686.285938:0:89434:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997686.285950:0:89434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d64f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef12 expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997686.285980:0:89434:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789997686.285999:0:89434:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997686.286014:0:89434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997686.286026:0:89434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d63a expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997686.286034:0:89434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997686.286071:0:89434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d63a expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997686.286085:0:89434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d63a expref: 18 pid: 5805 timeout: 2024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997686.286099:0:89434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89434:1876946713017088:0@lo:104: 00000100:00100000:2.0:1789997686.286159:0:89434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997686.286486:0:89434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59540 going to sleep for 11 seconds 00000100:00100000:1.0:1789997686.287194:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713017088 00000100:00100000:1.0:1789997686.287203:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713017088 00000100:00100000:2.0:1789997686.287303:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789997686.287324:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:89434:x1876946713017088:12345-0@lo:104: 00010000:00010000:2.0:1789997686.287338:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997686.287414:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997686.287421:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:89434:x1876946713017088:12345-0@lo:104: Request processed in 99us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997686.287431:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789997686.287513:0:89434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89434:1876946713017088:0@lo:104: 00010000:00010000:1.0:1789997686.287534:0:89434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287565:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997686.287572:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287580:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997686.287584:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287591:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997686.287598:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997686.287603:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997686.287644:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287650:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997686.287695:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287702:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d63a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d641 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287724:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997686.287726:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997686.287728:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997686.287741:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713017216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997686.287774:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997686.287818:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713017216 00000100:00100000:3.0:1789997686.287823:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713017216 00010000:00010000:3.0:1789997686.287842:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d63a expref: 19 pid: 5805 timeout: 2024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997686.287863:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789997686.287869:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713017216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997686.287879:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997686.287885:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d63a expref: 19 pid: 5805 timeout: 2024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287894:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d63a expref: 19 pid: 5805 timeout: 2024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287906:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592d641 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d63a expref: 19 pid: 5805 timeout: 2024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287919:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287926:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287939:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287944:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287948:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287953:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287956:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997686.287959:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.287964:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997686.289135:0:89434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.289140:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997686.289148:0:89434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997686.289151:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997686.289153:0:89434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592d679 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997686.289361:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713017216:12345-0@lo:103:ldlm_bl.0 Request processed in 1490us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997686.289370:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1789997686.289440:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713017216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997686.540862:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997687.435812:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997687.435820:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997687.435824:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997687.435884:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997687.435897:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997687.435909:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997687.435937:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713017344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997687.436006:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997687.436062:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789997687.436113:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713017344 00000100:00100000:2.0:1789997687.436121:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713017344 00000100:00100000:2.0:1789997687.436175:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1789997687.436190:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713017344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997687.436203:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997687.436218:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d680 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997687.436240:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d680 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997687.436257:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d680 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997687.436266:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2a00, rc 0) 00000100:00100000:2.0:1789997687.436323:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713017344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997687.436331:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1789997687.436492:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713017344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997687.436507:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997687.436525:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997687.436543:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997687.436547:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997687.436554:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997687.565404:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997688.587351:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997689.290956:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713017728:0@lo:400:kworker.0 00000100:00100000:3.0:1789997689.291033:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997689.291113:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997689.291120:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713017856:0@lo:400:kworker.0 00000100:00100000:3.0:1789997689.291146:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997689.291182:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713017728 00000100:00100000:3.0:1789997689.291190:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713017728 00000100:00100000:3.0:1789997689.291243:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1789997689.291264:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713017728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997689.291315:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713017728:12345-0@lo:400:kworker.0 Request processed in 54us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997689.291322:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1789997689.291344:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713017856 00000100:00100000:3.0:1789997689.291347:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713017856 00000100:00100000:3.0:1789997689.291375:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:3.0:1789997689.291383:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713017856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997689.291425:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713017856:12345-0@lo:400:kworker.0 Request processed in 31us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997689.291431:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00080000:3.0:1789997689.291449:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997689.291453:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997689.291896:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713017472:0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.291933:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997689.291970:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713017984:0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.291992:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997689.292013:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789997689.292019:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713017600:0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.292040:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997689.292058:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713018112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.292091:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997689.292115:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713017984 00000100:00100000:0.0:1789997689.292119:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713017984 00000100:00100000:0.0:1789997689.292154:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1789997689.292160:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713017984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.292207:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713017984:12345-0@lo:400:kworker.0 Request processed in 48us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997689.292214:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1789997689.292231:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713017600 00000100:00100000:0.0:1789997689.292234:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713017600 00000100:00100000:0.0:1789997689.292269:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713018112 00000100:00100000:0.0:1789997689.292272:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713018112 00000100:00100000:0.0:1789997689.292293:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1789997689.292299:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713017600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.292329:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713017600:12345-0@lo:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997689.292339:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:0.0:1789997689.292351:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1789997689.292357:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713018112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.292384:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713018112:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997689.292395:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00080000:0.0:1789997689.292416:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997689.292419:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997689.292441:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713017600:0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.292449:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713018112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997689.292457:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713017984:0@lo:400:kworker.0 00000100:00100000:2.0:1789997689.293076:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713017472 00000100:00100000:2.0:1789997689.293086:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713017472 00000100:00100000:2.0:1789997689.293130:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1789997689.293137:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713017472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997689.293183:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713017472:12345-0@lo:400:kworker.0 Request processed in 47us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997689.293190:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1789997689.293576:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713017472:0@lo:400:kworker.0 00000100:00100000:3.0:1789997689.294588:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713017856:0@lo:400:kworker.0 00000100:00100000:3.0:1789997689.294611:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713017728:0@lo:400:kworker.0 00010000:00010000:2.0:1789997689.611050:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997690.588408:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997690.589515:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704531456 00000100:00100000:1.0:1789997690.589528:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704531456 00000100:00100000:1.0:1789997690.589598:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 971 00000100:00100000:1.0:1789997690.589609:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:52981:x1876946704531456:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997690.589631:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997690.589675:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d68e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef20 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.589753:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.589768:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.589782:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.589795:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.589802:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.589809:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590101:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d6a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590110:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590117:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997690.590147:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:1.0:1789997690.590151:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997690.590320:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590332:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590338:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590345:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590351:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997690.590355:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590364:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590389:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997690.590392:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997690.590396:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590403:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590413:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590423:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590429:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590434:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997690.590437:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590443:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590449:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38e062d500) 00010000:00010000:1.0:1789997690.590452:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997690.590454:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590460:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d69c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590488:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592d68e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef20 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590504:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef20 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.590511:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997690.590514:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997690.590516:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997690.590582:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52981:x1876946704531456:12345-192.168.204.4@tcp:101:touch.0 Request processed in 974us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997690.590588:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 971 00000100:00080000:0.0:1789997690.593515:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997690.602847:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997690.603046:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704531712 00000100:00100000:1.0:1789997690.603056:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704531712 00000100:00100000:1.0:1789997690.603116:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 972 00000100:00100000:1.0:1789997690.603127:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:52981:x1876946704531712:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997690.603147:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997690.603178:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d6aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef27 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.603463:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.603479:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.603490:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.603504:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.603511:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.603518:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997690.605967:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:1.0:1789997690.606311:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d6bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606327:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d6bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606339:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d6bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606933:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606944:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606951:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606957:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997690.606962:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606970:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606984:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997690.606987:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997690.606993:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.606999:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d6b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997690.607018:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040735391 reply state 0000000029f06dcb transno 4294967670 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997690.607026:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997690.607063:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592d6aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef27 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.607077:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d6bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef27 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.607084:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:1.0:1789997690.607086:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997690.607088:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789997690.607909:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:52981:x1876946704531712:12345-192.168.204.4@tcp:101:touch.0 Request processed in 4781us (5069us total) trans 4294967670 rc 0/0 00000100:00100000:1.0:1789997690.607919:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 972 00010000:00010000:2.0:1789997690.621216:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.621246:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.621254:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.621261:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997690.621266:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.621275:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.621292:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38e062d900) 00010000:00010000:2.0:1789997690.621295:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997690.621300:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.621305:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d6b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997690.627812:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997690.628062:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704531968 00000100:00100000:2.0:1789997690.628072:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704531968 00000100:00100000:2.0:1789997690.628132:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 973 00000100:00100000:2.0:1789997690.628143:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:52981:x1876946704531968:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:2.0:1789997690.628207:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997690.628245:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592d6bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef27 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.628261:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:2.0:1789997690.628272:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997690.628314:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.628327:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.628337:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997690.628711:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e11caa4 reply state 00000000a7408b5b transno 4294967671 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997690.628721:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997690.630116:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:52981:x1876946704531968:12345-192.168.204.4@tcp:36:touch.0 Request processed in 1970us (2309us total) trans 4294967671 rc 0/0 00000100:00100000:2.0:1789997690.630126:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 973 00010000:00010000:0.0:1789997690.642773:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997690.642797:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.642809:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.642816:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.642822:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997690.642827:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.642846:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.642863:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:0.0:1789997690.642866:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997690.642871:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.642877:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592d6cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997690.665203:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997690.665257:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704532096 00000100:00100000:0.0:1789997690.665268:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704532096 00000100:00100000:0.0:1789997690.665319:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 974 00000100:00100000:0.0:1789997690.665329:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:52981:x1876946704532096:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997690.665356:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997690.665378:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d6d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef2e expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.665439:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d6d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef2e expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.665462:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d6d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef2e expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.665480:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997690.665483:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789997690.665487:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997690.665544:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:52981:x1876946704532096:12345-192.168.204.4@tcp:101:touch.0 Request processed in 217us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997690.665551:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 974 00000100:00100000:1.0:1789997690.673028:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997690.673063:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704532224 00000100:00100000:1.0:1789997690.673074:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704532224 00000100:00100000:1.0:1789997690.673112:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 517 00000100:00100000:1.0:1789997690.673120:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876946704532224:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:1.0:1789997690.673162:0:6656:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1879 last 0 00000020:00000080:1.0:1789997690.673195:0:6656:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592d6db 00002000:00100000:1.0:1789997690.673207:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a37c6ec1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789997690.673241:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789997690.673952:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789997690.673986:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789997690.674067:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704532224:12345-192.168.204.4@tcp:8:touch.0 Request processed in 946us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997690.674077:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 517 00000100:00100000:2.0:1789997690.702324:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997690.702741:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704532352 00000100:00100000:3.0:1789997690.702753:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704532352 00000100:00100000:3.0:1789997690.702822:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 518 00000100:00100000:3.0:1789997690.702842:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:0:x1876946704532352:12345-192.168.204.4@tcp:2:touch.0 00000100:00080000:2.0:1789997690.703687:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1789997690.788059:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000001:00080000:1.0:1789997690.788080:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967358 is committed 00000100:00100000:3.0:1789997690.788612:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:0:x1876946704532352:12345-192.168.204.4@tcp:2:touch.0 Request processed in 85767us (86291us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1789997690.788623:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 518 00000100:00100000:0.0:1789997690.796141:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997690.796277:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704532608 00000100:00100000:3.0:1789997690.796287:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704532608 00000100:00100000:3.0:1789997690.796345:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:3.0:1789997690.796356:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:52981:x1876946704532608:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:3.0:1789997690.797139:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:52981:x1876946704532608:12345-192.168.204.4@tcp:35:touch.0 Request processed in 782us (1006us total) trans 4294967672 rc 0/0 00000100:00100000:3.0:1789997690.797158:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 100 00000100:00100000:2.0:1789997690.878295:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997690.878602:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704532736 00000100:00100000:0.0:1789997690.878613:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704532736 00000100:00100000:0.0:1789997690.878710:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 975 00000100:00100000:0.0:1789997690.878720:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:52985:x1876946704532736:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997690.878744:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997690.878766:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d6e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef35 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.878830:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.878846:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.878858:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.878873:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.878880:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.878887:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.878977:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d6f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.878986:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879285:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997690.879320:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 0 00000004:00200000:0.0:1789997690.879324:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997690.879343:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879354:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879361:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879366:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879372:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879376:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997690.879381:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879520:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879533:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:0.0:1789997690.879536:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997690.879541:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879547:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d6e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879568:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879575:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879581:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879586:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997690.879590:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879595:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879603:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38c28e9600) 00010000:00010000:0.0:1789997690.879605:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997690.879607:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879612:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d6f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879647:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d6e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef35 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879753:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef35 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.879760:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997690.879762:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997690.879765:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997690.879833:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:52985:x1876946704532736:12345-192.168.204.4@tcp:101:rm.0 Request processed in 1114us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997690.879841:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 975 00000100:00100000:0.0:1789997690.895034:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997690.895584:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704532864 00000100:00100000:1.0:1789997690.895596:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704532864 00000100:00100000:1.0:1789997690.895680:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 519 00000100:00100000:1.0:1789997690.895691:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704532864:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997690.895709:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997690.895730:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef3c expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997690.895757:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x6ab1327a, atime: 0x6ab1327a, ctime: 0x6ab1327a, blocks: 0x1 00010000:00010000:1.0:1789997690.895786:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=1879s v=(0 0) 00010000:00010000:1.0:1789997690.895792:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997690.895801:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.895821:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 6 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997690.895842:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997690.897686:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704532864:12345-192.168.204.4@tcp:101:rm.0 Request processed in 1988us (2652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997690.897697:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 519 00000100:00100000:1.0:1789997690.905697:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997690.905801:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704533120 00000100:00100000:0.0:1789997690.905811:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704533120 00000100:00100000:0.0:1789997690.905879:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 976 00000100:00100000:0.0:1789997690.905890:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:52985:x1876946704533120:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789997690.905942:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997690.905968:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d6f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef35 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906015:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d6d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef2e expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906026:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997690.906037:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997690.906060:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906073:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906084:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906098:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906104:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906111:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906231:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906240:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906248:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789997690.906837:0:12471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].31, 64 off10176 00000004:00080000:0.0:1789997690.906848:0:12471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1879599193863ns, next at 1880599191638ns, rc = 0 00010000:00010000:0.0:1789997690.906901:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906911:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906919:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906926:0:12471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906932:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906939:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906963:0:12471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997690.906983:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906990:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.906995:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907000:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997690.907003:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907009:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907017:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997690.907020:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997690.907024:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907030:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d713 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907047:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907055:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907061:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907066:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997690.907069:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907074:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907081:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:0.0:1789997690.907084:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997690.907087:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997690.907093:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d705 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997690.907102:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004684ce3 reply state 00000000106b63e4 transno 4294967673 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997690.907115:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997690.907188:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:52985:x1876946704533120:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1298us (1499us total) trans 4294967673 rc 0/0 00000100:00100000:0.0:1789997690.907197:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 976 00010000:00010000:3.0:1789997690.907941:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997690.907950:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997690.907959:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997690.907962:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997690.907969:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997690.907981:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:3.0:1789997690.907984:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997690.907988:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997690.907993:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d71a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x50:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997690.908013:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997690.908015:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997690.908017:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997690.912088:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.912106:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.912114:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.912119:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997690.912123:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.912130:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.912145:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38c28e9600) 00010000:00010000:2.0:1789997690.912157:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997690.912161:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997690.912167:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d70c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997691.161837:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997691.161886:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997691.161926:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997691.161988:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704533248 00000100:00100000:3.0:1789997691.161999:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704533248 00000100:00100000:3.0:1789997691.162062:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1125 00000100:00100000:3.0:1789997691.162073:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704533248:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997691.162142:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704533248:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997691.162153:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1125 00000100:00100000:0.0:1789997691.162246:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704533504 00000100:00100000:0.0:1789997691.162250:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704533504 00000100:00100000:0.0:1789997691.162300:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 904 00000100:00100000:0.0:1789997691.162308:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704533504:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997691.162339:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704533504:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997691.162345:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 904 00000100:00100000:0.0:1789997691.162364:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704533376 00000100:00100000:0.0:1789997691.162368:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704533376 00000100:00100000:0.0:1789997691.162393:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1373 00000100:00100000:0.0:1789997691.162400:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2353:x1876946704533376:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997691.162432:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2353:x1876946704533376:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997691.162438:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1373 00000100:00100000:2.0:1789997691.341283:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713018240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997691.341355:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997691.341429:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713018240 00000100:00100000:2.0:1789997691.343051:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713018240 00000100:00100000:2.0:1789997691.343591:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:2.0:1789997691.343603:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713018240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997691.343629:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997691.343719:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713018240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (2364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997691.343735:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00080000:3.0:1789997691.343790:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997691.345331:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713018368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997691.345392:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997691.350903:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713018240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997691.352587:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713018368 00000100:00100000:1.0:1789997691.352600:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713018368 00000100:00100000:1.0:1789997691.352680:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1789997691.352690:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713018368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997691.352737:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997691.352808:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713018368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (7415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997691.352825:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00080000:3.0:1789997691.353066:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997691.353109:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713018368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789997691.659724:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997692.682819:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997693.370112:0:89680:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2dbd55b0 20000000:00000080:3.0:1789997693.370133:0:89680:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd8f0000 uarg=0000000000000000 00010000:00010000:3.0:1789997693.371244:0:89680:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997693.373394:0:89680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:3.0:1789997693.374095:0:89680:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997693.374108:0:89680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d6a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef20 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.374140:0:89680:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997693.374180:0:89680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997693.374196:0:89680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.374211:0:89680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d680 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.374219:0:89680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.375913:0:89680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d680 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.375939:0:89680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d680 expref: 18 pid: 5803 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997693.375953:0:89680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89680:1876946713018496:0@lo:104: 00000100:00100000:3.0:1789997693.376022:0:89680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997693.376121:0:89680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e09b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1789997693.386570:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713018496 00000100:00100000:0.0:1789997693.386586:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713018496 00000100:00100000:2.0:1789997693.396589:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789997693.396603:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:89680:x1876946713018496:12345-0@lo:104: 00010000:00010000:2.0:1789997693.396623:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997693.396957:0:89680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89680:1876946713018496:0@lo:104: 00010000:00010000:0.0:1789997693.396982:0:89680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997693.397063:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997693.397070:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:89680:x1876946713018496:12345-0@lo:104: Request processed in 470us (21047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997693.397077:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:0.0:1789997693.397239:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997693.397246:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997693.397254:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997693.397259:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997693.397267:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997693.397274:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997693.397279:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997693.397330:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997693.397337:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997693.397359:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997693.397366:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592d680 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d687 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997693.397383:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997693.397385:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997693.397386:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997693.397411:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713018624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997693.397454:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997693.397991:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713018624 00000100:00100000:3.0:1789997693.397999:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713018624 00010000:00010000:3.0:1789997693.398026:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d680 expref: 19 pid: 5803 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997693.398050:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789997693.398056:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713018624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997693.398066:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997693.398071:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d680 expref: 19 pid: 5803 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398079:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d680 expref: 19 pid: 5803 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398093:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2a00/0x65b43101d592d687 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d680 expref: 19 pid: 5803 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398106:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398114:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398143:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398150:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398156:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398162:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398177:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997693.398181:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398188:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398206:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.398214:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997693.398265:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713018624:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997693.398271:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789997693.399814:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713018624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997693.401075:0:89680:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997693.401090:0:89680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997693.401099:0:89680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592d721 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997693.720755:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997694.411026:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713018880:0@lo:400:kworker.0 00000100:00100000:3.0:1789997694.411093:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997694.411141:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713019392:0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414189:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713018752:0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414266:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997694.414313:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713019264:0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414340:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997694.414364:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997694.414371:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713019136:0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414393:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997694.414428:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713018880 00000100:00100000:1.0:1789997694.414436:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713018880 00000100:00100000:1.0:1789997694.414482:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1789997694.414492:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713018880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414542:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713018880:12345-0@lo:400:kworker.0 Request processed in 51us (3448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997694.414549:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1789997694.414571:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713018752 00000100:00100000:1.0:1789997694.414574:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713018752 00000100:00100000:1.0:1789997694.414598:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1789997694.414604:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713018752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414637:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713018752:12345-0@lo:400:kworker.0 Request processed in 33us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997694.414643:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1789997694.414683:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713019264 00000100:00100000:1.0:1789997694.414687:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713019264 00000100:00100000:1.0:1789997694.414719:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713019136 00000100:00100000:1.0:1789997694.414722:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713019136 00000100:00100000:1.0:1789997694.414742:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1789997694.414748:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713019264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414777:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713019264:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997694.414784:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1789997694.414794:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1789997694.414800:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713019136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414826:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713019136:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997694.414831:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1789997694.414874:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713019136:0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414886:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713018752:0@lo:400:kworker.0 00000100:00100000:1.0:1789997694.414895:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713019264:0@lo:400:kworker.0 00000100:00080000:1.0:1789997694.414918:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997694.414921:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997694.419530:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997694.419610:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713018880:0@lo:400:kworker.0 00000100:00100000:3.0:1789997694.419628:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997694.419640:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713019008:0@lo:400:kworker.0 00000100:00100000:3.0:1789997694.419684:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997694.423230:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713019392 00000100:00100000:2.0:1789997694.423245:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713019392 00000100:00100000:2.0:1789997694.423472:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713019008 00000100:00100000:2.0:1789997694.423476:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713019008 00000100:00100000:2.0:1789997694.423646:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1789997694.423808:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713019392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997694.423902:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713019392:12345-0@lo:400:kworker.0 Request processed in 248us (4379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997694.423910:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1789997694.423926:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:2.0:1789997694.423932:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713019008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997694.423956:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713019008:12345-0@lo:400:kworker.0 Request processed in 25us (4272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997694.423962:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00080000:0.0:1789997694.428207:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997694.432133:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713019008:0@lo:400:kworker.0 00000100:00100000:3.0:1789997694.432162:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713019392:0@lo:400:kworker.0 00010000:00010000:2.0:1789997694.749496:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997695.442346:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997695.442353:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997695.442359:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997695.442409:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.442422:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.442434:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997695.442460:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713019520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997695.442529:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997695.442578:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789997695.458108:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713019520 00000100:00100000:3.0:1789997695.458124:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713019520 00000100:00100000:3.0:1789997695.458330:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1789997695.459535:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713019520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997695.459553:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997695.459595:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d728 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997695.459725:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d728 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997695.459751:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d728 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997695.459760:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789997695.459856:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713019520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 345us (17328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997695.459864:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1789997695.465106:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713019520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997695.465150:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.465163:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997695.465186:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997695.465191:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.465201:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997695.580496:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967673 is committed 00000004:00080000:2.0:1789997695.580510:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 87 committed 00000100:00100000:1.0:1789997695.588781:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997695.588800:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713019648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997695.588861:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997695.588926:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713019648 00000100:00100000:1.0:1789997695.588934:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713019648 00000100:00100000:1.0:1789997695.588976:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:1.0:1789997695.588985:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713019648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789997695.589012:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:31 count 1 00010000:00010000:1.0:1789997695.589036:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.589058:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 5 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.589068:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1789997695.589072:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997695.589078:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.589108:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 5 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.589122:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 5 pid: 6656 timeout: 1984 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997695.589155:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946713019776:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997695.589210:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59480 going to sleep for 11 seconds 00000100:00100000:1.0:1789997695.599271:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997695.599302:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704533632 00000100:00100000:1.0:1789997695.599311:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704533632 00010000:00010000:1.0:1789997695.599356:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 6 pid: 6656 timeout: 1984 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997695.599391:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 396 00000100:00100000:1.0:1789997695.599401:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704533632:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997695.599417:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997695.599423:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 6 pid: 6656 timeout: 1984 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.599437:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 6 pid: 6656 timeout: 1984 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.599463:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997695.599467:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997695.599473:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.599483:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.599508:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997695.599550:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704533632:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 150us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997695.599557:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 396 00000100:00080000:1.0:1789997695.599603:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997695.608461:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9bac850/0x65b43101d592d6fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef3c expref: 5 pid: 6656 timeout: 1984 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997695.608487:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946713019776:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997695.608511:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.618447:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.618471:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.618484:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.618492:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997695.618523:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789997695.619164:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713019648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30177us (30299us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1789997695.619175:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000004:00080000:1.0:1789997695.619225:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38c3533800/2, rc 0, transno 4294967359 00000100:00100000:1.0:1789997695.619231:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713019648:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789997695.620927:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997695.620940:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997695.620955:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997695.620960:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997695.620972:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997695.620994:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997695.621002:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067114deb/0x65b43101d592d736 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997695.621027:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997695.621029:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997695.621031:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997695.756628:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997696.084614:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967359 is committed 00000100:00100000:0.0:1789997696.289060:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997696.289098:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997696.289135:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997696.289165:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704533888 00000100:00100000:0.0:1789997696.289174:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704533888 00000100:00100000:0.0:1789997696.289245:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1377 00000100:00100000:0.0:1789997696.289257:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704533888:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997696.289348:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704533888:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997696.289362:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1377 00000100:00100000:0.0:1789997696.289393:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704533760 00000100:00100000:0.0:1789997696.289396:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704533760 00000100:00100000:0.0:1789997696.289426:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1128 00000100:00100000:0.0:1789997696.289432:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704533760:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997696.289461:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704533760:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997696.289476:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1128 00000100:00100000:0.0:1789997696.289507:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704534016 00000100:00100000:0.0:1789997696.289511:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704534016 00000100:00100000:0.0:1789997696.289542:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 907 00000100:00080000:3.0:1789997696.290720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997696.291839:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704534016:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997696.291965:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704534016:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2409us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997696.291976:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 907 00000100:00100000:0.0:1789997696.459737:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997696.459759:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713019904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997696.459824:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997696.460579:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713019904 00000100:00100000:1.0:1789997696.460588:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713019904 00000100:00100000:1.0:1789997696.460675:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1789997696.460685:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713019904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997696.460719:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997696.460770:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713019904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997696.460777:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1789997696.461421:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713019904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997696.461956:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997696.464183:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713020032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997696.464244:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997696.464704:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713020032 00000100:00100000:1.0:1789997696.464713:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713020032 00000100:00100000:1.0:1789997696.464768:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1789997696.464777:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713020032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997696.464809:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789997696.467782:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997696.474481:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713020032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9696us (10227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997696.474494:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1789997696.474622:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:0.0:1789997696.474628:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38c3533800, transno 4294967359 00000100:00100000:0.0:1789997696.474675:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713020032:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997696.780934:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997697.805691:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997698.261641:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997698.261796:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704534144 00000100:00100000:1.0:1789997698.261807:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704534144 00000100:00100000:1.0:1789997698.261880:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 977 00000100:00100000:1.0:1789997698.261890:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53073:x1876946704534144:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997698.261908:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997698.261931:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d73d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997698.262006:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d744 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997698.262021:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997698.262038:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997698.262070:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:1.0:1789997698.262085:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997698.262103:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d744 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997698.262126:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d73d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef43 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997698.262146:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d744 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef43 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997698.262154:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997698.262157:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997698.262160:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997698.262209:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53073:x1876946704534144:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 321us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997698.262216:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 977 00000100:00080000:3.0:1789997698.263474:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997698.265357:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997698.265614:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704534400 00000100:00100000:3.0:1789997698.265716:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704534400 00000100:00100000:3.0:1789997698.265768:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 978 00000100:00100000:3.0:1789997698.265778:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53073:x1876946704534400:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997698.265835:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997698.265859:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d744 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef43 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997698.265876:0:11799:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592d6a3) 00010000:00010000:3.0:1789997698.265880:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:3.0:1789997698.265892:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997698.265915:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997698.265928:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997698.265938:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997698.357479:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967674 is committed 00000004:00010000:3.0:1789997698.357611:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ccce6dd5 reply state 000000009f58fb59 transno 4294967674 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997698.357636:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997698.357758:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00080000:3.0:1789997698.357852:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997698.357870:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53073:x1876946704534400:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 92089us (92516us total) trans 4294967674 rc 0/0 00000100:00100000:3.0:1789997698.357879:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 978 00010000:00010000:0.0:1789997698.363566:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997698.363585:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997698.363592:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997698.363599:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997698.363604:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997698.363611:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997698.363642:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:0.0:1789997698.363646:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997698.363650:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997698.363691:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592d74b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997698.827131:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997699.531409:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713020416:0@lo:400:kworker.0 00000100:00100000:0.0:1789997699.531484:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997699.532832:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713020160:0@lo:400:kworker.0 00000100:00100000:1.0:1789997699.532897:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997699.532947:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713020672:0@lo:400:kworker.0 00000100:00100000:1.0:1789997699.532975:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997699.533002:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789997699.533009:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713020288:0@lo:400:kworker.0 00000100:00100000:1.0:1789997699.533043:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713020160 00000100:00100000:1.0:1789997699.533063:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713020160 00000100:00100000:1.0:1789997699.533112:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1789997699.533120:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997699.533174:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713020160:12345-0@lo:400:kworker.0 Request processed in 54us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997699.533182:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1789997699.533216:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713020672 00000100:00100000:1.0:1789997699.533220:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713020672 00000100:00100000:1.0:1789997699.533257:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1789997699.533264:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997699.533297:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713020672:12345-0@lo:400:kworker.0 Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997699.533303:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00080000:1.0:1789997699.533322:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997699.533366:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713020544:0@lo:400:kworker.0 00000100:00100000:1.0:1789997699.533391:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997699.533423:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713020544 00000100:00100000:1.0:1789997699.533426:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713020544 00000100:00100000:1.0:1789997699.533457:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:1.0:1789997699.533463:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997699.533496:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713020544:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997699.533502:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00080000:1.0:1789997699.533517:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997699.533543:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713020544:0@lo:400:kworker.0 00000100:00100000:0.0:1789997699.533860:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713020416 00000100:00100000:0.0:1789997699.533866:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713020416 00000100:00100000:0.0:1789997699.533902:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:0.0:1789997699.533910:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713020416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997699.533948:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713020416:12345-0@lo:400:kworker.0 Request processed in 39us (2465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997699.533954:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00080000:0.0:1789997699.533972:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997699.533996:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997699.534066:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713020800:0@lo:400:kworker.0 00000100:00100000:0.0:1789997699.534095:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997699.534119:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713020160:0@lo:400:kworker.0 00000100:00100000:0.0:1789997699.534131:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713020672:0@lo:400:kworker.0 00000100:00100000:0.0:1789997699.534155:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713020288 00000100:00100000:0.0:1789997699.534159:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713020288 00000100:00100000:0.0:1789997699.534183:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713020800 00000100:00100000:0.0:1789997699.534185:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713020800 00000100:00100000:0.0:1789997699.534210:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1789997699.534217:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713020288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997699.534251:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713020288:12345-0@lo:400:kworker.0 Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997699.534257:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1789997699.534268:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1789997699.534274:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c8776c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713020800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997699.534299:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c8776c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713020800:12345-0@lo:400:kworker.0 Request processed in 26us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997699.534304:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1789997699.544022:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713020416:0@lo:400:kworker.0 00000100:00080000:1.0:1789997699.544077:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997699.544103:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713020288:0@lo:400:kworker.0 00000100:00100000:1.0:1789997699.544115:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713020800:0@lo:400:kworker.0 00000020:00000080:2.0:1789997699.568634:0:89878:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7307c7e0 20000000:00000080:2.0:1789997699.568842:0:89878:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa6400 uarg=0000000000000000 00010000:00010000:2.0:1789997699.569445:0:89878:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997699.569461:0:89878:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997699.569475:0:89878:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997699.569493:0:89878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997699.569509:0:89878:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d728 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997699.569517:0:89878:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997699.569556:0:89878:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d728 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997699.569577:0:89878:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d728 expref: 18 pid: 5803 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997699.569590:0:89878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89878:1876946713020928:0@lo:104: 00000100:00100000:2.0:1789997699.569650:0:89878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997699.569725:0:89878:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d10a76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997699.569765:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713020928 00000100:00100000:1.0:1789997699.569772:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713020928 00000100:00100000:1.0:1789997699.569817:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1789997699.569827:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:89878:x1876946713020928:12345-0@lo:104: 00010000:00010000:1.0:1789997699.569840:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997699.569904:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997699.569911:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:89878:x1876946713020928:12345-0@lo:104: Request processed in 85us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997699.569918:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00010000:00010000:3.0:1789997699.570114:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997699.570121:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570134:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997699.570138:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570146:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997699.570154:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997699.570159:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997699.570193:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570199:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997699.570219:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570225:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592d728 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d72f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570240:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997699.570242:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997699.570243:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997699.570254:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713021056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997699.570282:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997699.570301:0:89878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89878:1876946713020928:0@lo:104: 00000100:00100000:3.0:1789997699.570316:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713021056 00010000:00010000:2.0:1789997699.570318:0:89878:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997699.570319:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713021056 00010000:00010000:3.0:1789997699.570336:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d728 expref: 19 pid: 5803 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997699.570366:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789997699.570373:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713021056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997699.570383:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997699.570387:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d728 expref: 19 pid: 5803 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570397:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d728 expref: 19 pid: 5803 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570409:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592d72f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d728 expref: 19 pid: 5803 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570422:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570429:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570441:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570448:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570455:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570461:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570470:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997699.570475:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.570482:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997699.576390:0:89878:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997699.576407:0:89878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.579850:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.579870:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592d752 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997699.579894:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997699.581188:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713021056:12345-0@lo:103:ldlm_bl.0 Request processed in 10809us (10898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997699.581271:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789997699.581576:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713021056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997699.851009:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997700.690890:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997700.690896:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997700.690900:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997700.690949:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997700.690960:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997700.690970:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997700.691078:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713021184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997700.691148:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997700.691289:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713021184 00000100:00100000:0.0:1789997700.691299:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713021184 00000100:00100000:0.0:1789997700.691355:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1789997700.691365:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713021184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997700.691378:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997700.691392:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d759 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997700.691421:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d759 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997700.691431:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d759 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997700.691440:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997700.691478:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713021184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997700.691484:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1789997700.691619:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3f84c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997700.691640:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713021184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997700.691727:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997700.691737:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997700.691755:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997700.691760:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997700.691768:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997700.875527:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997701.412948:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997701.412984:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997701.413037:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997701.413070:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704534656 00000100:00100000:1.0:1789997701.413080:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704534656 00000100:00100000:1.0:1789997701.413142:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1381 00000100:00100000:1.0:1789997701.413152:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704534656:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997701.413230:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704534656:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997701.413237:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1381 00000100:00080000:1.0:1789997701.413259:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997701.413445:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704534784 00000100:00100000:0.0:1789997701.413450:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704534784 00000100:00100000:0.0:1789997701.413492:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 910 00000100:00100000:0.0:1789997701.413500:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704534784:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997701.413538:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704534784:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997701.413545:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 910 00000100:00080000:1.0:1789997701.413616:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997701.413854:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704534528 00000100:00100000:3.0:1789997701.413859:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704534528 00000100:00100000:3.0:1789997701.413929:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1131 00000100:00100000:3.0:1789997701.413937:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704534528:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997701.413980:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704534528:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997701.413996:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1131 00000100:00100000:3.0:1789997701.581486:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713021312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997701.581551:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997701.581695:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713021312 00000100:00100000:1.0:1789997701.581704:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713021312 00000100:00100000:1.0:1789997701.581769:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1789997701.581778:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713021312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997701.581816:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997701.581874:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713021312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997701.581880:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00080000:3.0:1789997701.582724:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997701.582765:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713021312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997701.599684:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713021440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997701.599757:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997701.599888:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713021440 00000100:00100000:3.0:1789997701.599897:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713021440 00000100:00100000:3.0:1789997701.599951:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1789997701.599961:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713021440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997701.599995:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997701.600051:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713021440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997701.600059:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1789997701.600105:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713021440:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997701.600124:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789997701.900090:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997702.773958:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997702.774075:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704534912 00000100:00100000:2.0:1789997702.774085:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704534912 00000100:00100000:2.0:1789997702.774177:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 979 00000100:00100000:2.0:1789997702.774187:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53150:x1876946704534912:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997702.774209:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997702.774306:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d767 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef4a expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774384:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774398:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774411:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774438:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774445:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774450:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774963:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d77c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774974:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.774981:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997702.775016:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:2.0:1789997702.775020:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997702.775038:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775050:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775057:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775068:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775073:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997702.775078:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775085:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775097:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997702.775100:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997702.775104:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775109:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d76e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775120:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775127:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775133:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775138:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997702.775141:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775150:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775157:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38d0bdfb00) 00010000:00010000:2.0:1789997702.775159:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997702.775161:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775167:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d775 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775196:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d767 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef4a expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775213:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d77c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef4a expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997702.775220:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997702.775222:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997702.775225:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997702.775333:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53150:x1876946704534912:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1146us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997702.775341:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 979 00000100:00100000:0.0:1789997702.779114:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997702.779193:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704535168 00000100:00100000:1.0:1789997702.779204:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704535168 00000100:00100000:1.0:1789997702.779256:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 980 00000100:00100000:1.0:1789997702.779266:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53150:x1876946704535168:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997702.779286:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997702.779307:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d783 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef51 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779384:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779398:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779409:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779424:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779435:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779442:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997702.779454:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:1.0:1789997702.779473:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779480:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779486:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779491:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997702.779495:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779502:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779514:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:1.0:1789997702.779517:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997702.779521:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779527:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d78a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779542:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779548:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779553:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779557:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997702.779560:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779566:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779573:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38e062db00) 00010000:00010000:1.0:1789997702.779576:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997702.779578:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779584:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d791 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779628:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d783 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef51 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779639:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:1.0:1789997702.779642:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997702.779646:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d783 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef51 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.779899:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997702.780101:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53150:x1876946704535168:12345-192.168.204.4@tcp:101:touch.0 Request processed in 721us (881us total) trans 0 rc 301/301 00000100:00100000:1.0:1789997702.780109:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 980 00000100:00100000:1.0:1789997702.783461:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997702.783546:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704535296 00000100:00100000:0.0:1789997702.783554:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704535296 00000100:00100000:0.0:1789997702.783619:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 981 00000100:00100000:0.0:1789997702.783630:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53150:x1876946704535296:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997702.783647:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997702.783826:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d798 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef58 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783896:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783911:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783922:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783938:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783945:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783950:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783969:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783975:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.783982:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784006:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997702.784011:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784022:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784033:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:0.0:1789997702.784035:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997702.784040:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784046:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d79f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784079:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784085:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784091:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784095:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997702.784097:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784102:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784109:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38c28e9200) 00010000:00010000:0.0:1789997702.784112:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997702.784115:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784124:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d7a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784231:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d798 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef58 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784242:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:0.0:1789997702.784244:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997702.784247:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592d798 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef58 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997702.784258:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789997702.784323:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53150:x1876946704535296:12345-192.168.204.4@tcp:101:touch.0 Request processed in 694us (869us total) trans 0 rc 301/301 00000100:00100000:0.0:1789997702.784330:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 981 00000100:00100000:3.0:1789997702.788631:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997702.789917:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704535424 00000100:00100000:1.0:1789997702.789931:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704535424 00000100:00100000:1.0:1789997702.790007:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 982 00000100:00100000:1.0:1789997702.790018:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53150:x1876946704535424:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997702.790038:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997702.790057:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d7ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef5f expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790122:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790137:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790149:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790163:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790170:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790181:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790200:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790207:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790230:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790236:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997702.790240:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790248:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790260:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:1.0:1789997702.790264:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997702.790268:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790275:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d7b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790288:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790294:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790301:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790305:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997702.790308:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790314:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790321:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38e062db00) 00010000:00010000:1.0:1789997702.790323:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997702.790326:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790331:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d7bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790358:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d7ad lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef5f expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790368:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:1.0:1789997702.790370:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997702.790374:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d7ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef5f expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997702.790383:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997702.790563:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53150:x1876946704535424:12345-192.168.204.4@tcp:101:touch.0 Request processed in 546us (1939us total) trans 0 rc 301/301 00000100:00100000:1.0:1789997702.790574:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 982 00010000:00010000:3.0:1789997702.922789:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997703.950518:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997704.271473:0:90122:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff9f40c8c0 20000000:00000080:2.0:1789997704.271492:0:90122:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa6c00 uarg=0000000000000000 00010000:00010000:0.0:1789997704.272933:0:90122:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997704.272983:0:90122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:0.0:1789997704.272987:0:90122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997704.273000:0:90122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d77c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef4a expref: 5 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997704.273024:0:90122:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997704.273040:0:90122:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997704.273056:0:90122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997704.273069:0:90122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d759 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997704.273078:0:90122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997704.273119:0:90122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d759 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997704.273133:0:90122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d759 expref: 18 pid: 5805 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997704.273147:0:90122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90122:1876946713021568:0@lo:104: 00000100:00100000:0.0:1789997704.273212:0:90122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997704.273285:0:90122:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997704.273617:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713021568 00000100:00100000:2.0:1789997704.273627:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713021568 00000100:00100000:2.0:1789997704.273747:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789997704.273757:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:90122:x1876946713021568:12345-0@lo:104: 00010000:00010000:2.0:1789997704.273770:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997704.273947:0:90122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90122:1876946713021568:0@lo:104: 00010000:00010000:0.0:1789997704.273979:0:90122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997704.274017:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997704.274024:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:90122:x1876946713021568:12345-0@lo:104: Request processed in 268us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997704.274031:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00010000:3.0:1789997704.278588:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997704.278602:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.278615:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997704.278619:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.278630:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997704.278642:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997704.278647:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997704.278911:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.278919:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997704.278964:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.278972:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592d759 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d760 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.278990:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997704.278992:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997704.278994:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997704.280070:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997704.280097:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713021696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997704.280181:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997704.280479:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713021696 00000100:00100000:3.0:1789997704.280488:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713021696 00010000:00010000:3.0:1789997704.280525:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d759 expref: 19 pid: 5805 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997704.280568:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789997704.280577:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713021696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997704.280591:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997704.280596:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d759 expref: 19 pid: 5805 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280609:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d759 expref: 19 pid: 5805 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280625:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592d760 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d759 expref: 19 pid: 5805 timeout: 2042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280649:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280683:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280699:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280707:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280713:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280720:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280726:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997704.280730:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280738:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280757:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997704.280772:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997704.280810:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713021696:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997704.280818:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1789997704.280998:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713021696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997704.281027:0:90122:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997704.281035:0:90122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997704.281041:0:90122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592d7c2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997704.651916:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713021952:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652002:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997704.652075:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713022464:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652099:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997704.652123:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789997704.652130:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713021824:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652156:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997704.652179:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713022336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652203:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997704.652227:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713022080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652264:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997704.652283:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997704.652288:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713022208:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652309:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997704.652341:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713021952 00000100:00100000:1.0:1789997704.652349:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713021952 00000100:00100000:1.0:1789997704.652411:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713022464 00000100:00100000:1.0:1789997704.652415:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713022464 00000100:00100000:1.0:1789997704.652442:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713022080 00000100:00100000:1.0:1789997704.652445:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713022080 00000100:00100000:1.0:1789997704.652468:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1789997704.652476:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713021952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652526:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713021952:12345-0@lo:400:kworker.0 Request processed in 49us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997704.652533:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1789997704.652550:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1789997704.652555:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713022464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652582:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713022464:12345-0@lo:400:kworker.0 Request processed in 27us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997704.652588:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:1.0:1789997704.652600:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1789997704.652606:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713022080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652635:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713022080:12345-0@lo:400:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997704.652641:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:1.0:1789997704.652685:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713021824 00000100:00100000:1.0:1789997704.652689:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713021824 00000100:00100000:1.0:1789997704.652714:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789997704.652720:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713021824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652749:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713021824:12345-0@lo:400:kworker.0 Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997704.652755:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1789997704.652780:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713022336 00000100:00100000:1.0:1789997704.652783:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713022336 00000100:00100000:1.0:1789997704.652809:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713022208 00000100:00100000:1.0:1789997704.652812:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713022208 00000100:00100000:1.0:1789997704.652830:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1789997704.652837:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713022336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652866:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713022336:12345-0@lo:400:kworker.0 Request processed in 29us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997704.652872:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1789997704.652883:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1789997704.652889:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713022208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.652912:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713022208:12345-0@lo:400:kworker.0 Request processed in 23us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997704.652917:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00080000:1.0:1789997704.652945:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997704.652961:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997704.652963:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997704.653009:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713022208:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.653020:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713022080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.653047:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713021824:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.653055:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713022336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.653063:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713021952:0@lo:400:kworker.0 00000100:00100000:1.0:1789997704.653072:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713022464:0@lo:400:kworker.0 00010000:00010000:3.0:1789997704.972536:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997705.359412:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997705.359419:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997705.359424:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997705.359467:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997705.359479:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997705.359490:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997705.359514:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713022592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997705.359591:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997705.359971:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8900 going to sleep for 11 seconds 00000100:00100000:3.0:1789997705.360009:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713022592 00000100:00100000:3.0:1789997705.360018:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713022592 00000100:00100000:3.0:1789997705.360089:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1789997705.360099:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713022592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997705.360112:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997705.360125:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d7c9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997705.360148:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997705.360159:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997705.360168:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:2.0:1789997705.360272:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713022592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997705.360290:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997705.360298:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997705.363879:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997705.363897:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997705.363911:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997705.364070:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713022592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3967us (4473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997705.364082:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00010000:00010000:1.0:1789997705.996594:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997706.520307:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997706.520350:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997706.520378:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704535552 00000100:00100000:1.0:1789997706.520383:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997706.520388:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704535552 00000100:00100000:0.0:1789997706.520443:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1134 00000100:00100000:0.0:1789997706.520454:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704535552:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997706.520535:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704535552:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997706.520541:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1134 00000100:00100000:2.0:1789997706.520605:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704535808 00000100:00100000:2.0:1789997706.520610:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704535808 00000100:00100000:2.0:1789997706.520679:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 913 00000100:00100000:2.0:1789997706.520688:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704535808:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997706.520719:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704535808:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997706.520725:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 913 00000100:00080000:0.0:1789997706.520794:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997706.520969:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704535680 00000100:00100000:3.0:1789997706.520974:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704535680 00000100:00100000:3.0:1789997706.521023:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1385 00000100:00080000:0.0:1789997706.521027:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997706.521032:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704535680:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997706.521066:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704535680:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997706.521072:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1385 00000100:00100000:2.0:1789997706.702011:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713022720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997706.702081:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997706.702149:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997706.702156:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713022848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997706.702179:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997706.702505:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713022720 00000100:00100000:0.0:1789997706.702515:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713022720 00000100:00100000:0.0:1789997706.702588:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713022848 00000100:00100000:0.0:1789997706.702593:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713022848 00000100:00100000:0.0:1789997706.702619:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1789997706.702628:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713022720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997706.702688:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997706.702745:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713022720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997706.702753:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1789997706.702772:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1789997706.702779:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713022848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997706.702799:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997706.702827:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713022848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997706.702833:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00080000:2.0:1789997706.702970:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997706.702974:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997706.703018:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713022848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997706.703034:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713022720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997706.803996:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997706.804828:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704535936 00000100:00100000:3.0:1789997706.804841:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704535936 00000100:00100000:3.0:1789997706.804923:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 983 00000100:00100000:3.0:1789997706.804936:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53236:x1876946704535936:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997706.804959:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997706.804984:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d7d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef66 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997706.805052:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d7de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997706.805068:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997706.805083:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997706.805117:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:3.0:1789997706.805121:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997706.805140:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d7de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997706.805166:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592d7d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef66 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997706.805192:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d7de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef66 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997706.805201:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49e300) 00010000:00010000:3.0:1789997706.805204:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997706.805207:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997706.805264:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53236:x1876946704535936:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 332us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997706.805271:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 983 00000100:00100000:3.0:1789997706.810265:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997706.810589:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704536192 00000100:00100000:1.0:1789997706.810601:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704536192 00000100:00100000:1.0:1789997706.810687:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 984 00000100:00100000:1.0:1789997706.810699:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53236:x1876946704536192:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997706.810749:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997706.810783:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592d7de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef66 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.810803:0:6536:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592d77c) 00010000:00010000:1.0:1789997706.810808:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49e300) 00010000:00010000:1.0:1789997706.810823:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997706.810853:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.810868:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.810879:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997706.811256:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2f5300a reply state 0000000005535c31 transno 4294967675 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997706.811266:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997706.811275:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000100:00100000:1.0:1789997706.811367:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53236:x1876946704536192:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 670us (1110us total) trans 4294967675 rc 0/0 00000100:00100000:1.0:1789997706.811376:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 984 00010000:00010000:1.0:1789997706.813213:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.813230:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.813238:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.813245:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997706.813251:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.813259:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.813274:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789997706.813277:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997706.813282:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997706.813289:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d7e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997707.019681:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997707.436977:0:90318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd87f3150 20000000:00000080:0.0:1789997707.436995:0:90318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd793800 uarg=0000000000000000 00010000:00010000:0.0:1789997707.438290:0:90318:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997707.438311:0:90318:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997707.438326:0:90318:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997707.438348:0:90318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.438367:0:90318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.438374:0:90318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.438415:0:90318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.438431:0:90318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 18 pid: 5803 timeout: 2046 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997707.438446:0:90318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90318:1876946713022976:0@lo:104: 00000100:00100000:0.0:1789997707.438515:0:90318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997707.438594:0:90318:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb4afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997707.438624:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713022976 00000100:00100000:1.0:1789997707.438632:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713022976 00000100:00100000:1.0:1789997707.438714:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789997707.438725:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:90318:x1876946713022976:12345-0@lo:104: 00010000:00010000:1.0:1789997707.438740:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997707.438804:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997707.438810:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:90318:x1876946713022976:12345-0@lo:104: Request processed in 88us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997707.438817:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:3.0:1789997707.439018:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997707.439026:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997707.439036:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997707.439041:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997707.439050:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997707.439057:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997707.439063:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997707.439102:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997707.439109:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997707.439135:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997707.439147:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d7c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d7d0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997707.439160:0:90318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90318:1876946713022976:0@lo:104: 00010000:00010000:3.0:1789997707.439166:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997707.439169:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997707.439171:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997707.439184:0:90318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997707.439186:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713023104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997707.439231:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997707.439283:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713023104 00000100:00100000:0.0:1789997707.439289:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713023104 00010000:00010000:0.0:1789997707.439311:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 19 pid: 5803 timeout: 2046 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997707.439353:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1789997707.439361:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713023104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997707.439371:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997707.439377:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 19 pid: 5803 timeout: 2046 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439388:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 19 pid: 5803 timeout: 2046 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439401:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592d7d0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d7c9 expref: 19 pid: 5803 timeout: 2046 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439416:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439425:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439439:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439445:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439451:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439457:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439467:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997707.439471:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439479:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439501:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997707.439510:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997707.439566:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713023104:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997707.439573:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00010000:00010000:2.0:1789997707.439575:0:90318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997707.439589:0:90318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997707.439596:0:90318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592d7ec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997707.440700:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713023104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997708.042819:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997708.495338:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997708.495346:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997708.495351:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997708.495398:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997708.495724:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997708.495736:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997708.495762:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713023232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997708.495835:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997708.495896:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c29ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1789997708.495954:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713023232 00000100:00100000:2.0:1789997708.495963:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713023232 00000100:00100000:2.0:1789997708.496020:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1789997708.496030:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713023232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997708.496042:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997708.496056:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d7f3 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997708.496080:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997708.496091:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997708.496100:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2000, rc 0) 00000100:00100000:2.0:1789997708.496144:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713023232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997708.496151:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1789997708.496217:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713023232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997708.496232:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997708.496241:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997708.496260:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997708.496265:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997708.496273:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997708.789040:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967675 is committed 00010000:00010000:1.0:1789997709.071179:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997709.772882:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713023360:0@lo:400:kworker.0 00000100:00100000:1.0:1789997709.772959:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997709.773967:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713023744:0@lo:400:kworker.0 00000100:00100000:1.0:1789997709.774238:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713023872:0@lo:400:kworker.0 00000100:00100000:1.0:1789997709.774297:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997709.774304:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713023616:0@lo:400:kworker.0 00000100:00100000:0.0:1789997709.774340:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997709.774344:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713023872 00000100:00100000:1.0:1789997709.774363:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713023872 00000100:00100000:0.0:1789997709.774368:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789997709.774376:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713023488:0@lo:400:kworker.0 00000100:00100000:0.0:1789997709.774404:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997709.774424:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713024000:0@lo:400:kworker.0 00000100:00100000:1.0:1789997709.774441:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:0.0:1789997709.774447:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997709.774455:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713023872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997709.774477:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713023616 00000100:00100000:0.0:1789997709.774482:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713023616 00000100:00100000:1.0:1789997709.774514:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713023872:12345-0@lo:400:kworker.0 Request processed in 64us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.774516:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713023488 00000100:00100000:0.0:1789997709.774521:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713023488 00000100:00100000:1.0:1789997709.774526:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:0.0:1789997709.774543:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713024000 00000100:00100000:0.0:1789997709.774547:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713024000 00000100:00100000:0.0:1789997709.774574:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1789997709.774582:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713023872:0@lo:400:kworker.0 00000100:00100000:0.0:1789997709.774776:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713023616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997709.774903:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713023616:12345-0@lo:400:kworker.0 Request processed in 322us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.774910:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1789997709.774925:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1789997709.774932:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713023488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997709.774966:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713023488:12345-0@lo:400:kworker.0 Request processed in 34us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.774972:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:0.0:1789997709.775316:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1789997709.775325:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713024000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997709.775361:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713024000:12345-0@lo:400:kworker.0 Request processed in 36us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.775367:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:0.0:1789997709.775412:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997709.776510:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713023488:0@lo:400:kworker.0 00000100:00100000:1.0:1789997709.776526:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713024000:0@lo:400:kworker.0 00000100:00100000:1.0:1789997709.776538:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713023616:0@lo:400:kworker.0 00000100:00100000:2.0:1789997709.777088:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713023360 00000100:00100000:2.0:1789997709.777096:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713023360 00000100:00100000:2.0:1789997709.777148:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1789997709.777158:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713023360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997709.777276:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713023360:12345-0@lo:400:kworker.0 Request processed in 119us (4315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997709.777282:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00080000:2.0:1789997709.777320:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997709.777325:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997709.777335:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713023744 00000100:00100000:2.0:1789997709.777339:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713023744 00000100:00100000:2.0:1789997709.777389:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:2.0:1789997709.777396:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713023744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997709.777447:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713023744:12345-0@lo:400:kworker.0 Request processed in 52us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997709.777453:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00080000:2.0:1789997709.777468:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997709.778200:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713023360:0@lo:400:kworker.0 00000100:00100000:0.0:1789997709.778238:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713023744:0@lo:400:kworker.0 00000100:00100000:3.0:1789997709.898916:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997709.899856:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704536320 00000100:00100000:0.0:1789997709.899869:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704536320 00000100:00100000:0.0:1789997709.899970:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 985 00000100:00100000:0.0:1789997709.899982:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704536320:12345-192.168.204.4@tcp:48:lfs.0 00000100:00080000:2.0:1789997709.900023:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997709.900100:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704536320:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 120us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.900108:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 985 00000100:00100000:2.0:1789997709.907545:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997709.907815:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704536448 00000100:00100000:1.0:1789997709.907827:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704536448 00000100:00100000:1.0:1789997709.907892:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 521 00000100:00100000:1.0:1789997709.907900:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876946704536448:12345-192.168.204.4@tcp:8:lfs.0 00010000:00080000:1.0:1789997709.907930:0:8169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1898 last 0 00000020:00000080:1.0:1789997709.908025:0:8169:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592d801 00002000:00100000:1.0:1789997709.908038:0:8169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a37c6ec7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789997709.908061:0:8169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789997709.909001:0:8169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789997709.909041:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a37c8049000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789997709.909180:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704536448:12345-192.168.204.4@tcp:8:lfs.0 Request processed in 1278us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.909191:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 521 00000100:00100000:1.0:1789997709.917471:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997709.917638:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704536576 00000100:00100000:2.0:1789997709.917649:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704536576 00000100:00100000:2.0:1789997709.918445:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 522 00000100:00100000:2.0:1789997709.918456:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53321:x1876946704536576:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997709.918928:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53321:x1876946704536576:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 472us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997709.918938:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 522 00000100:00080000:0.0:1789997709.919315:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997709.923954:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997709.924271:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704536704 00000100:00100000:2.0:1789997709.924282:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704536704 00000100:00100000:2.0:1789997709.924364:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 523 00000100:00100000:2.0:1789997709.924374:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704536704:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:0.0:1789997709.925176:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997709.927250:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704536704:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 2868us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997709.927264:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 523 00000100:00100000:3.0:1789997709.930950:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997709.931058:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704536832 00000100:00100000:0.0:1789997709.931072:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704536832 00000100:00100000:0.0:1789997709.931149:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 986 00000100:00100000:0.0:1789997709.931160:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704536832:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997709.931700:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704536832:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 539us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.931709:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 986 00000100:00100000:1.0:1789997709.935553:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997709.935696:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704536960 00000100:00100000:0.0:1789997709.935706:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704536960 00000100:00100000:0.0:1789997709.935765:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 987 00000100:00100000:0.0:1789997709.935775:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704536960:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997709.935891:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704536960:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.935898:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 987 00000100:00100000:3.0:1789997709.937985:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997709.938238:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704537088 00000100:00100000:2.0:1789997709.938247:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704537088 00000100:00100000:2.0:1789997709.938313:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 524 00000100:00100000:2.0:1789997709.938324:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53321:x1876946704537088:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997709.938940:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53321:x1876946704537088:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 616us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997709.938950:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 524 00000100:00100000:3.0:1789997709.941368:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997709.941550:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704537216 00000100:00100000:1.0:1789997709.941559:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704537216 00000100:00100000:1.0:1789997709.941618:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 525 00000100:00100000:1.0:1789997709.941629:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704537216:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997709.942030:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704537216:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 402us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997709.942039:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 525 00000100:00100000:1.0:1789997709.944544:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997709.944682:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704537344 00000100:00100000:0.0:1789997709.944691:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704537344 00000100:00100000:0.0:1789997709.944746:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 988 00000100:00100000:0.0:1789997709.944757:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704537344:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997709.945390:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53321:x1876946704537344:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 632us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997709.945399:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 988 00000100:00100000:3.0:1789997709.994378:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997709.994588:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704537472 00000100:00100000:1.0:1789997709.994600:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704537472 00000100:00100000:1.0:1789997709.994806:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 989 00000100:00100000:1.0:1789997709.994818:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53325:x1876946704537472:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997709.994840:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997709.994875:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef6d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.994942:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.994957:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.994972:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.994986:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.994993:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995000:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995305:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d81d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995313:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995320:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997709.995340:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:1.0:1789997709.995343:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997709.995361:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995371:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995377:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995383:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995389:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997709.995393:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995400:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995411:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:1.0:1789997709.995415:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997709.995419:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995424:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592d80f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995438:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995443:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995448:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995467:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997709.995469:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995475:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995481:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38e062d400) 00010000:00010000:1.0:1789997709.995484:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997709.995486:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995491:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d816 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995519:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592d808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef6d expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995540:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d81d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef6d expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997709.995546:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997709.995548:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997709.995551:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997709.995606:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53325:x1876946704537472:12345-192.168.204.4@tcp:101:dd.0 Request processed in 791us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997709.995613:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 989 00000100:00100000:3.0:1789997710.001604:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997710.002548:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704537728 00000100:00100000:0.0:1789997710.002560:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704537728 00000100:00100000:0.0:1789997710.002680:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 990 00000100:00100000:0.0:1789997710.002692:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53325:x1876946704537728:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997710.002711:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997710.002729:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d824 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef74 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.003287:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.003305:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.003318:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.003333:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.003341:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.003348:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997710.004291:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:0.0:1789997710.004555:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004568:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004577:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004614:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004621:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004628:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004633:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997710.004638:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004645:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004764:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997710.004767:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997710.004773:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.004860:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592d82b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997710.004887:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6dbd2d8 reply state 000000002c2b11b1 transno 4294967676 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997710.004895:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997710.005007:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592d824 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef74 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.005019:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef74 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.005024:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997710.005026:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997710.005028:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997710.005245:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:53325:x1876946704537728:12345-192.168.204.4@tcp:101:dd.0 Request processed in 2547us (3643us total) trans 4294967676 rc 0/0 00000100:00100000:0.0:1789997710.005253:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 990 00010000:00010000:0.0:1789997710.009016:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.009035:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.009044:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.009050:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997710.009055:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.009067:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.009144:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997710.009149:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997710.009155:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997710.009161:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d832 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997710.010178:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997710.010314:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704537856 00000100:00100000:1.0:1789997710.010326:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704537856 00000100:00100000:1.0:1789997710.010385:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 526 00000100:00100000:1.0:1789997710.010396:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53325:x1876946704537856:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:1.0:1789997710.010415:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997710.010437:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef7b expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997710.010465:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789997710.010488:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=1898s v=(0 0) 00010000:00010000:1.0:1789997710.010493:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997710.010503:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997710.010521:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997710.010538:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997710.010604:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53325:x1876946704537856:12345-192.168.204.4@tcp:101:dd.0 Request processed in 210us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997710.010611:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 526 00000100:00100000:2.0:1789997710.027470:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997710.027630:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704537984 00000100:00100000:1.0:1789997710.027641:0:6662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704537984 00002000:00100000:1.0:1789997710.027749:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f:0x0] (0->1048575) req@ffff8a38fb3bad80 x1876946704537984/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:686/0 lens 488/0 e 0 to 0 dl 1789997721 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789997710.027760:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fb3bad80 with x1876946704537984 ext(0->1048575) 00002000:00010000:1.0:1789997710.027765:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fb3bad80 00000100:00100000:1.0:1789997710.027837:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:1.0:1789997710.027859:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704537984:12345-192.168.204.4@tcp:4:dd.0 00000001:00100000:1.0:1789997710.072895:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:3.0:1789997710.079813:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704537984:12345-192.168.204.4@tcp:4:dd.0 Request processed in 51945us (52342us total) trans 4294967358 rc 0/0 00000100:00100000:3.0:1789997710.079829:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00002000:00100000:3.0:1789997710.079854:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1f:0x0] (0->1048575) req@ffff8a38fb3bad80 x1876946704537984/t4294967358(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:686/0 lens 488/448 e 0 to 0 dl 1789997721 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789997710.079866:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fb3bad80 with x1876946704537984 ext(0->1048575) 00002000:00010000:3.0:1789997710.079874:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fb3bad80 00000100:00100000:3.0:1789997710.083548:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997710.083738:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704538112 00000100:00100000:0.0:1789997710.083749:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704538112 00000100:00100000:0.0:1789997710.083806:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 991 00000100:00100000:0.0:1789997710.083815:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:53325:x1876946704538112:12345-192.168.204.4@tcp:44:dd.0 00010000:00010000:3.0:1789997710.091954:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997710.119503:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967676 is committed 00000100:00100000:2.0:1789997710.120700:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53325:x1876946704538112:12345-192.168.204.4@tcp:44:dd.0 Request processed in 36874us (37150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997710.120715:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 991 00000100:00100000:2.0:1789997710.126598:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997710.127317:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704538240 00000100:00100000:1.0:1789997710.127332:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704538240 00000100:00100000:1.0:1789997710.127399:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 527 00000100:00100000:1.0:1789997710.127411:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704538240:12345-192.168.204.4@tcp:16:dd.0 00000001:00080000:1.0:1789997710.168265:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00000100:00100000:1.0:1789997710.168386:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704538240:12345-192.168.204.4@tcp:16:dd.0 Request processed in 40971us (41793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997710.168397:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 527 00000100:00100000:1.0:1789997710.171712:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997710.171809:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704538496 00000100:00100000:3.0:1789997710.171819:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704538496 00000100:00100000:3.0:1789997710.171883:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 101 00000100:00100000:3.0:1789997710.171893:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53325:x1876946704538496:12345-192.168.204.4@tcp:35:dd.0 00000001:00080000:3.0:1789997710.172332:0:5814:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967677 00000100:00100000:3.0:1789997710.172438:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:53325:x1876946704538496:12345-192.168.204.4@tcp:35:dd.0 Request processed in 545us (735us total) trans 4294967678 rc 0/0 00000100:00100000:3.0:1789997710.172447:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 101 00000020:00080000:3.0:1789997710.172452:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789997711.115838:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997711.180159:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967678 is committed 00000100:00100000:3.0:1789997711.638215:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997711.638266:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997711.638380:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997711.638414:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997711.638471:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704538752 00000100:00100000:0.0:1789997711.638481:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704538752 00000100:00100000:0.0:1789997711.638546:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1389 00000100:00100000:0.0:1789997711.638557:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704538752:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997711.638630:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704538752:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997711.638638:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1389 00000100:00080000:0.0:1789997711.638688:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997711.639722:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704538624 00000100:00100000:1.0:1789997711.639730:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704538624 00000100:00100000:1.0:1789997711.639767:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1137 00000100:00100000:1.0:1789997711.639776:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704538624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997711.639827:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704538624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 51us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997711.639834:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1137 00000100:00100000:2.0:1789997711.641690:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704538880 00000100:00100000:2.0:1789997711.641702:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704538880 00000100:00080000:1.0:1789997711.641795:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997711.641868:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704539008 00000100:00100000:0.0:1789997711.641872:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704539008 00000100:00100000:0.0:1789997711.641952:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 916 00000100:00100000:0.0:1789997711.641962:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704538880:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997711.642043:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704538880:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (3775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997711.642061:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 916 00000100:00100000:0.0:1789997711.642078:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 917 00000100:00100000:0.0:1789997711.642085:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704539008:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997711.642112:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704539008:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (3697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997711.642117:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 917 00000100:00080000:1.0:1789997711.642267:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997711.821613:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997711.821639:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713024128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997711.821736:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997711.825524:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713024128 00000100:00100000:3.0:1789997711.825540:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713024128 00000100:00100000:3.0:1789997711.825682:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1789997711.825693:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713024128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997711.825743:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997711.825843:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713024128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997711.825850:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1789997711.825913:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713024128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997711.827264:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713024256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997711.827319:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997711.827504:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713024256 00000100:00100000:1.0:1789997711.827511:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713024256 00000100:00100000:1.0:1789997711.829927:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1789997711.829954:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713024256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997711.829994:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789997711.830078:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713024256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997711.830085:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1789997711.830147:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713024256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997711.830329:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997711.830335:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997712.140164:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997712.255163:0:90565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1900947506009ns, next at 1814475708606ns, rc = 0 00000004:00080000:3.0:1789997712.255277:0:90565:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1900947622030ns, next at 1880599191638ns, rc = 0 00000004:00080000:2.0:1789997712.264698:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 86 committed 00000004:00080000:2.0:1789997712.268478:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 88 committed 00010000:00010000:3.0:1789997713.162765:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997713.417362:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997713.417718:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704539136 00000100:00100000:0.0:1789997713.417728:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704539136 00000100:00100000:0.0:1789997713.417846:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 992 00000100:00100000:0.0:1789997713.417858:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53517:x1876946704539136:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997713.417969:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53517:x1876946704539136:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 114us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997713.417977:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 992 00000100:00080000:1.0:1789997713.418200:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997713.422904:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997713.422959:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704539264 00000100:00100000:3.0:1789997713.422970:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704539264 00000100:00100000:3.0:1789997713.423040:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 528 00000100:00100000:3.0:1789997713.423052:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53517:x1876946704539264:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997713.423606:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53517:x1876946704539264:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 554us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997713.423615:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 528 00000100:00080000:3.0:1789997713.423640:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997713.426373:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997713.426567:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704539392 00000100:00100000:0.0:1789997713.426577:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704539392 00000100:00100000:0.0:1789997713.426642:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 529 00000100:00100000:0.0:1789997713.426677:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53517:x1876946704539392:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997713.427154:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53517:x1876946704539392:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 501us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997713.427162:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 529 00000100:00080000:3.0:1789997713.427376:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997713.431310:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997713.431403:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704539520 00000100:00100000:2.0:1789997713.431414:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704539520 00000100:00100000:2.0:1789997713.431473:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 993 00000100:00100000:2.0:1789997713.431484:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53517:x1876946704539520:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997713.432716:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53517:x1876946704539520:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 382us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997713.432729:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 993 00000100:00100000:0.0:1789997713.439515:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997713.440154:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704539648 00000100:00100000:3.0:1789997713.440164:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704539648 00000100:00100000:3.0:1789997713.440222:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 994 00000100:00100000:3.0:1789997713.440231:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53517:x1876946704539648:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997713.440331:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53517:x1876946704539648:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 101us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997713.440339:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 994 00000100:00100000:3.0:1789997713.444146:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997713.444295:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704539776 00000100:00100000:2.0:1789997713.444306:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704539776 00000100:00100000:2.0:1789997713.444363:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 530 00000100:00100000:2.0:1789997713.444374:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53517:x1876946704539776:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997713.444759:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53517:x1876946704539776:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 385us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997713.444767:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 530 00000100:00100000:0.0:1789997713.449112:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997713.449239:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704539904 00000100:00100000:2.0:1789997713.449249:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704539904 00000100:00100000:2.0:1789997713.449319:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 531 00000100:00100000:2.0:1789997713.449330:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53517:x1876946704539904:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997713.449715:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53517:x1876946704539904:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 386us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997713.449724:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 531 00000100:00100000:0.0:1789997713.453047:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997713.453080:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704540032 00000100:00100000:0.0:1789997713.453089:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704540032 00000100:00100000:0.0:1789997713.453136:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 995 00000100:00100000:0.0:1789997713.453146:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53517:x1876946704540032:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997713.453561:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53517:x1876946704540032:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 415us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997713.453569:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 995 00000100:00100000:0.0:1789997713.513412:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997713.515192:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704540288 00000100:00100000:2.0:1789997713.515206:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704540288 00000100:00100000:2.0:1789997713.515388:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 996 00000100:00100000:2.0:1789997713.515400:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:53521:x1876946704540288:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997713.515452:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997713.515491:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592d839 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef74 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.515527:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:2.0:1789997713.515539:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997713.515562:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.515576:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.515586:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.515601:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.515609:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.515615:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.515988:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.515998:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.516005:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997713.516822:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].31, 64 off10176 00000004:00080000:2.0:1789997713.516834:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1902209179780ns, next at 1903209177397ns, rc = 0 00010000:00010000:2.0:1789997713.516925:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.516937:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.516946:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.516954:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.516960:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.516967:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.516990:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997713.517012:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517017:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517023:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517028:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997713.517032:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517040:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517049:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997713.517051:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997713.517056:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517061:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d85c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517078:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517083:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517088:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517092:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997713.517094:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517099:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517106:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:2.0:1789997713.517108:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997713.517111:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997713.517116:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d84e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997713.517125:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d17dfe8 reply state 00000000726a90f7 transno 4294967679 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997713.517138:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997713.517230:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:53521:x1876946704540288:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1830us (3825us total) trans 4294967679 rc 0/0 00000100:00100000:2.0:1789997713.517238:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 996 00010000:00010000:0.0:1789997713.517335:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997713.517344:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997713.517352:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997713.517356:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997713.517364:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997713.517374:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:0.0:1789997713.517376:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997713.517380:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997713.517386:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d863 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997713.517401:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997713.517403:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997713.517405:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997713.522887:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997713.522913:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997713.522927:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997713.522934:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997713.522939:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997713.522947:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997713.522965:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38d0bdf900) 00010000:00010000:1.0:1789997713.522968:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997713.522974:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997713.522982:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d855 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997714.186931:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997714.894137:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713024384:0@lo:400:kworker.0 00000100:00100000:2.0:1789997714.894218:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997714.894431:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713024384 00000100:00100000:3.0:1789997714.894440:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713024384 00000100:00100000:3.0:1789997714.894487:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1789997714.894498:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713024384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997714.895684:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713024512:0@lo:400:kworker.0 00000100:00100000:0.0:1789997714.895739:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997714.895786:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997714.895793:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713024640:0@lo:400:kworker.0 00000100:00100000:0.0:1789997714.895817:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997714.895843:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713024768:0@lo:400:kworker.0 00000100:00100000:0.0:1789997714.895869:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997714.895899:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713024512 00000100:00100000:0.0:1789997714.895904:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713024512 00000100:00100000:0.0:1789997714.895935:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713024640 00000100:00100000:0.0:1789997714.895938:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713024640 00000100:00100000:0.0:1789997714.895966:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1789997714.895974:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997714.896017:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713024512:12345-0@lo:400:kworker.0 Request processed in 44us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997714.896024:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1789997714.896042:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1789997714.896048:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713024640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997714.896075:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713024640:12345-0@lo:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997714.896081:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:0.0:1789997714.896213:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713024640:0@lo:400:kworker.0 00000100:00100000:0.0:1789997714.896223:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713024512:0@lo:400:kworker.0 00000100:00100000:1.0:1789997714.897125:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997714.897139:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713025024:0@lo:400:kworker.0 00000100:00100000:1.0:1789997714.897180:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997714.897213:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713025024 00000100:00100000:1.0:1789997714.897218:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713025024 00000100:00100000:1.0:1789997714.897258:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1789997714.897265:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713025024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997714.897320:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713025024:12345-0@lo:400:kworker.0 Request processed in 56us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997714.897326:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1789997714.897360:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713025024:0@lo:400:kworker.0 00000100:00100000:1.0:1789997714.897393:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997714.897400:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713024896:0@lo:400:kworker.0 00000100:00100000:1.0:1789997714.897424:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997714.897451:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713024768 00000100:00100000:1.0:1789997714.897456:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713024768 00000100:00100000:1.0:1789997714.897487:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713024896 00000100:00100000:1.0:1789997714.897491:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713024896 00000100:00100000:1.0:1789997714.897514:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1789997714.897521:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713024768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997714.897556:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713024768:12345-0@lo:400:kworker.0 Request processed in 36us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997714.897563:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1789997714.897574:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1789997714.897579:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713024896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997714.897605:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713024896:12345-0@lo:400:kworker.0 Request processed in 26us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997714.897610:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1789997714.897635:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713024896:0@lo:400:kworker.0 00000100:00100000:1.0:1789997714.897647:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713024768:0@lo:400:kworker.0 00000100:00100000:3.0:1789997714.897983:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713024384:12345-0@lo:400:kworker.0 Request processed in 3485us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997714.897993:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00080000:3.0:1789997714.898025:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997714.898029:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997714.898032:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997714.898137:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713024384:0@lo:400:kworker.0 00010000:00010000:3.0:1789997715.211767:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789997715.426366:0:90710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1904118709247ns, next at 1903209177397ns, rc = 0 00000004:00080000:2.0:1789997715.462906:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 88 committed 00000001:00080000:2.0:1789997715.462940:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967679 is committed 00000004:00080000:2.0:1789997715.462945:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 87 committed 00000100:00100000:2.0:1789997715.463640:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713025152:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789997715.463760:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997715.463821:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713025152 00000100:00100000:3.0:1789997715.463829:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713025152 00000100:00100000:3.0:1789997715.463887:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1789997715.463898:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713025152:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789997715.463927:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:31 count 1 00010000:00010000:3.0:1789997715.463953:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.464286:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.464293:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f:0x0].0x0 since=6s v=(0 0) 00010000:00010000:3.0:1789997715.464296:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997715.464300:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.464324:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.464334:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 5 pid: 6658 timeout: 2004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997715.464344:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1876946713025280:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997715.464396:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61900 going to sleep for 11 seconds 00000100:00100000:3.0:1789997715.469510:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1876946713025280:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997715.469540:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997715.477866:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997715.477951:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704540416 00000100:00100000:3.0:1789997715.477962:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704540416 00010000:00010000:3.0:1789997715.478028:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 6 pid: 6658 timeout: 2004 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997715.478069:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 400 00000100:00100000:3.0:1789997715.478079:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704540416:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997715.478094:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997715.478100:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 6 pid: 6658 timeout: 2004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.478113:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 6 pid: 6658 timeout: 2004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.478137:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c771f607/0x65b43101d592d847 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef7b expref: 6 pid: 6658 timeout: 2004 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.478154:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997715.478159:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997715.478164:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.478178:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997715.478438:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997715.478506:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704540416:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 427us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997715.478514:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 400 00000100:00080000:0.0:1789997715.478576:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997715.479776:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997715.479794:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997715.479805:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997715.479813:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997715.479941:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789997715.480966:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713025152:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17064us (17200us total) trans 4294967359 rc 0/0 00000100:00100000:2.0:1789997715.480977:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00010000:00010000:0.0:1789997715.481156:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997715.481165:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997715.481176:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997715.481180:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997715.481191:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997715.481212:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997715.481219:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000505ae5cf/0x65b43101d592d86a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997715.481244:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997715.481246:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997715.481248:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997715.481448:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fad0f800/2, rc 0, transno 4294967359 00000100:00100000:1.0:1789997715.481515:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713025152:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789997715.481954:0:90710:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1904174299608ns, next at 1880599191638ns, rc = 0 00000004:00080000:3.0:1789997715.492805:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 89 committed 00010000:00010000:1.0:1789997716.234898:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997716.758795:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997716.758852:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997716.760218:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704540544 00000100:00100000:1.0:1789997716.760230:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704540544 00000100:00100000:1.0:1789997716.760291:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1139 00000100:00100000:1.0:1789997716.760301:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704540544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997716.760413:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704540672 00000100:00100000:0.0:1789997716.760418:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704540672 00000100:00100000:0.0:1789997716.760473:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1393 00000100:00100000:0.0:1789997716.760481:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704540672:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1789997716.761051:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997716.761308:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704540544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1005us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997716.761320:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1139 00000100:00100000:3.0:1789997716.761408:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997716.761444:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704540672:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 960us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997716.761458:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1393 00000100:00100000:1.0:1789997716.761482:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704540800 00000100:00100000:1.0:1789997716.761489:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704540800 00000100:00100000:1.0:1789997716.761523:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 920 00000100:00100000:1.0:1789997716.761531:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704540800:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997716.761568:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704540800:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997716.761575:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 920 00000100:00100000:3.0:1789997716.761696:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997716.762331:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704540928 00000100:00100000:0.0:1789997716.762337:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704540928 00000100:00100000:0.0:1789997716.762394:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 921 00000100:00080000:3.0:1789997716.762397:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997716.762404:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704540928:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997716.762446:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704540928:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997716.762453:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 921 00000100:00100000:3.0:1789997716.939269:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997716.939297:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713025408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997716.939441:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997716.939522:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713025536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997716.939546:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997716.939574:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713025408 00000100:00100000:1.0:1789997716.939584:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713025408 00000100:00100000:0.0:1789997716.939628:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713025536 00000100:00100000:0.0:1789997716.939634:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713025536 00000100:00100000:1.0:1789997716.939679:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1789997716.939690:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713025408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997716.939741:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789997716.939794:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713025408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997716.939847:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713025408:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997716.939850:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997716.939856:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997716.942131:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1789997716.942184:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1789997716.942203:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713025536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997716.942335:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997716.942556:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713025536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 362us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997716.942568:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:2.0:1789997716.942614:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713025536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997717.259217:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997718.284415:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997718.515573:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00010000:00010000:1.0:1789997719.310026:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997720.011894:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713025664:0@lo:400:kworker.0 00000100:00100000:2.0:1789997720.011967:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997720.012107:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713025664 00000100:00100000:3.0:1789997720.012116:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713025664 00000100:00100000:2.0:1789997720.012121:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997720.012128:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713025792:0@lo:400:kworker.0 00000100:00100000:2.0:1789997720.012155:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997720.012159:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1789997720.012167:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713025664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997720.016694:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713026304:0@lo:400:kworker.0 00000100:00100000:2.0:1789997720.016776:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713025664:0@lo:400:kworker.0 00000100:00100000:2.0:1789997720.016808:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713026176:0@lo:400:kworker.0 00000100:00100000:2.0:1789997720.016860:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997720.016906:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713026176 00000100:00100000:2.0:1789997720.016912:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713026176 00000100:00100000:2.0:1789997720.016966:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1789997720.016977:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713026176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997720.017106:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713026176:12345-0@lo:400:kworker.0 Request processed in 131us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997720.017115:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1789997720.017157:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713026176:0@lo:400:kworker.0 00000100:00100000:3.0:1789997720.017217:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713025664:12345-0@lo:400:kworker.0 Request processed in 5049us (5247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997720.017227:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00080000:3.0:1789997720.017262:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997720.017295:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713025920:0@lo:400:kworker.0 00000100:00100000:3.0:1789997720.017325:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997720.017349:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997720.017355:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713026048:0@lo:400:kworker.0 00000100:00100000:3.0:1789997720.017378:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997720.017406:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713025792 00000100:00100000:3.0:1789997720.017411:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713025792 00000100:00100000:3.0:1789997720.017520:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713025920 00000100:00100000:3.0:1789997720.017525:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713025920 00000100:00100000:3.0:1789997720.017568:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1789997720.017576:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713025792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997720.017613:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713025792:12345-0@lo:400:kworker.0 Request processed in 38us (5458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997720.017620:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1789997720.017631:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:3.0:1789997720.017637:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713025920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997720.017711:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713025920:12345-0@lo:400:kworker.0 Request processed in 74us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997720.017717:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:3.0:1789997720.017736:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713026048 00000100:00100000:3.0:1789997720.017740:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713026048 00000100:00100000:3.0:1789997720.017765:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1789997720.017772:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713026048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997720.017802:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713026048:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997720.017808:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1789997720.017838:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:3.0:1789997720.017843:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fad0f800, transno 4294967359 00000100:00100000:3.0:1789997720.017856:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713026048:0@lo:400:kworker.0 00000100:00100000:3.0:1789997720.017868:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713025920:0@lo:400:kworker.0 00000100:00100000:0.0:1789997720.018390:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997720.019161:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713026304 00000100:00100000:3.0:1789997720.019169:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713026304 00000100:00100000:3.0:1789997720.019214:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:3.0:1789997720.019222:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713026304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997720.019270:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713026304:12345-0@lo:400:kworker.0 Request processed in 50us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997720.019276:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:3.0:1789997720.019311:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713026304:0@lo:400:kworker.0 00000100:00080000:1.0:1789997720.020572:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997720.020580:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997720.021689:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713025792:0@lo:400:kworker.0 00010000:00010000:3.0:1789997720.330769:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997721.354895:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997721.882212:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997721.882263:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997721.882301:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997721.882339:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997721.882380:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704541312 00000100:00100000:2.0:1789997721.882389:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704541312 00000100:00100000:2.0:1789997721.882441:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704541440 00000100:00100000:2.0:1789997721.882445:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704541440 00000100:00100000:2.0:1789997721.882466:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 924 00000100:00100000:2.0:1789997721.882478:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704541312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997721.882550:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704541312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997721.882558:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 924 00000100:00100000:2.0:1789997721.882573:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 925 00000100:00100000:2.0:1789997721.882580:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704541440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997721.882607:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704541440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997721.882625:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 925 00000100:00100000:3.0:1789997721.882722:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704541056 00000100:00100000:3.0:1789997721.882727:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704541056 00000100:00100000:3.0:1789997721.882762:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1141 00000100:00100000:3.0:1789997721.882769:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704541056:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997721.882794:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704541056:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997721.882800:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1141 00000100:00080000:1.0:1789997721.883554:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997721.883560:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997721.884406:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704541184 00000100:00100000:0.0:1789997721.884415:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704541184 00000100:00100000:0.0:1789997721.884491:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1397 00000100:00100000:0.0:1789997721.884504:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704541184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997721.884579:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704541184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997721.884586:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1397 00000100:00080000:1.0:1789997721.884595:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997722.059342:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713026560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997722.059427:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997722.059588:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713026560 00000100:00100000:1.0:1789997722.059597:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713026560 00000100:00100000:2.0:1789997722.060502:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713026432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997722.060550:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789997722.065385:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997722.066379:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713026432 00000100:00100000:3.0:1789997722.066391:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713026432 00000100:00100000:3.0:1789997722.066501:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1789997722.066528:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713026560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997722.066593:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997722.066708:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713026560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (7296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997722.066715:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1789997722.066731:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1789997722.066738:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713026432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997722.066754:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997722.066799:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713026432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (6249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997722.066805:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00080000:3.0:1789997722.066821:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997722.066867:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713026560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997722.067349:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713026432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997722.380336:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997723.402828:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997724.428021:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997725.131083:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713026816:0@lo:400:kworker.0 00000100:00100000:3.0:1789997725.131110:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713027072:0@lo:400:kworker.0 00000100:00100000:3.0:1789997725.131160:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997725.131165:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997725.131172:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713026944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997725.131192:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713027072 00000100:00100000:2.0:1789997725.131199:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713027072 00000100:00100000:0.0:1789997725.131234:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713026688:0@lo:400:kworker.0 00000100:00080000:3.0:1789997725.131238:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997725.131270:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:2.0:1789997725.131279:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713027072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997725.131347:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713027328:0@lo:400:kworker.0 00000100:00100000:1.0:1789997725.131378:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997725.131416:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713026816 00000100:00100000:1.0:1789997725.131421:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713026816 00000100:00100000:1.0:1789997725.131459:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713027328 00000100:00100000:1.0:1789997725.131463:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713027328 00000100:00100000:1.0:1789997725.131502:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:1.0:1789997725.131510:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713026816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997725.131566:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713026816:12345-0@lo:400:kworker.0 Request processed in 57us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997725.131573:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:1.0:1789997725.131594:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1789997725.131600:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713027328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997725.131634:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713027328:12345-0@lo:400:kworker.0 Request processed in 34us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997725.131640:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00080000:1.0:1789997725.131686:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997725.131714:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713027328:0@lo:400:kworker.0 00000100:00100000:1.0:1789997725.131724:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713026816:0@lo:400:kworker.0 00000100:00100000:3.0:1789997725.132583:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997725.132583:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997725.132633:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713027200:0@lo:400:kworker.0 00000100:00100000:0.0:1789997725.132685:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997725.132720:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713027200 00000100:00100000:0.0:1789997725.132726:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713027200 00000100:00100000:0.0:1789997725.132773:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:0.0:1789997725.132782:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713027200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997725.132823:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713027200:12345-0@lo:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997725.132830:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00080000:0.0:1789997725.132850:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997725.132879:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713027200:0@lo:400:kworker.0 00000100:00100000:2.0:1789997725.132908:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713027072:12345-0@lo:400:kworker.0 Request processed in 1627us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997725.132919:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1789997725.132923:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713026688 00000100:00100000:0.0:1789997725.132929:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713026688 00000100:00100000:3.0:1789997725.132933:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713027072:0@lo:400:kworker.0 00000100:00100000:0.0:1789997725.132967:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:0.0:1789997725.132974:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713026688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997725.133016:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713026944 00000100:00100000:1.0:1789997725.133021:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713026944 00000100:00100000:1.0:1789997725.133105:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1789997725.133117:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713026944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997725.133157:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713026944:12345-0@lo:400:kworker.0 Request processed in 45us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997725.133163:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00080000:3.0:1789997725.133217:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997725.133237:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713026944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997725.134720:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713026688:0@lo:400:kworker.0 00000100:00100000:0.0:1789997725.134790:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713026688:12345-0@lo:400:kworker.0 Request processed in 1616us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997725.134801:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00010000:00010000:1.0:1789997725.450863:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997726.474890:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997726.999327:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997726.999411:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997726.999449:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997726.999492:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997726.999536:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704541824 00000100:00100000:2.0:1789997726.999545:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704541824 00000100:00100000:2.0:1789997726.999604:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704541952 00000100:00100000:2.0:1789997726.999607:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704541952 00000100:00100000:2.0:1789997726.999632:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 928 00000100:00100000:2.0:1789997726.999643:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704541824:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997726.999765:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704541824:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 124us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997726.999774:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 928 00000100:00100000:2.0:1789997726.999792:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 929 00000100:00100000:2.0:1789997726.999800:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704541952:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997726.999825:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704541952:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997726.999832:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 929 00000100:00080000:2.0:1789997726.999957:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997726.999961:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997727.000275:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704541696 00000100:00100000:0.0:1789997727.000280:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704541696 00000100:00100000:0.0:1789997727.000336:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1401 00000100:00100000:0.0:1789997727.000345:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704541696:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997727.000384:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704541696:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997727.000390:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1401 00000100:00080000:2.0:1789997727.001000:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997727.006607:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704541568 00000100:00100000:3.0:1789997727.006622:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704541568 00000100:00100000:3.0:1789997727.007199:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1143 00000100:00100000:3.0:1789997727.007212:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704541568:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997727.007295:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704541568:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (7976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997727.007302:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1143 00000100:00100000:3.0:1789997727.179098:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713027456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997727.179179:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997727.179591:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713027584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997727.180044:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713027456 00000100:00100000:1.0:1789997727.180052:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713027456 00000100:00100000:1.0:1789997727.180123:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1789997727.180134:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713027456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997727.180184:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997727.180240:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713027456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997727.180247:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00080000:2.0:1789997727.180285:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997727.180331:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997727.180415:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713027584 00000100:00100000:1.0:1789997727.180420:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713027584 00000100:00100000:1.0:1789997727.180466:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1789997727.180473:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713027584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997727.180496:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997727.180541:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713027584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997727.180548:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1789997727.180608:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713027456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997727.180650:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713027584:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997727.180729:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997727.500259:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997728.522968:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997729.546930:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997730.228016:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997730.228093:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704542080 00000100:00100000:1.0:1789997730.228103:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704542080 00000100:00100000:1.0:1789997730.228184:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 997 00000100:00100000:1.0:1789997730.228197:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53739:x1876946704542080:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997730.228311:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53739:x1876946704542080:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997730.228318:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 997 00000100:00080000:2.0:1789997730.228462:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997730.230547:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997730.230614:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704542208 00000100:00100000:2.0:1789997730.230623:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704542208 00000100:00100000:2.0:1789997730.230734:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 533 00000100:00100000:2.0:1789997730.230744:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53739:x1876946704542208:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:3.0:1789997730.230833:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997730.231127:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53739:x1876946704542208:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 383us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997730.231135:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 533 00000100:00100000:3.0:1789997730.232902:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997730.233317:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704542336 00000100:00100000:2.0:1789997730.233325:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704542336 00000100:00100000:2.0:1789997730.233386:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 534 00000100:00100000:2.0:1789997730.233396:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53739:x1876946704542336:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997730.233776:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53739:x1876946704542336:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 380us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997730.233783:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 534 00000100:00080000:3.0:1789997730.233851:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997730.236591:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997730.236800:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704542464 00000100:00100000:1.0:1789997730.236810:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704542464 00000100:00100000:1.0:1789997730.236875:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 998 00000100:00100000:1.0:1789997730.236886:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53739:x1876946704542464:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997730.237960:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53739:x1876946704542464:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 1071us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997730.237970:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 998 00000100:00100000:0.0:1789997730.241476:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997730.241631:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704542592 00000100:00100000:1.0:1789997730.241644:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704542592 00000100:00100000:1.0:1789997730.241730:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 999 00000100:00100000:1.0:1789997730.241741:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53739:x1876946704542592:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997730.241955:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53739:x1876946704542592:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 215us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997730.241964:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 999 00000100:00100000:3.0:1789997730.243941:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997730.244087:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704542720 00000100:00100000:0.0:1789997730.244097:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704542720 00000100:00100000:0.0:1789997730.244149:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 535 00000100:00100000:0.0:1789997730.244160:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53739:x1876946704542720:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997730.244696:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53739:x1876946704542720:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 537us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997730.244704:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 535 00000100:00100000:3.0:1789997730.251821:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713027840:0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.251887:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997730.252167:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713027968:0@lo:400:kworker.0 00000100:00100000:1.0:1789997730.252178:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713028096:0@lo:400:kworker.0 00000100:00100000:0.0:1789997730.252198:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997730.252246:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713027840 00000100:00100000:0.0:1789997730.252267:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713027840 00000100:00100000:3.0:1789997730.252306:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713028352:0@lo:400:kworker.0 00000100:00100000:0.0:1789997730.252310:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713027968 00000100:00100000:0.0:1789997730.252313:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713027968 00000100:00100000:3.0:1789997730.252331:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997730.252356:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997730.252394:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713028096 00000100:00100000:1.0:1789997730.252397:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713028096 00000100:00100000:1.0:1789997730.252429:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1789997730.252438:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713028096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997730.252501:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713028096:12345-0@lo:400:kworker.0 Request processed in 64us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997730.252509:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:1.0:1789997730.252552:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713028096:0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.252769:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789997730.252776:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713027712:0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.252805:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997730.252827:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713028224:0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.252845:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997730.252869:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713027712 00000100:00100000:3.0:1789997730.252872:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713027712 00000100:00100000:3.0:1789997730.252898:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1789997730.252904:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713027712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.252940:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713027712:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997730.252946:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1789997730.254895:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713028352 00000100:00100000:0.0:1789997730.254907:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713028352 00000100:00100000:0.0:1789997730.254975:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1789997730.254984:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713027840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.255004:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1789997730.255012:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713027968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.255051:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713027968:12345-0@lo:400:kworker.0 Request processed in 40us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997730.255051:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713027840:12345-0@lo:400:kworker.0 Request processed in 69us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997730.255058:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1789997730.255069:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1789997730.255072:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:3.0:1789997730.255078:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713028352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997730.255093:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713028224 00000100:00100000:0.0:1789997730.255096:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713028224 00000100:00100000:3.0:1789997730.255105:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713028352:12345-0@lo:400:kworker.0 Request processed in 27us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997730.255110:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1789997730.255122:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1789997730.255128:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713028224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.255156:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997730.255156:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713028224:12345-0@lo:400:kworker.0 Request processed in 29us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997730.255162:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:0.0:1789997730.255170:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704542848 00000100:00100000:0.0:1789997730.255173:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704542848 00000100:00100000:0.0:1789997730.255191:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 536 00000100:00100000:3.0:1789997730.255196:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713027712:0@lo:400:kworker.0 00000100:00100000:0.0:1789997730.255196:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53739:x1876946704542848:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997730.255210:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713028224:0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.255220:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713028352:0@lo:400:kworker.0 00000100:00100000:3.0:1789997730.255229:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713027840:0@lo:400:kworker.0 00000100:00100000:2.0:1789997730.255426:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713027968:0@lo:400:kworker.0 00000100:00080000:2.0:1789997730.255446:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997730.255463:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997730.255466:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997730.255865:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53739:x1876946704542848:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 666us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997730.255872:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 536 00000100:00100000:1.0:1789997730.257224:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997730.257358:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704542976 00000100:00100000:0.0:1789997730.257364:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704542976 00000100:00100000:0.0:1789997730.257410:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1000 00000100:00100000:0.0:1789997730.257419:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53739:x1876946704542976:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997730.257815:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53739:x1876946704542976:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 395us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997730.257823:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1000 00010000:00010000:1.0:1789997730.570854:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997731.596382:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997731.617781:0:90978:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce91a8f70 20000000:00000080:0.0:1789997731.617799:0:90978:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c5e75c00 uarg=0000000000000000 00010000:00010000:0.0:1789997731.618284:0:90978:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997731.618311:0:90978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997731.618314:0:90978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997731.618324:0:90978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592d81d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef6d expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997731.618343:0:90978:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997731.618416:0:90978:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997731.618444:0:90978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997731.618457:0:90978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997731.618466:0:90978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997731.618506:0:90978:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997731.618519:0:90978:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 18 pid: 7594 timeout: 2070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997731.618533:0:90978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90978:1876946713028480:0@lo:104: 00000100:00100000:0.0:1789997731.618603:0:90978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997731.618795:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789997731.618808:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713028480 00000100:00100000:1.0:1789997731.618814:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713028480 00000100:00100000:1.0:1789997731.618872:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789997731.618883:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd790850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:90978:x1876946713028480:12345-0@lo:104: 00010000:00010000:1.0:1789997731.618897:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997731.618947:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997731.618953:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd790850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:90978:x1876946713028480:12345-0@lo:104: Request processed in 72us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997731.618959:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789997731.619045:0:90978:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c60df240 going to sleep for 11 seconds 00000100:00100000:0.0:1789997731.619069:0:90978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90978:1876946713028480:0@lo:104: 00010000:00010000:0.0:1789997731.619089:0:90978:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619197:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997731.619205:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619213:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997731.619218:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619227:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997731.619234:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997731.619239:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997731.619307:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619314:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997731.619343:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619355:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592d7f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d7fa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619380:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997731.619381:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997731.619383:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997731.619534:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713028608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997731.619571:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997731.619768:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713028608 00000100:00100000:3.0:1789997731.619774:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713028608 00010000:00010000:3.0:1789997731.619797:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 19 pid: 7594 timeout: 2070 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997731.619826:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789997731.619833:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713028608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997731.619844:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997731.619849:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 19 pid: 7594 timeout: 2070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619859:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 19 pid: 7594 timeout: 2070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619871:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592d7fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d7f3 expref: 19 pid: 7594 timeout: 2070 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619883:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619890:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619910:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619917:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619923:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619930:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619936:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997731.619940:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619946:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619972:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997731.619981:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997731.620015:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713028608:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997731.620021:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789997731.620132:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713028608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997731.620174:0:90978:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997731.620182:0:90978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997731.620188:0:90978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592d871 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997732.118098:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997732.118143:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997732.118262:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704543104 00000100:00100000:2.0:1789997732.118274:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704543104 00000100:00100000:3.0:1789997732.118295:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997732.118341:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997732.118343:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1145 00000100:00100000:2.0:1789997732.118355:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704543104:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997732.118391:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704543232 00000100:00100000:0.0:1789997732.118397:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704543232 00000100:00100000:2.0:1789997732.118437:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704543104:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997732.118445:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1145 00000100:00100000:0.0:1789997732.118459:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1405 00000100:00100000:0.0:1789997732.118470:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704543232:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1789997732.118485:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997732.118505:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704543232:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997732.118512:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1405 00000100:00100000:1.0:1789997732.118964:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704543360 00000100:00100000:1.0:1789997732.118970:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704543360 00000100:00080000:2.0:1789997732.118997:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997732.119019:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704543488 00000100:00100000:1.0:1789997732.119023:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704543488 00000100:00100000:2.0:1789997732.119035:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 932 00000100:00100000:2.0:1789997732.119045:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704543360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997732.119066:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 933 00000100:00100000:1.0:1789997732.119076:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704543488:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997732.119096:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704543360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 52us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997732.119107:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 932 00000100:00100000:1.0:1789997732.119114:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704543488:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 39us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997732.119121:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 933 00000100:00080000:3.0:1789997732.119307:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997732.299036:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997732.299060:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713028736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997732.299131:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997732.299339:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713028736 00000100:00100000:2.0:1789997732.299349:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713028736 00000100:00100000:2.0:1789997732.299430:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:2.0:1789997732.299441:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713028736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997732.299476:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997732.299524:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713028736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997732.299531:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00080000:0.0:1789997732.299578:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997732.299615:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713028736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997732.303596:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713028864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997732.303718:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997732.303957:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713028864 00000100:00100000:2.0:1789997732.303965:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713028864 00000100:00100000:2.0:1789997732.304153:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1789997732.304164:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713028864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997732.304201:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997732.304250:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713028864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997732.304257:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1789997732.304345:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713028864:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997732.305793:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789997732.621105:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997733.130716:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997733.130723:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997733.130727:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997733.130777:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997733.130790:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997733.130801:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997733.130828:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713028992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997733.130903:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997733.130996:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c60df780 going to sleep for 11 seconds 00000100:00100000:3.0:1789997733.131166:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713028992 00000100:00100000:3.0:1789997733.131175:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713028992 00000100:00100000:3.0:1789997733.131262:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1789997733.131271:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713028992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997733.131284:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997733.131298:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d878 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997733.131321:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d878 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997733.131332:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d878 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997733.131342:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ac00, rc 0) 00000100:00100000:3.0:1789997733.131408:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713028992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997733.131415:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1789997733.131497:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713028992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997733.131525:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997733.131535:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997733.131556:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997733.131560:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997733.131569:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997733.606254:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997733.606415:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704543616 00000100:00100000:1.0:1789997733.606431:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704543616 00000100:00100000:1.0:1789997733.606774:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1001 00000100:00100000:1.0:1789997733.606788:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53825:x1876946704543616:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997733.606820:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997733.606847:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d886 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef82 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.606918:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d88d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.606932:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.606946:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997733.606979:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:1.0:1789997733.606983:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997733.607002:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.607026:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592d886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef82 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.607047:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d88d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef82 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.607055:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997733.607058:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997733.607062:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997733.607146:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53825:x1876946704543616:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 362us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997733.607153:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1001 00000100:00100000:3.0:1789997733.616119:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997733.621320:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704543872 00000100:00100000:1.0:1789997733.621353:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704543872 00000100:00100000:1.0:1789997733.621438:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1002 00000100:00100000:1.0:1789997733.621448:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53825:x1876946704543872:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997733.621514:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997733.621559:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592d88d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef82 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.621577:0:11799:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592d81d) 00010000:00010000:1.0:1789997733.621581:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997733.621592:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997733.621618:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.621632:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.621644:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997733.643227:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997733.651392:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967680 is committed 00000004:00010000:1.0:1789997733.651481:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fb48656 reply state 00000000a289e6f4 transno 4294967680 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997733.651495:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997733.651510:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00080000:1.0:1789997733.651838:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789997733.651857:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53825:x1876946704543872:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 30406us (35744us total) trans 4294967680 rc 0/0 00000100:00100000:1.0:1789997733.651866:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1002 00010000:00010000:2.0:1789997733.652395:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997733.652406:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997733.652415:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997733.652422:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997733.652426:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997733.652434:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997733.652450:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:2.0:1789997733.652454:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997733.652458:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997733.652465:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d894 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789997734.305365:0:91175:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe422c6f00 20000000:00000080:2.0:1789997734.305398:0:91175:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4f14000 uarg=0000000000000000 00010000:00010000:2.0:1789997734.307190:0:91175:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997734.307211:0:91175:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997734.307226:0:91175:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997734.307247:0:91175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997734.307265:0:91175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d878 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997734.307273:0:91175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997734.307313:0:91175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d878 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997734.307327:0:91175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d878 expref: 18 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997734.307341:0:91175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91175:1876946713029120:0@lo:104: 00000100:00100000:2.0:1789997734.307416:0:91175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997734.307472:0:91175:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c35fbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789997734.307544:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713029120 00000100:00100000:1.0:1789997734.307552:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713029120 00000100:00100000:1.0:1789997734.308468:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789997734.308482:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:91175:x1876946713029120:12345-0@lo:104: 00010000:00010000:1.0:1789997734.308496:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997734.308635:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997734.308642:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:91175:x1876946713029120:12345-0@lo:104: Request processed in 164us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997734.308650:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:0.0:1789997734.308930:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997734.308937:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.308945:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997734.308949:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.308957:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997734.308965:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997734.308971:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997734.309014:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309021:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997734.309044:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309051:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592d878 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d87f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309077:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997734.309078:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997734.309080:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997734.309094:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713029248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997734.309127:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997734.309172:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713029248 00000100:00100000:0.0:1789997734.309177:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713029248 00010000:00010000:0.0:1789997734.309197:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d878 expref: 19 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997734.309218:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789997734.309224:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713029248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997734.309234:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997734.309239:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d878 expref: 19 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309249:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d878 expref: 19 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309265:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309272:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309285:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309292:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309300:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309306:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309311:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997734.309314:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309321:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309328:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.309341:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997734.309382:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713029248:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997734.309389:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789997734.309426:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713029248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997734.310311:0:91175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592d87f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d878 expref: 18 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997734.310323:0:91175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91175:1876946713029120:0@lo:104: 00010000:00010000:3.0:1789997734.310340:0:91175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997734.310350:0:91175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997734.310356:0:91175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997734.310362:0:91175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592d89b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997734.667958:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997735.371902:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713029376:0@lo:400:kworker.0 00000100:00100000:1.0:1789997735.371977:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997735.372056:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713029376 00000100:00100000:0.0:1789997735.372066:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713029376 00000100:00100000:0.0:1789997735.372115:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1789997735.372125:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713029376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997735.372344:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713029632:0@lo:400:kworker.0 00000100:00100000:2.0:1789997735.372394:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997735.372420:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997735.372427:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713029760:0@lo:400:kworker.0 00000100:00100000:2.0:1789997735.372455:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997735.372488:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713029632 00000100:00100000:2.0:1789997735.372491:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713029632 00000100:00100000:2.0:1789997735.372532:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1789997735.372540:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713029632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997735.372580:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713029632:12345-0@lo:400:kworker.0 Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997735.372587:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1789997735.372607:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713029760 00000100:00100000:2.0:1789997735.372611:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713029760 00000100:00100000:2.0:1789997735.372637:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1789997735.372644:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713029760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997735.372736:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713029760:12345-0@lo:400:kworker.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997735.372743:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1789997735.372782:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713029760:0@lo:400:kworker.0 00000100:00100000:2.0:1789997735.372795:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713029632:0@lo:400:kworker.0 00000100:00100000:1.0:1789997735.373092:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713029376:0@lo:400:kworker.0 00000100:00100000:0.0:1789997735.373096:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713029376:12345-0@lo:400:kworker.0 Request processed in 971us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997735.373105:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1789997735.373116:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713029888:0@lo:400:kworker.0 00000100:00080000:0.0:1789997735.373144:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997735.373150:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789997735.373150:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997735.373164:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713029504:0@lo:400:kworker.0 00000100:00100000:0.0:1789997735.373194:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997735.373233:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713030016:0@lo:400:kworker.0 00000100:00100000:0.0:1789997735.373269:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997735.373296:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713029888 00000100:00100000:2.0:1789997735.373302:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713029888 00000100:00100000:0.0:1789997735.373308:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713029504 00000100:00100000:0.0:1789997735.373314:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713029504 00000100:00100000:2.0:1789997735.373342:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:0.0:1789997735.373363:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713030016 00000100:00100000:2.0:1789997735.373365:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713029888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997735.373368:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713030016 00000100:00100000:0.0:1789997735.373403:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1789997735.373414:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713029888:12345-0@lo:400:kworker.0 Request processed in 63us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997735.373422:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713029504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997735.373423:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00080000:2.0:1789997735.373447:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997735.373452:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997735.373480:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713029504:12345-0@lo:400:kworker.0 Request processed in 70us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997735.373489:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:1.0:1789997735.373505:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1789997735.373515:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713030016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997735.373537:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713029504:0@lo:400:kworker.0 00000100:00100000:1.0:1789997735.373557:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713030016:12345-0@lo:400:kworker.0 Request processed in 43us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997735.373562:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713030016:0@lo:400:kworker.0 00000100:00100000:1.0:1789997735.373569:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1789997735.373603:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713029888:0@lo:400:kworker.0 10000000:01000000:2.0:1789997735.626781:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997735.626788:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997735.626793:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997735.626830:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997735.626849:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997735.626860:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997735.626884:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713030144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997735.626949:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997735.627477:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789997735.627522:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713030144 00000100:00100000:3.0:1789997735.627530:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713030144 00000100:00100000:3.0:1789997735.627570:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1789997735.627580:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713030144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997735.627593:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997735.627611:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d8a2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997735.627771:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997735.627785:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997735.627795:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:0.0:1789997735.627885:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713030144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 306us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997735.627892:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1789997735.628071:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713030144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997735.628087:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997735.628096:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997735.628114:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997735.628119:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997735.628127:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997735.691381:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997736.076283:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997736.076691:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704544000 00000100:00100000:2.0:1789997736.076704:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704544000 00000100:00080000:1.0:1789997736.076766:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997736.076776:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1003 00000100:00100000:2.0:1789997736.076789:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53901:x1876946704544000:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997736.076813:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997736.076837:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d8b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef89 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.076905:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077035:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077051:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077067:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077074:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077082:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077648:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d8c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077681:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077690:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997736.077715:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:2.0:1789997736.077720:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997736.077743:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077756:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077762:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077769:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077775:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997736.077780:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077787:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077802:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997736.077805:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997736.077811:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077818:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077831:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077837:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077848:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077854:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997736.077858:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077865:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077873:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997736.077876:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997736.077880:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.077886:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d8be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.078217:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d8b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef89 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.078236:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef89 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.078244:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997736.078246:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997736.078249:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997736.079730:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53901:x1876946704544000:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 2934us (3448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997736.079746:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1003 00000100:00100000:0.0:1789997736.083614:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997736.083770:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704544256 00000100:00100000:2.0:1789997736.083780:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704544256 00000100:00100000:2.0:1789997736.084126:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1004 00000100:00100000:2.0:1789997736.084138:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53901:x1876946704544256:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997736.084158:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997736.084175:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d8cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef90 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.084421:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.084437:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.084449:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.084463:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.084470:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.084476:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997736.085219:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:2.0:1789997736.085516:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d8e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085529:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085537:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085568:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085576:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085583:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085589:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997736.085593:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085600:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085613:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997736.085617:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997736.085621:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085628:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592d8d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997736.085640:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebb94d78 reply state 00000000e6753456 transno 4294967681 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997736.085649:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997736.085698:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592d8cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef90 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085715:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef90 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.085722:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997736.085725:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997736.085727:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997736.085791:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:53901:x1876946704544256:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1655us (2183us total) trans 4294967681 rc 0/0 00000100:00100000:2.0:1789997736.085799:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1004 00010000:00010000:2.0:1789997736.088743:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.088759:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.088766:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.088772:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997736.088777:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.088785:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.088803:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38d0bdfb00) 00010000:00010000:2.0:1789997736.088806:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997736.088810:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.088817:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592d8da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997736.089630:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997736.089854:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704544512 00000100:00100000:2.0:1789997736.089864:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704544512 00000100:00100000:2.0:1789997736.090022:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1005 00000100:00100000:2.0:1789997736.090034:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:53901:x1876946704544512:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:2.0:1789997736.090086:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997736.090106:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592d8e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef90 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.090122:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997736.090130:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997736.090179:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.090193:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.090203:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997736.090321:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000972b0a2f reply state 00000000c17f21fa transno 4294967682 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997736.090347:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997736.090442:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:53901:x1876946704544512:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 410us (816us total) trans 4294967682 rc 0/0 00000100:00100000:2.0:1789997736.090448:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1005 00010000:00010000:2.0:1789997736.092200:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.092213:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.092219:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.092225:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997736.092229:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.092237:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.092250:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997736.092253:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997736.092258:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.092264:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592d8ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997736.094940:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997736.095136:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704544640 00000100:00100000:3.0:1789997736.095147:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704544640 00000100:00100000:3.0:1789997736.095203:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1006 00000100:00100000:3.0:1789997736.095212:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:53901:x1876946704544640:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997736.095236:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997736.095257:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d8f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef97 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.095317:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef97 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.095331:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d8f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef97 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.095361:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997736.095365:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997736.095369:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997736.095470:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:53901:x1876946704544640:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 258us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997736.095478:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1006 00000100:00100000:3.0:1789997736.097822:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997736.097859:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704544768 00000100:00100000:2.0:1789997736.097875:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704544768 00000100:00100000:2.0:1789997736.098000:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 537 00000100:00100000:2.0:1789997736.098010:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704544768:12345-192.168.204.4@tcp:2:touch.60003 00000100:00080000:1.0:1789997736.098161:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997736.098606:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704544768:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 595us (797us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789997736.098614:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 537 00000100:00100000:1.0:1789997736.101125:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997736.101278:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704545024 00000100:00100000:2.0:1789997736.101287:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704545024 00000100:00100000:2.0:1789997736.101352:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:2.0:1789997736.101361:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:53901:x1876946704545024:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:2.0:1789997736.102032:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:53901:x1876946704545024:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 670us (912us total) trans 4294967683 rc 0/0 00000100:00100000:2.0:1789997736.102040:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 102 00000100:00100000:0.0:1789997736.139768:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997736.139852:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704545152 00000100:00100000:3.0:1789997736.139860:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704545152 00000100:00100000:3.0:1789997736.139953:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1007 00000100:00100000:3.0:1789997736.139964:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:53905:x1876946704545152:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:3.0:1789997736.139988:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997736.140005:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d8fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaef9e expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140059:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140074:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140085:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140099:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140107:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140119:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140203:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d912 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140212:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140219:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997736.140249:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x53:0x0]: returning size 0 00000004:00200000:3.0:1789997736.140255:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997736.140273:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140285:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d912 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140292:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140299:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140305:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140312:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997736.140316:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140324:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140349:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997736.140352:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997736.140357:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140363:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592d904 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140380:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140390:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140396:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140402:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997736.140404:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140409:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140416:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38ee49e600) 00010000:00010000:3.0:1789997736.140418:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997736.140420:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140426:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d90b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140483:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592d8fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef9e expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140498:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d912 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef9e expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997736.140504:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997736.140507:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997736.140510:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997736.140576:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:53905:x1876946704545152:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 614us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997736.140583:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1007 00000100:00100000:3.0:1789997736.144212:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997736.145244:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704545280 00000100:00100000:2.0:1789997736.145257:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704545280 00000100:00100000:2.0:1789997736.145323:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 538 00000100:00100000:2.0:1789997736.145345:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704545280:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:2.0:1789997736.145363:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997736.145384:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefa5 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997736.145412:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x6ab132a8, atime: 0x6ab132a8, ctime: 0x6ab132a8, blocks: 0x1 00010000:00010000:2.0:1789997736.145430:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=1924s v=(0 0) 00010000:00010000:2.0:1789997736.145435:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997736.145445:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.145471:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 7 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.145950:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997736.146018:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704545280:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 684us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997736.146026:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 538 00000100:00100000:2.0:1789997736.149914:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997736.150037:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704545536 00000100:00100000:0.0:1789997736.150047:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704545536 00000100:00100000:0.0:1789997736.150105:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1008 00000100:00100000:0.0:1789997736.150116:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:53905:x1876946704545536:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:0.0:1789997736.150178:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997736.150205:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592d912 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef9e expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.150781:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592d8f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x53:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef97 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.150797:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:0.0:1789997736.150809:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997736.150832:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.150845:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.150854:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.150868:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.150876:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.150883:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.151172:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.151181:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.151189:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789997736.152088:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].32, 64 off10240 00000004:00080000:0.0:1789997736.152099:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1924844445067ns, next at 1925844443028ns, rc = 0 00010000:00010000:0.0:1789997736.152170:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152183:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152192:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152200:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152206:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152212:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152409:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997736.152517:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997736.152524:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997736.152532:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997736.152536:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997736.152544:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997736.152556:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:1.0:1789997736.152559:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997736.152564:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997736.152569:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592d935 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997736.152585:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997736.152587:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997736.152589:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997736.152630:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152638:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152644:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152649:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997736.152690:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152696:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152705:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997736.152707:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997736.152710:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152716:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592d92e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152735:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152742:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152748:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152752:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997736.152755:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152761:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152769:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:0.0:1789997736.152771:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997736.152774:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.152779:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592d920 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997736.152802:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091de24ec reply state 00000000106b63e4 transno 4294967684 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997736.152811:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997736.152901:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:53905:x1876946704545536:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 2784us (2992us total) trans 4294967684 rc 0/0 00000100:00100000:0.0:1789997736.152910:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1008 00010000:00010000:2.0:1789997736.154903:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.154919:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.154926:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.154933:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997736.154936:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.154953:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.154968:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38c28e9f00) 00010000:00010000:2.0:1789997736.154970:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997736.154975:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997736.154982:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592d927 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997736.714878:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997737.239094:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997737.239127:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997737.239158:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997737.239189:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997737.239213:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704545792 00000100:00100000:0.0:1789997737.239222:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704545792 00000100:00100000:2.0:1789997737.239258:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704545664 00000100:00100000:2.0:1789997737.239263:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704545664 00000100:00100000:0.0:1789997737.239277:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1409 00000100:00100000:0.0:1789997737.239287:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2355:x1876946704545792:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997737.239292:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1149 00000100:00100000:2.0:1789997737.239298:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704545664:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997737.239415:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704545664:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997737.239423:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1149 00000100:00100000:0.0:1789997737.241842:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2355:x1876946704545792:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2547us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997737.241856:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1409 00000100:00100000:0.0:1789997737.241902:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704545920 00000100:00100000:0.0:1789997737.241910:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704545920 00000100:00100000:0.0:1789997737.241969:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704546048 00000100:00100000:0.0:1789997737.241973:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704546048 00000100:00080000:3.0:1789997737.241995:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997737.242004:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 936 00000100:00100000:0.0:1789997737.242017:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704545920:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997737.242038:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 937 00000100:00100000:2.0:1789997737.242051:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704546048:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997737.242096:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704545920:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997737.242103:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 936 00000100:00100000:2.0:1789997737.242422:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704546048:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 373us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997737.242430:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 937 00000020:00000080:1.0:1789997737.255954:0:91419:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdba6b2a80 20000000:00000080:1.0:1789997737.255973:0:91419:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4d05000 uarg=0000000000000000 00010000:00010000:1.0:1789997737.256184:0:91419:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997737.256214:0:91419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:1.0:1789997737.256218:0:91419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997737.256228:0:91419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d8c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaef89 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997737.256250:0:91419:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997737.256264:0:91419:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997737.256278:0:91419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997737.256291:0:91419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997737.256299:0:91419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997737.256347:0:91419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997737.256362:0:91419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 18 pid: 5804 timeout: 2025 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997737.256376:0:91419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91419:1876946713030272:0@lo:104: 00000100:00100000:1.0:1789997737.256571:0:91419:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997737.256759:0:91419:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997737.256920:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713030272 00000100:00100000:0.0:1789997737.256927:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713030272 00000100:00100000:0.0:1789997737.257004:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789997737.257015:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:91419:x1876946713030272:12345-0@lo:104: 00010000:00010000:0.0:1789997737.257027:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997737.257126:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997737.257133:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:91419:x1876946713030272:12345-0@lo:104: Request processed in 120us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997737.257140:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789997737.257212:0:91419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91419:1876946713030272:0@lo:104: 00010000:00010000:1.0:1789997737.257229:0:91419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257261:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997737.257268:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257276:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997737.257280:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257288:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997737.257294:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997737.257300:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997737.257344:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257350:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789997737.257395:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713030400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997737.257438:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789997737.257591:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257600:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d8a2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d8a9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257619:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997737.257621:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997737.257622:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997737.257632:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713030400 00000100:00100000:3.0:1789997737.257636:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713030400 00010000:00010000:3.0:1789997737.257672:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 19 pid: 5804 timeout: 2025 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997737.257693:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789997737.257700:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713030400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997737.257710:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997737.257715:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 19 pid: 5804 timeout: 2025 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257725:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 19 pid: 5804 timeout: 2025 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257737:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b800/0x65b43101d592d8a9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d8a2 expref: 19 pid: 5804 timeout: 2025 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257750:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257759:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257772:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257784:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257791:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257797:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257803:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997737.257807:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257814:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257826:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997737.257834:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997737.258126:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713030400:12345-0@lo:103:ldlm_bl.0 Request processed in 426us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997737.258133:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789997737.258212:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713030400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997737.258233:0:91419:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997737.258242:0:91419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997737.258247:0:91419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592d93c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997737.418835:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1789997737.418879:0:7604:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1926111224230ns, next at 1927111221767ns, rc = 0 00000100:00100000:1.0:1789997737.418987:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713030528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997737.419061:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997737.419641:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713030528 00000100:00100000:3.0:1789997737.419757:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713030528 00000100:00100000:2.0:1789997737.419937:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1789997737.419951:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713030528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997737.419996:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997737.420056:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713030528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997737.420063:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1789997737.420139:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713030656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997737.420171:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997737.420230:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713030656 00000100:00100000:2.0:1789997737.420235:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713030656 00000100:00080000:3.0:1789997737.421005:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997737.421011:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997737.421528:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1789997737.421540:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713030656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997737.421580:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997737.421648:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713030656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997737.421674:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1789997737.421724:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713030528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997737.423491:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713030656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997737.740177:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997738.762728:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997738.762734:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997738.762739:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997738.762779:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997738.762792:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997738.762804:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997738.762827:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713030784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997738.762885:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997738.762926:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38faf3d840 going to sleep for 11 seconds 00010000:00010000:2.0:1789997738.763078:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997738.763125:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713030784 00000100:00100000:0.0:1789997738.763132:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713030784 00000100:00100000:0.0:1789997738.763183:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:0.0:1789997738.763191:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713030784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997738.763203:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997738.763215:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d943 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997738.763236:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d943 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997738.763246:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d943 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997738.763260:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997738.763319:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713030784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997738.763326:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1789997738.763704:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713030784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997738.763719:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997738.763730:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997738.763757:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997738.763762:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997738.763769:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997739.016141:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967360 is committed 00000001:00080000:2.0:1789997739.024461:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967684 is committed 00000004:00080000:2.0:1789997739.024473:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 90 committed 00000004:00080000:2.0:1789997739.024493:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00000100:00100000:2.0:1789997739.024754:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713030912:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997739.024815:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997739.024955:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713030912 00000100:00100000:3.0:1789997739.024962:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713030912 00000100:00100000:3.0:1789997739.025017:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1789997739.025026:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713030912:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789997739.025053:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:32 count 1 00010000:00010000:3.0:1789997739.025078:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.025099:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 5 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.025108:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1789997739.025112:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997739.025117:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.025143:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 5 pid: 6656 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.025158:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 5 pid: 6656 timeout: 2027 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997739.025169:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1876946713031040:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997739.025229:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6240 going to sleep for 11 seconds 00000100:00080000:1.0:1789997739.026039:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997739.031015:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6658:1876946713031040:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997739.031046:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997739.032422:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997739.032512:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704546176 00000100:00100000:0.0:1789997739.032520:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704546176 00010000:00010000:0.0:1789997739.032575:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 6 pid: 6656 timeout: 2027 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997739.032614:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 404 00000100:00100000:0.0:1789997739.032623:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704546176:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789997739.032638:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997739.032643:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 6 pid: 6656 timeout: 2027 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997739.032671:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 6 pid: 6656 timeout: 2027 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997739.032695:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a189263/0x65b43101d592d919 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefa5 expref: 6 pid: 6656 timeout: 2027 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997739.032715:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997739.032720:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997739.032726:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997739.032736:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997739.032762:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997739.032808:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704546176:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 186us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997739.032815:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 404 00010000:00010000:0.0:1789997739.032843:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997739.032853:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997739.032863:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997739.032872:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789997739.032980:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997739.034635:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997739.035156:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713030912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10129us (10338us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1789997739.035166:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000004:00080000:2.0:1789997739.038647:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fd86e300/2, rc 0, transno 4294967361 00000100:00100000:2.0:1789997739.038680:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713030912:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789997739.039387:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997739.039398:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.039412:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997739.039416:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.039428:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.039448:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.039455:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007da5c494/0x65b43101d592d951 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.039477:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997739.039479:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997739.039481:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997739.589543:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997739.589616:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704546304 00000100:00100000:3.0:1789997739.589627:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704546304 00000100:00100000:3.0:1789997739.589725:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1009 00000100:00100000:3.0:1789997739.589737:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:53993:x1876946704546304:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997739.589757:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997739.589781:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefac expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.589848:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d95f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.589863:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.589877:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997739.589910:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:3.0:1789997739.589914:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997739.589931:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d95f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.589968:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592d958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefac expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.589988:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d95f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefac expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997739.589996:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:3.0:1789997739.589999:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997739.590003:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:3.0:1789997739.590058:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53993:x1876946704546304:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 323us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997739.590064:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1009 00000100:00080000:1.0:1789997739.590279:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997739.600343:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997739.600435:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704546560 00000100:00100000:1.0:1789997739.600445:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704546560 00000100:00100000:1.0:1789997739.600518:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1010 00000100:00100000:1.0:1789997739.600532:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53993:x1876946704546560:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997739.600587:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997739.600618:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592d95f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefac expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.600637:0:5811:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592d8c5) 00010000:00010000:1.0:1789997739.600643:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38ee49ed00) 00010000:00010000:1.0:1789997739.600691:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997739.600715:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.600728:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.600740:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789997739.632792:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967685 is committed 00000004:00010000:1.0:1789997739.633694:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c71d5f4 reply state 0000000080f97e36 transno 4294967685 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997739.633709:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997739.633727:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00080000:1.0:1789997739.633831:0:5811:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789997739.633852:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:53993:x1876946704546560:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 33320us (33515us total) trans 4294967685 rc 0/0 00000100:00100000:1.0:1789997739.633860:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1010 00010000:00010000:1.0:1789997739.633894:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.633902:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.633914:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.633919:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997739.633924:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.633931:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.633945:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:1.0:1789997739.633948:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997739.633952:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.633958:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592d966 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997739.789806:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997740.444902:0:91617:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe13f275d0 20000000:00000080:0.0:1789997740.444920:0:91617:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c62ef800 uarg=0000000000000000 00010000:00010000:0.0:1789997740.446738:0:91617:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997740.446758:0:91617:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997740.446773:0:91617:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997740.446791:0:91617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997740.446870:0:91617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d943 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997740.446879:0:91617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997740.446918:0:91617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d943 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997740.447008:0:91617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d943 expref: 18 pid: 5805 timeout: 2029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997740.447022:0:91617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91617:1876946713031168:0@lo:104: 00000100:00100000:0.0:1789997740.447083:0:91617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997740.447261:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713031168 00000100:00100000:1.0:1789997740.447270:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713031168 00000100:00100000:1.0:1789997740.447333:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789997740.447343:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:91617:x1876946713031168:12345-0@lo:104: 00010000:00010000:1.0:1789997740.447355:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997740.447409:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997740.447415:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:91617:x1876946713031168:12345-0@lo:104: Request processed in 74us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997740.447425:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:2.0:1789997740.447491:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997740.447499:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.447506:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997740.447510:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.447518:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997740.447526:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997740.447532:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997740.447561:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.447567:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997740.447598:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.447606:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592d943 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d94a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.447626:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997740.447628:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997740.447630:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997740.447750:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713031296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997740.447782:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997740.447899:0:91617:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789997740.447922:0:91617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91617:1876946713031168:0@lo:104: 00010000:00010000:0.0:1789997740.447954:0:91617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997740.463469:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713031296 00000100:00100000:2.0:1789997740.463492:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713031296 00010000:00010000:2.0:1789997740.463544:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d943 expref: 19 pid: 5805 timeout: 2029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997740.463595:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789997740.463605:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713031296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997740.463621:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997740.463626:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d943 expref: 19 pid: 5805 timeout: 2029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.463640:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d943 expref: 19 pid: 5805 timeout: 2029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.463950:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592d94a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d943 expref: 19 pid: 5805 timeout: 2029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.463978:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.463987:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.464015:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.464028:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.464034:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.464041:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.464048:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997740.464052:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.464061:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997740.464586:0:91617:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997740.464596:0:91617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.467095:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.467540:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592d96d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997740.467566:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997740.467727:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713031296:12345-0@lo:103:ldlm_bl.0 Request processed in 4120us (19940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997740.467736:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1789997740.468595:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713031296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997740.492128:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713031424:0@lo:400:kworker.0 00000100:00100000:1.0:1789997740.492208:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997740.492269:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713031936:0@lo:400:kworker.0 00000100:00100000:1.0:1789997740.492294:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997740.492369:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997740.492381:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713031808:0@lo:400:kworker.0 00000100:00100000:1.0:1789997740.492416:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997740.492458:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713031424 00000100:00100000:1.0:1789997740.492469:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713031424 00000100:00100000:1.0:1789997740.492533:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713031936 00000100:00100000:1.0:1789997740.492536:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713031936 00000100:00100000:1.0:1789997740.492572:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1789997740.492589:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713031424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997740.492732:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713031552:0@lo:400:kworker.0 00000100:00100000:2.0:1789997740.492766:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997740.492795:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997740.492802:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713031680:0@lo:400:kworker.0 00000100:00100000:2.0:1789997740.492824:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997740.492850:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713031552 00000100:00100000:2.0:1789997740.492854:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713031552 00000100:00100000:2.0:1789997740.492889:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1789997740.492896:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713031936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997740.493165:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713031424:12345-0@lo:400:kworker.0 Request processed in 577us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997740.493172:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:0.0:1789997740.493273:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713031424:0@lo:400:kworker.0 00000100:00100000:2.0:1789997740.493340:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713031936:12345-0@lo:400:kworker.0 Request processed in 444us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997740.493352:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1789997740.493374:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:2.0:1789997740.493387:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713031552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997740.493457:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713031808 00000100:00100000:1.0:1789997740.493461:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713031808 00000100:00100000:1.0:1789997740.493491:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713031680 00000100:00100000:1.0:1789997740.493495:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713031680 00000100:00100000:1.0:1789997740.493518:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1789997740.493525:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713031808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997740.493563:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713031808:12345-0@lo:400:kworker.0 Request processed in 38us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997740.493570:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:1.0:1789997740.493585:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1789997740.493592:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713031680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997740.493698:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713031808:0@lo:400:kworker.0 00000100:00100000:0.0:1789997740.493709:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713031936:0@lo:400:kworker.0 00000100:00100000:2.0:1789997740.493786:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713031552:12345-0@lo:400:kworker.0 Request processed in 405us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997740.493794:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1789997740.494828:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713031680:12345-0@lo:400:kworker.0 Request processed in 1234us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997740.494836:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00080000:1.0:1789997740.494862:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997740.494867:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997740.497074:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713031680:0@lo:400:kworker.0 00000100:00100000:0.0:1789997740.497094:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713031552:0@lo:400:kworker.0 00010000:00010000:3.0:1789997740.810944:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997741.584586:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997741.584593:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997741.584599:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997741.584669:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997741.584682:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997741.584694:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997741.584720:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713032064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997741.584786:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997741.584855:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789997741.584922:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713032064 00000100:00100000:2.0:1789997741.584931:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713032064 00000100:00100000:2.0:1789997741.584980:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1789997741.584990:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713032064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997741.585003:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997741.585017:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d974 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997741.585042:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d974 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997741.585123:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d974 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997741.585138:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997741.585191:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713032064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997741.585198:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1789997741.585293:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713032064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997741.585309:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997741.585318:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997741.585336:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997741.585341:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997741.585348:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997741.834810:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997742.362454:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997742.362497:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997742.362530:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997742.362552:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997742.362614:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704546816 00000100:00100000:0.0:1789997742.362624:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704546816 00000100:00100000:0.0:1789997742.362731:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1413 00000100:00100000:0.0:1789997742.362743:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704546816:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997742.362819:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704546816:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997742.362828:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1413 00000100:00100000:0.0:1789997742.362852:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704547072 00000100:00100000:0.0:1789997742.362855:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704547072 00000100:00100000:0.0:1789997742.362878:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704546944 00000100:00100000:0.0:1789997742.362881:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704546944 00000100:00100000:0.0:1789997742.362901:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 940 00000100:00100000:0.0:1789997742.362906:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704547072:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997742.362931:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704547072:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997742.362937:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 940 00000100:00100000:0.0:1789997742.362949:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 941 00000100:00100000:0.0:1789997742.362955:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704546944:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997742.362991:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704546944:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997742.362997:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 941 00000100:00100000:0.0:1789997742.363014:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704546688 00000100:00100000:0.0:1789997742.363017:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704546688 00000100:00100000:0.0:1789997742.363041:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1152 00000100:00100000:0.0:1789997742.363047:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704546688:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997742.363069:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704546688:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 23us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997742.363076:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1152 00000100:00080000:2.0:1789997742.363426:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997742.363431:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997742.363446:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997742.539778:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997742.539800:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713032192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997742.539865:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997742.543025:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713032192 00000100:00100000:1.0:1789997742.543037:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713032192 00000100:00100000:1.0:1789997742.543093:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1789997742.543102:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713032192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997742.543136:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997742.543220:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713032192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997742.543228:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00080000:1.0:1789997742.543250:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997742.543299:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713032192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997742.545200:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997742.545232:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713032320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997742.545419:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997742.555152:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713032320 00000100:00100000:1.0:1789997742.555167:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713032320 00000100:00080000:3.0:1789997742.555198:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997742.555252:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1789997742.555263:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713032320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997742.556106:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997742.556197:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713032320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 934us (10777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997742.556205:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1789997742.556276:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713032320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789997742.859489:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997743.506308:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997743.506560:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704547200 00000100:00100000:2.0:1789997743.506571:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704547200 00000100:00100000:2.0:1789997743.506642:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1011 00000100:00100000:2.0:1789997743.506696:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54069:x1876946704547200:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997743.506728:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997743.506753:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefb3 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.506815:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.506830:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.506845:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.506858:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.506865:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.506872:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507557:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d997 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507569:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507579:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997743.507603:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:2.0:1789997743.507607:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997743.507627:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507639:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507645:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507680:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507687:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997743.507691:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507699:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507721:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997743.507725:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997743.507730:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507736:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592d989 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507747:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507753:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507759:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507764:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997743.507767:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507778:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507785:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997743.507787:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997743.507791:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507796:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592d990 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507826:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592d982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefb3 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507842:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefb3 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997743.507849:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997743.507852:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997743.507854:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2a00, rc 0) 00000100:00100000:2.0:1789997743.508128:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54069:x1876946704547200:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1474us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997743.508136:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1011 00010000:00010000:3.0:1789997743.882773:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997744.104720:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967361 is committed 00010000:00010000:0.0:1789997744.908134:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997744.986440:0:91862:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff841b2f70 20000000:00000080:2.0:1789997744.986457:0:91862:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e82000 uarg=0000000000000000 00010000:00010000:2.0:1789997744.986701:0:91862:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789997744.986738:0:91862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997744.986747:0:91862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997744.986758:0:91862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592d997 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefb3 expref: 5 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997744.986786:0:91862:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997744.989066:0:91862:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997744.989095:0:91862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997744.989113:0:91862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d974 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997744.989122:0:91862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997744.989292:0:91862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d974 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997744.989308:0:91862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d974 expref: 18 pid: 7594 timeout: 2033 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997744.989322:0:91862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91862:1876946713032448:0@lo:104: 00000100:00100000:3.0:1789997744.989558:0:91862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997744.990061:0:91862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b51240 going to sleep for 11 seconds 00000100:00100000:2.0:1789997744.990137:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713032448 00000100:00100000:2.0:1789997744.990144:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713032448 00000100:00100000:2.0:1789997744.990301:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789997744.990310:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:91862:x1876946713032448:12345-0@lo:104: 00010000:00010000:2.0:1789997744.990324:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997744.990564:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997744.990570:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:91862:x1876946713032448:12345-0@lo:104: Request processed in 262us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997744.990580:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00010000:0.0:1789997744.990610:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997744.990626:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.990635:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997744.990639:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.990648:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997744.990721:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997744.990728:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1789997744.990761:0:91862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91862:1876946713032448:0@lo:104: 00010000:00010000:0.0:1789997744.990779:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997744.990782:0:91862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.990801:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997744.990828:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.990837:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d974 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d97b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.990854:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997744.990856:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997744.990859:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997744.990872:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713032576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997744.990905:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997744.991465:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713032576 00000100:00100000:0.0:1789997744.991471:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713032576 00010000:00010000:0.0:1789997744.991496:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d974 expref: 19 pid: 7594 timeout: 2033 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997744.991530:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1789997744.991538:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713032576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997744.991549:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997744.991555:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d974 expref: 19 pid: 7594 timeout: 2033 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991567:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d974 expref: 19 pid: 7594 timeout: 2033 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991581:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592d97b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d974 expref: 19 pid: 7594 timeout: 2033 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991594:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991694:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991708:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991714:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991721:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991728:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991734:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997744.991738:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991744:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991766:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997744.991775:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997744.991821:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713032576:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997744.991829:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1789997744.991871:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9b46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713032576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997744.991983:0:91862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997744.991993:0:91862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997744.991999:0:91862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592d99e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997745.611134:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713032704:0@lo:400:kworker.0 00000100:00100000:1.0:1789997745.611229:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997745.611325:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713032704 00000100:00100000:0.0:1789997745.611334:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713032704 00000100:00100000:0.0:1789997745.611380:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1789997745.611389:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713032704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997745.623554:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713032704:12345-0@lo:400:kworker.0 Request processed in 12156us (12316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997745.623569:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1789997745.623640:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713033088:0@lo:400:kworker.0 00000100:00100000:0.0:1789997745.623696:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713032832:0@lo:400:kworker.0 00000100:00100000:2.0:1789997745.623725:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997745.623725:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997745.623753:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713033344:0@lo:400:kworker.0 00000100:00100000:2.0:1789997745.623773:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997745.623774:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997745.623779:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713033216:0@lo:400:kworker.0 00000100:00100000:0.0:1789997745.623798:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997745.623799:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997745.623805:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713032960:0@lo:400:kworker.0 00000100:00100000:0.0:1789997745.623826:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997745.623859:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713032832 00000100:00100000:0.0:1789997745.623868:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713032832 00000100:00100000:0.0:1789997745.623902:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713033344 00000100:00100000:2.0:1789997745.623903:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713033088 00000100:00100000:0.0:1789997745.623905:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713033344 00000100:00100000:2.0:1789997745.623906:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713033088 00000100:00100000:3.0:1789997745.623972:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713032960 00000100:00100000:3.0:1789997745.623977:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713032960 00000100:00100000:2.0:1789997745.624118:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713033216 00000100:00100000:2.0:1789997745.624122:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713033216 00000100:00100000:2.0:1789997745.624142:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:2.0:1789997745.624164:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713033088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997745.624276:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713033088:12345-0@lo:400:kworker.0 Request processed in 115us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997745.624283:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00100000:2.0:1789997745.624354:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1789997745.624361:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713033216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997745.624375:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1789997745.624382:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713032832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997745.624528:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713032832:12345-0@lo:400:kworker.0 Request processed in 146us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997745.624535:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1789997745.624549:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1789997745.624579:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713033216:12345-0@lo:400:kworker.0 Request processed in 219us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997745.624587:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1789997745.624638:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:2.0:1789997745.624643:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fd86e300, transno 4294967361 00000100:00100000:2.0:1789997745.624670:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713033216:0@lo:400:kworker.0 00000100:00100000:2.0:1789997745.624683:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713033088:0@lo:400:kworker.0 00000100:00100000:3.0:1789997745.625011:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713032960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997745.625047:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713032960:12345-0@lo:400:kworker.0 Request processed in 39us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997745.625053:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00080000:3.0:1789997745.625073:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997745.625077:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997745.625079:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997745.625108:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713032960:0@lo:400:kworker.0 00000100:00100000:3.0:1789997745.625121:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713032832:0@lo:400:kworker.0 00000100:00100000:1.0:1789997745.625462:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713032704:0@lo:400:kworker.0 00000100:00100000:0.0:1789997745.625718:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1789997745.625727:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713033344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997745.625787:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713033344:12345-0@lo:400:kworker.0 Request processed in 62us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997745.625793:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1789997745.625848:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713033344:0@lo:400:kworker.0 00010000:00010000:3.0:1789997745.936050:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997746.702569:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997746.702577:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997746.702582:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997746.702629:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997746.702641:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997746.702670:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997746.702709:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713033472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997746.702784:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997746.702831:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c4ba53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997746.703327:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713033472 00000100:00100000:1.0:1789997746.703336:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713033472 00000100:00100000:1.0:1789997746.703393:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1789997746.703402:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713033472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997746.703414:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997746.703427:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d9a5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997746.703448:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997746.703460:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997746.703469:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997746.703515:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713033472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997746.703522:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1789997746.703572:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713033472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997746.703587:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997746.703595:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997746.703624:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997746.703629:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997746.703637:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997746.958184:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997747.495502:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997747.495546:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997747.495578:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997747.495602:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704547456 00000100:00100000:3.0:1789997747.495613:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704547456 00000100:00100000:0.0:1789997747.495687:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997747.495712:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1417 00000100:00100000:0.0:1789997747.495716:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704547712 00000100:00100000:0.0:1789997747.495721:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704547712 00000100:00100000:3.0:1789997747.495733:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704547456:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997747.495754:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704547584 00000100:00100000:0.0:1789997747.495757:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704547584 00000100:00100000:0.0:1789997747.495777:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 944 00000100:00100000:0.0:1789997747.495784:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704547712:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997747.495839:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704547712:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 54us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997747.495846:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 944 00000100:00100000:0.0:1789997747.495861:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 945 00000100:00100000:0.0:1789997747.495868:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704547584:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997747.495891:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704547584:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997747.495897:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 945 00000100:00100000:1.0:1789997747.496145:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704547328 00000100:00100000:1.0:1789997747.496150:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704547328 00000100:00100000:1.0:1789997747.496189:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1155 00000100:00100000:1.0:1789997747.496199:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704547328:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997747.496222:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704547456:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 493us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997747.496231:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1417 00000100:00100000:1.0:1789997747.496237:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704547328:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997747.496245:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1155 00000100:00080000:3.0:1789997747.496256:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997747.496261:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997747.496264:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997747.658809:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713033600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997747.658877:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997747.658971:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713033600 00000100:00100000:1.0:1789997747.658978:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713033600 00000100:00100000:1.0:1789997747.659029:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1789997747.659038:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713033600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997747.659070:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997747.659129:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713033600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997747.659135:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1789997747.659181:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713033600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997747.659351:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997747.659360:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713033728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997747.659391:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997747.659417:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713033728 00000100:00100000:0.0:1789997747.659421:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713033728 00000100:00100000:0.0:1789997747.659447:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1789997747.659454:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713033728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997747.659473:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997747.659504:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713033728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997747.659510:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1789997747.659538:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713033728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997747.659735:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997747.659739:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997747.978855:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997748.875480:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997748.875674:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704547840 00000100:00100000:2.0:1789997748.875685:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704547840 00000100:00100000:2.0:1789997748.875748:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1012 00000100:00100000:2.0:1789997748.875757:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54156:x1876946704547840:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997748.875777:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997748.875797:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d9b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefba expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997748.875854:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d9ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997748.875866:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997748.875879:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997748.876024:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:2.0:1789997748.876029:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997748.876058:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997748.876082:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592d9b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefba expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997748.876113:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d9ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefba expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997748.876120:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997748.876123:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997748.876127:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997748.876193:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54156:x1876946704547840:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 437us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997748.876200:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1012 00000100:00100000:0.0:1789997748.882388:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997748.882465:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704548096 00000100:00100000:1.0:1789997748.882476:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704548096 00000100:00100000:1.0:1789997748.882536:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1013 00000100:00100000:1.0:1789997748.882546:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54156:x1876946704548096:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997748.882596:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997748.882624:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592d9ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefba expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997748.882646:0:5810:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592d997) 00010000:00010000:1.0:1789997748.882908:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:1.0:1789997748.882922:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997748.882950:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997748.882964:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997748.882974:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997748.883411:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000583f4b08 reply state 00000000b347de66 transno 4294967686 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997748.883421:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997748.883430:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000100:00100000:1.0:1789997748.883521:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54156:x1876946704548096:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 974us (1141us total) trans 4294967686 rc 0/0 00000100:00100000:1.0:1789997748.883529:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1013 00010000:00010000:3.0:1789997748.896438:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997748.896456:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997748.896465:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997748.896472:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997748.896476:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997748.896484:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997748.896505:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:3.0:1789997748.896508:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997748.896513:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997748.896519:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592d9c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997749.002812:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997749.701581:0:92060:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd76128280 20000000:00000080:2.0:1789997749.701600:0:92060:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e82000 uarg=0000000000000000 00010000:00010000:2.0:1789997749.706088:0:92060:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997749.706112:0:92060:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997749.706130:0:92060:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997749.706493:0:92060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997749.706515:0:92060:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997749.706524:0:92060:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997749.706561:0:92060:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997749.706574:0:92060:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 18 pid: 5805 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997749.706587:0:92060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92060:1876946713033856:0@lo:104: 00000100:00100000:2.0:1789997749.706645:0:92060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997749.707003:0:92060:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d399de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789997749.713828:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713033856 00000100:00100000:3.0:1789997749.713847:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713033856 00000100:00100000:0.0:1789997749.726831:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789997749.726845:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:92060:x1876946713033856:12345-0@lo:104: 00010000:00010000:0.0:1789997749.726866:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727129:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997749.727136:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:92060:x1876946713033856:12345-0@lo:104: Request processed in 294us (20491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997749.727422:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:0.0:1789997749.727445:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997749.727451:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727460:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997749.727465:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727474:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997749.727482:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997749.727488:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997749.727527:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727535:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997749.727555:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727562:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3800/0x65b43101d592d9a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d9ac expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727579:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997749.727580:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997749.727582:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997749.727602:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713033984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997749.727640:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997749.727718:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713033984 00000100:00100000:0.0:1789997749.727725:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713033984 00010000:00010000:0.0:1789997749.727745:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 19 pid: 5805 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997749.727766:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789997749.727773:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713033984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997749.727783:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997749.727788:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 19 pid: 5805 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727799:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 19 pid: 5805 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727816:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727825:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727840:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727847:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727854:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727860:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727866:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997749.727870:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727878:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727887:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.727899:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997749.732292:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713033984:12345-0@lo:103:ldlm_bl.0 Request processed in 4508us (4640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997749.732308:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1789997749.735092:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713033984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997749.741591:0:92060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2800/0x65b43101d592d9ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d9a5 expref: 18 pid: 5805 timeout: 2038 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997749.741612:0:92060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92060:1876946713033856:0@lo:104: 00010000:00010000:1.0:1789997749.741637:0:92060:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.741852:0:92060:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.741861:0:92060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997749.741867:0:92060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592d9c8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997750.035387:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997750.291942:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967686 is committed 00000100:00100000:2.0:1789997750.731079:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713034368:0@lo:400:kworker.0 00000100:00100000:1.0:1789997750.731107:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713034112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997750.731169:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713034240:0@lo:400:kworker.0 00000100:00100000:1.0:1789997750.737495:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713034496:0@lo:400:kworker.0 00000100:00100000:3.0:1789997750.737516:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997750.737569:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713034112 00000100:00100000:3.0:1789997750.737578:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713034112 00000100:00100000:3.0:1789997750.737630:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1789997750.737639:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713034112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997750.737720:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713034112:12345-0@lo:400:kworker.0 Request processed in 81us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997750.737727:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1789997750.737791:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713034112:0@lo:400:kworker.0 00000100:00100000:3.0:1789997750.737799:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713034624:0@lo:400:kworker.0 00000100:00100000:3.0:1789997750.737825:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997750.738390:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997750.738424:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713034752:0@lo:400:kworker.0 00000100:00100000:0.0:1789997750.738448:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997750.738481:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713034624 00000100:00100000:0.0:1789997750.738485:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713034624 00000100:00100000:0.0:1789997750.738524:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1789997750.738532:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713034624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997750.738574:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713034624:12345-0@lo:400:kworker.0 Request processed in 43us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997750.738580:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1789997750.738599:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713034240 00000100:00100000:0.0:1789997750.738604:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713034240 00000100:00100000:0.0:1789997750.738627:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713034752 00000100:00100000:0.0:1789997750.738630:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713034752 00000100:00100000:0.0:1789997750.738681:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1789997750.738689:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713034240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997750.738727:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713034240:12345-0@lo:400:kworker.0 Request processed in 38us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997750.738733:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1789997750.738747:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1789997750.738753:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713034752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997750.738781:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713034752:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997750.738786:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00080000:0.0:1789997750.738803:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997750.738807:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997750.738836:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713034240:0@lo:400:kworker.0 00000100:00100000:0.0:1789997750.738847:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713034752:0@lo:400:kworker.0 00000100:00100000:0.0:1789997750.738871:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713034624:0@lo:400:kworker.0 00000100:00100000:1.0:1789997750.746672:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997750.746733:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713034496 00000100:00100000:1.0:1789997750.746742:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713034496 00000100:00100000:1.0:1789997750.746794:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1789997750.746804:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713034496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997750.746881:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713034496:12345-0@lo:400:kworker.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997750.746889:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00080000:1.0:1789997750.746909:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997750.746941:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713034496:0@lo:400:kworker.0 00000100:00100000:2.0:1789997750.747893:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997750.748753:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713034368 00000100:00100000:1.0:1789997750.748761:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713034368 00000100:00100000:1.0:1789997750.748826:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1789997750.748834:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713034368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997750.748890:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713034368:12345-0@lo:400:kworker.0 Request processed in 58us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997750.748897:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:1.0:1789997750.748936:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713034368:0@lo:400:kworker.0 00000100:00080000:2.0:1789997750.749356:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1789997750.922870:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997750.922879:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997750.922884:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997750.922930:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997750.922960:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997750.922971:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997750.923000:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713034880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997750.923082:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997750.923174:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789997750.926579:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713034880 00000100:00100000:2.0:1789997750.926593:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713034880 00000100:00100000:3.0:1789997750.929547:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1789997750.929572:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713034880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997750.929590:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997750.929610:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592d9cf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997750.930125:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592d9cf expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997750.930139:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d9cf expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997750.930148:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997750.930287:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713034880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 729us (7204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997750.930295:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1789997750.942535:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713034880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997750.942579:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997750.942593:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997750.942634:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997750.942640:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997750.942648:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997751.052638:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997752.089381:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997752.604005:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997752.604152:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704548480 00000100:00100000:3.0:1789997752.604164:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704548480 00000100:00100000:3.0:1789997752.604238:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 540 00000100:00100000:3.0:1789997752.604249:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704548480:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:3.0:1789997752.604282:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592d801 00000100:00080000:3.0:1789997752.604291:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a37c8049000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789997752.604330:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967359 00000100:00100000:3.0:1789997752.604597:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704548480:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 350us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997752.604605:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 540 00010000:00010000:3.0:1789997752.604625:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789997752.604934:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997752.606223:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997752.606272:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997752.606306:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997752.606331:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704548608 00000100:00100000:1.0:1789997752.606337:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704548608 00000100:00100000:1.0:1789997752.606383:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 948 00000100:00100000:1.0:1789997752.606392:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704548608:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997752.606444:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704548608:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 53us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997752.606452:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 948 00000100:00080000:1.0:1789997752.606469:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997752.606517:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704548224 00000100:00100000:3.0:1789997752.606521:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704548224 00000100:00100000:3.0:1789997752.606560:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1158 00000100:00100000:3.0:1789997752.606568:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704548224:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997752.606599:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704548224:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997752.606606:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1158 00000100:00100000:0.0:1789997752.606892:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704548352 00000100:00100000:0.0:1789997752.606897:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704548352 00000100:00100000:0.0:1789997752.606948:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1421 00000100:00100000:0.0:1789997752.606956:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704548352:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997752.606990:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704548352:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997752.606996:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1421 00000100:00080000:1.0:1789997752.607467:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997752.778984:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713035008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997752.779020:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713035136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997752.779079:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997752.779236:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997752.779379:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713035136 00000100:00100000:0.0:1789997752.779390:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713035008 00000100:00100000:1.0:1789997752.779391:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713035136 00000100:00100000:0.0:1789997752.779398:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713035008 00000100:00100000:1.0:1789997752.779468:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1789997752.779480:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713035136:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997752.779493:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997752.779499:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789997752.779516:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997752.779577:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713035136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997752.779594:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1789997752.779611:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1789997752.779618:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713035008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997752.779637:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997752.779690:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713035008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997752.779696:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1789997752.779778:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713035008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997752.779819:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713035136:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997753.098834:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997753.491936:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997753.506305:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704548736 00000100:00100000:2.0:1789997753.506320:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704548736 00000100:00100000:2.0:1789997753.506431:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1014 00000100:00100000:2.0:1789997753.506442:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704548736:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997753.506547:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704548736:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 106us (14619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997753.506554:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1014 00000100:00100000:3.0:1789997753.509981:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997753.510076:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704548864 00000100:00100000:1.0:1789997753.510085:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704548864 00000100:00100000:1.0:1789997753.510127:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 541 00000100:00100000:1.0:1789997753.510134:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876946704548864:12345-192.168.204.4@tcp:8:lfs.60003 00010000:00080000:1.0:1789997753.510162:0:6659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1942 last 0 00000020:00000080:1.0:1789997753.510193:0:6659:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592d9dd 00002000:00100000:1.0:1789997753.510206:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a37c6ec5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789997753.510217:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789997753.510336:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789997753.510362:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789997753.510435:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704548864:12345-192.168.204.4@tcp:8:lfs.60003 Request processed in 299us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997753.510442:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 541 00000100:00100000:1.0:1789997753.532829:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997753.535363:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704548992 00000100:00100000:0.0:1789997753.535377:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704548992 00000100:00100000:0.0:1789997753.536380:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 542 00000100:00100000:0.0:1789997753.536393:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54241:x1876946704548992:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997753.536730:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54241:x1876946704548992:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 340us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997753.536738:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 542 00000100:00100000:3.0:1789997753.538520:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997753.538584:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704549120 00000100:00100000:0.0:1789997753.538591:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704549120 00000100:00100000:0.0:1789997753.538643:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 543 00000100:00100000:0.0:1789997753.538673:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549120:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997753.538951:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549120:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 300us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997753.538958:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 543 00000100:00080000:2.0:1789997753.541887:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997753.546131:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997753.548313:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704549248 00000100:00100000:1.0:1789997753.548326:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704549248 00000100:00100000:1.0:1789997753.548396:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1015 00000100:00100000:1.0:1789997753.548407:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549248:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997753.552796:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549248:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 4380us (6664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997753.552810:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1015 00000100:00100000:1.0:1789997753.564363:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997753.564507:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704549376 00000100:00100000:1.0:1789997753.564516:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704549376 00000100:00100000:1.0:1789997753.564562:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1016 00000100:00100000:1.0:1789997753.564572:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549376:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997753.564689:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549376:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 119us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997753.564696:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1016 00000100:00100000:0.0:1789997753.571872:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997753.572704:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704549504 00000100:00100000:1.0:1789997753.572717:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704549504 00000100:00100000:1.0:1789997753.572769:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 544 00000100:00100000:1.0:1789997753.572779:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54241:x1876946704549504:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997753.573139:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54241:x1876946704549504:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 358us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997753.573147:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 544 00000100:00100000:1.0:1789997753.575392:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997753.576544:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704549632 00000100:00100000:0.0:1789997753.576555:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704549632 00000100:00100000:0.0:1789997753.576615:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 545 00000100:00100000:0.0:1789997753.576627:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549632:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997753.577029:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549632:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 404us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997753.577037:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 545 00000100:00100000:2.0:1789997753.586245:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997753.586288:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704549760 00000100:00100000:2.0:1789997753.586298:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704549760 00000100:00100000:2.0:1789997753.586349:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1017 00000100:00100000:2.0:1789997753.586359:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549760:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997753.586820:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54241:x1876946704549760:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 461us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997753.586829:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1017 00000100:00100000:0.0:1789997753.656637:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997753.657232:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704549888 00000100:00100000:2.0:1789997753.657243:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704549888 00000100:00100000:2.0:1789997753.657332:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1018 00000100:00100000:2.0:1789997753.657343:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54245:x1876946704549888:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:2.0:1789997753.657363:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997753.657385:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d9e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefc1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657443:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657462:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657474:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657486:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657493:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657500:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657823:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d9f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657832:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657840:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997753.657860:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:2.0:1789997753.657864:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997753.657884:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657896:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657907:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657914:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657920:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997753.657924:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657931:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657943:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdfd00) 00010000:00010000:2.0:1789997753.657946:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997753.657950:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657956:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592d9eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657971:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657976:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.657981:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.658098:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997753.658104:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.658111:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.658118:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997753.658120:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997753.658122:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.658127:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592d9f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.658156:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592d9e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefc1 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.658169:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefc1 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997753.658175:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:2.0:1789997753.658177:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997753.658179:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997753.658305:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54245:x1876946704549888:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 963us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997753.658312:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1018 00000100:00100000:1.0:1789997753.660954:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997753.661511:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704550144 00000100:00100000:0.0:1789997753.661522:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704550144 00000100:00100000:3.0:1789997753.661727:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1019 00000100:00100000:3.0:1789997753.661738:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54245:x1876946704550144:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997753.661756:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997753.661775:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefc8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.662035:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.662049:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.662059:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.662073:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.662080:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.662090:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997753.663347:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:3.0:1789997753.663830:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592da15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663843:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592da15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663852:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592da15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663887:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663894:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663901:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663907:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997753.663911:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663919:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663930:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:3.0:1789997753.663933:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997753.663938:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.663944:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997753.663957:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002fc38652 reply state 00000000501ce614 transno 4294967687 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997753.663965:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997753.664076:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefc8 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.664093:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592da15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefc8 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997753.664099:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997753.664101:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997753.664103:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997753.664288:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:54245:x1876946704550144:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 2483us (3271us total) trans 4294967687 rc 0/0 00000100:00100000:3.0:1789997753.664296:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1019 00000100:00100000:2.0:1789997753.673014:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997753.673614:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704550272 00000100:00100000:0.0:1789997753.673626:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704550272 00000100:00100000:0.0:1789997753.673706:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 546 00000100:00100000:0.0:1789997753.673716:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54245:x1876946704550272:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997753.673733:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997753.673754:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefcf expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997753.673787:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789997753.673807:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=1942s v=(0 0) 00010000:00010000:0.0:1789997753.673812:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997753.673822:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997753.673840:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 7 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997753.673854:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789997753.673919:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54245:x1876946704550272:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 203us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997753.673925:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 546 00010000:00010000:1.0:1789997753.680944:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997753.680963:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997753.680972:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997753.680978:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997753.680985:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997753.681007:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997753.681025:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38ee49e800) 00010000:00010000:1.0:1789997753.681029:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997753.681034:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997753.681041:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997753.694819:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997753.694920:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704550400 00000100:00100000:0.0:1789997753.694931:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704550400 00002000:00100000:0.0:1789997753.694980:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x20:0x0] (0->1048575) req@ffff8a37c7f43480 x1876946704550400/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:729/0 lens 488/0 e 0 to 0 dl 1789997764 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997753.695005:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c7f43480 with x1876946704550400 ext(0->1048575) 00002000:00010000:0.0:1789997753.695012:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c7f43480 00000100:00100000:0.0:1789997753.695047:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 25 00000100:00100000:0.0:1789997753.695057:0:6663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704550400:12345-192.168.204.4@tcp:4:dd.60003 00000001:00100000:0.0:1789997753.741854:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000001:00100000:0.0:1789997753.741868:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997753.741872:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a37c6ec7800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997753.741902:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c6ec7800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:0.0:1789997753.741950:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c8049000 for lustre-OST0000 00000001:00080000:3.0:1789997753.771517:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000100:00100000:2.0:1789997753.771824:0:6663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704550400:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 76761us (77006us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789997753.771840:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 25 00002000:00100000:2.0:1789997753.771854:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x20:0x0] (0->1048575) req@ffff8a37c7f43480 x1876946704550400/t4294967360(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:729/0 lens 488/448 e 0 to 0 dl 1789997764 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789997753.771864:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c7f43480 with x1876946704550400 ext(0->1048575) 00002000:00010000:2.0:1789997753.771871:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c7f43480 00000100:00100000:3.0:1789997753.774737:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997753.774934:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704550528 00000100:00100000:2.0:1789997753.774944:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704550528 00000100:00100000:2.0:1789997753.775011:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1020 00000100:00100000:2.0:1789997753.775023:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54245:x1876946704550528:12345-192.168.204.4@tcp:44:dd.60003 00000100:00100000:2.0:1789997753.812354:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54245:x1876946704550528:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 37320us (37611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997753.812368:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1020 00000100:00100000:3.0:1789997753.814449:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997753.814591:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704550656 00000100:00100000:2.0:1789997753.814689:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704550656 00000100:00100000:2.0:1789997753.814736:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 547 00000100:00100000:2.0:1789997753.814747:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704550656:12345-192.168.204.4@tcp:16:dd.60003 00000100:00100000:2.0:1789997753.814847:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704550656:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 102us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997753.814855:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 547 00000001:00080000:1.0:1789997753.815101:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967687 is committed 00000100:00100000:3.0:1789997753.817887:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997753.818055:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704550912 00000100:00100000:2.0:1789997753.818063:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704550912 00000100:00100000:2.0:1789997753.818159:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 103 00000100:00100000:2.0:1789997753.818169:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54245:x1876946704550912:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:2.0:1789997753.818960:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54245:x1876946704550912:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 789us (1078us total) trans 4294967688 rc 0/0 00000100:00100000:2.0:1789997753.818970:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 103 00010000:00010000:1.0:1789997754.124622:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997755.159728:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997755.392165:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967688 is committed 00000100:00100000:3.0:1789997755.850917:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713035648:0@lo:400:kworker.0 00000100:00100000:3.0:1789997755.850999:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997755.851080:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997755.851088:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713035520:0@lo:400:kworker.0 00000100:00100000:3.0:1789997755.851115:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997755.851155:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713035648 00000100:00100000:3.0:1789997755.851164:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713035648 00000100:00100000:1.0:1789997755.851328:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713035392:0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.851359:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997755.851391:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713035904:0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.851413:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997755.851433:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789997755.851439:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713035264:0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.851466:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997755.851486:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713035776:0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.851507:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997755.851696:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713035520 00000100:00100000:1.0:1789997755.851701:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713035520 00000100:00100000:1.0:1789997755.851746:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713035392 00000100:00100000:1.0:1789997755.851750:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713035392 00000100:00100000:1.0:1789997755.851768:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713035904 00000100:00100000:1.0:1789997755.851771:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713035904 00000100:00100000:1.0:1789997755.851792:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1789997755.851801:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713035520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.851854:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713035520:12345-0@lo:400:kworker.0 Request processed in 55us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997755.851861:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:1.0:1789997755.851879:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1789997755.851884:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713035392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.851915:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713035392:12345-0@lo:400:kworker.0 Request processed in 30us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997755.851921:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1789997755.851933:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1789997755.851938:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713035904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.851978:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713035904:12345-0@lo:400:kworker.0 Request processed in 39us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997755.851983:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:1.0:1789997755.852028:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713035520:0@lo:400:kworker.0 00000100:00100000:2.0:1789997755.852289:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713035264 00000100:00100000:2.0:1789997755.852294:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713035264 00000100:00100000:2.0:1789997755.852322:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1789997755.852327:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713035264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.852459:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713035264:0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.852469:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713035392:0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.852477:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713035904:0@lo:400:kworker.0 00000100:00100000:1.0:1789997755.852517:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713035776 00000100:00100000:1.0:1789997755.852520:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713035776 00000100:00100000:3.0:1789997755.852684:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:3.0:1789997755.852694:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713035648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997755.852734:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713035648:12345-0@lo:400:kworker.0 Request processed in 44us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997755.852741:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:3.0:1789997755.852767:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713035648:0@lo:400:kworker.0 00000100:00100000:2.0:1789997755.852860:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713035264:12345-0@lo:400:kworker.0 Request processed in 531us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997755.852867:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1789997755.853137:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1789997755.853145:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713035776:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997755.853357:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997755.853669:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997755.853674:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997755.853759:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713035776:12345-0@lo:400:kworker.0 Request processed in 614us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997755.853766:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1789997755.856102:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713035776:0@lo:400:kworker.0 00010000:00010000:3.0:1789997756.175894:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789997756.795920:0:92307:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1945488262751ns, next at 1903209177397ns, rc = 0 00000004:00080000:2.0:1789997756.796083:0:92307:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1945488428700ns, next at 1927111221767ns, rc = 0 00000004:00080000:1.0:1789997756.805510:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 92 committed 00000004:00080000:1.0:1789997756.805545:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 89 committed 00010000:00010000:1.0:1789997757.195277:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997757.726965:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997757.727238:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997757.727268:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997757.727289:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997757.727310:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704551296 00000100:00100000:1.0:1789997757.727319:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704551296 00000100:00100000:1.0:1789997757.727365:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704551424 00000100:00100000:1.0:1789997757.727368:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704551424 00000100:00100000:1.0:1789997757.727386:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 951 00000100:00100000:1.0:1789997757.727395:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704551296:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997757.727455:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704551296:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997757.727462:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 951 00000100:00100000:1.0:1789997757.727478:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 952 00000100:00100000:1.0:1789997757.727484:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704551424:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997757.727503:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704551424:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 20us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997757.727509:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 952 00000100:00080000:1.0:1789997757.727526:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997757.727530:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997757.727756:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704551040 00000100:00100000:2.0:1789997757.727761:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704551040 00000100:00100000:0.0:1789997757.727770:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704551168 00000100:00100000:0.0:1789997757.727774:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704551168 00000100:00100000:2.0:1789997757.727787:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1160 00000100:00100000:2.0:1789997757.727794:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704551040:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997757.727803:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1425 00000100:00100000:0.0:1789997757.727809:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704551168:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997757.727826:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704551040:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997757.727832:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1160 00000100:00100000:0.0:1789997757.727835:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704551168:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997757.727841:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1425 00000100:00080000:1.0:1789997757.728825:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997757.899098:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997757.899119:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713036032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997757.899199:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997757.899260:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713036032 00000100:00100000:0.0:1789997757.899268:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713036032 00000100:00100000:0.0:1789997757.899322:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1789997757.899330:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713036032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997757.899377:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789997757.899419:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713036032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997757.899426:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00080000:0.0:1789997757.899444:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997757.899488:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713036032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997757.900954:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997757.900972:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713036160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997757.901017:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997757.901169:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713036160 00000100:00100000:1.0:1789997757.901176:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713036160 00000100:00100000:1.0:1789997757.901225:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1789997757.901232:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713036160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997757.901257:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997757.901296:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713036160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997757.901303:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1789997757.901438:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713036160:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997757.901466:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997758.219335:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997758.440036:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997758.440169:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704551552 00000100:00100000:3.0:1789997758.440179:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704551552 00000100:00100000:3.0:1789997758.440242:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1021 00000100:00100000:3.0:1789997758.440254:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54437:x1876946704551552:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997758.440439:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54437:x1876946704551552:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 187us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997758.440447:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1021 00000100:00100000:0.0:1789997758.452390:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997758.452426:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704551680 00000100:00100000:0.0:1789997758.452436:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704551680 00000100:00100000:0.0:1789997758.452535:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 548 00000100:00100000:0.0:1789997758.452546:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54437:x1876946704551680:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997758.452958:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54437:x1876946704551680:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 413us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997758.452967:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 548 00000100:00100000:0.0:1789997758.457341:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997758.459789:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704551808 00000100:00100000:3.0:1789997758.459803:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704551808 00000100:00100000:3.0:1789997758.459863:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 549 00000100:00100000:3.0:1789997758.459875:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54437:x1876946704551808:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997758.460246:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54437:x1876946704551808:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 372us (2908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997758.460254:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 549 00000100:00100000:1.0:1789997758.463075:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997758.463144:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704551936 00000100:00100000:3.0:1789997758.463152:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704551936 00000100:00100000:3.0:1789997758.463204:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1022 00000100:00100000:3.0:1789997758.463214:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54437:x1876946704551936:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997758.463535:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54437:x1876946704551936:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 322us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997758.463542:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1022 00000100:00100000:1.0:1789997758.479194:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997758.479271:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704552064 00000100:00100000:3.0:1789997758.479282:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704552064 00000100:00100000:3.0:1789997758.479349:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1023 00000100:00100000:3.0:1789997758.479360:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54437:x1876946704552064:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997758.479483:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54437:x1876946704552064:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 124us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997758.479491:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1023 00000100:00100000:3.0:1789997758.483189:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997758.483231:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704552192 00000100:00100000:3.0:1789997758.483240:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704552192 00000100:00100000:3.0:1789997758.483288:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 550 00000100:00100000:3.0:1789997758.483297:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54437:x1876946704552192:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997758.483763:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54437:x1876946704552192:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 466us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997758.483772:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 550 00000100:00100000:1.0:1789997758.489395:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997758.489465:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704552320 00000100:00100000:3.0:1789997758.489476:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704552320 00000100:00100000:3.0:1789997758.489535:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 551 00000100:00100000:3.0:1789997758.489546:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54437:x1876946704552320:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997758.490163:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54437:x1876946704552320:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 617us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997758.490172:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 551 00000100:00100000:1.0:1789997758.500610:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997758.500777:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704552448 00000100:00100000:0.0:1789997758.500787:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704552448 00000100:00100000:0.0:1789997758.500871:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1024 00000100:00100000:0.0:1789997758.500881:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54437:x1876946704552448:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997758.501275:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54437:x1876946704552448:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 395us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997758.501283:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1024 00000100:00100000:1.0:1789997758.557214:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997758.557326:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704552704 00000100:00100000:3.0:1789997758.557337:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704552704 00000100:00100000:3.0:1789997758.557491:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1025 00000100:00100000:3.0:1789997758.557502:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54441:x1876946704552704:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:3.0:1789997758.557565:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997758.557594:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592da15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefc8 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.557614:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997758.557625:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997758.557646:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.557809:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.557821:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.557836:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.557843:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.557850:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.558185:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.558195:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.558202:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997758.559047:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].32, 64 off10240 00000004:00080000:3.0:1789997758.559058:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1947251403562ns, next at 1948251401232ns, rc = 0 00010000:00010000:3.0:1789997758.559155:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559167:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559176:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559184:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559189:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559195:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559224:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997758.559247:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559254:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559261:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559267:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997758.559271:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559279:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559290:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997758.559292:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997758.559296:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559303:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592da38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997758.559309:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997758.559316:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559319:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997758.559323:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997758.559326:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997758.559327:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559332:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997758.559333:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559337:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997758.559340:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997758.559342:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997758.559344:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997758.559347:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559350:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997758.559354:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592da3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559357:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:3.0:1789997758.559359:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997758.559362:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.559367:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592da2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997758.559367:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997758.559369:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997758.559371:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1789997758.559377:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b18482b reply state 0000000054181496 transno 4294967689 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997758.559386:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997758.559641:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54441:x1876946704552704:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 2137us (2432us total) trans 4294967689 rc 0/0 00000100:00100000:3.0:1789997758.559650:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1025 00010000:00010000:3.0:1789997758.561729:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.561745:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.561753:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.561759:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997758.561763:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.561774:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.561789:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0xecba81fd (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997758.561792:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997758.561797:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997758.561804:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592da31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997759.245103:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997760.267457:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997760.380343:0:92451:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1949072686060ns, next at 1948251401232ns, rc = 0 00000004:00080000:2.0:1789997760.407875:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 91 committed 00000001:00080000:2.0:1789997760.407905:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967689 is committed 00000004:00080000:2.0:1789997760.407917:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 90 committed 00000100:00100000:3.0:1789997760.408336:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713036288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789997760.408416:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997760.408632:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713036288 00000100:00100000:0.0:1789997760.408641:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713036288 00000100:00100000:0.0:1789997760.408815:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1789997760.408838:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713036288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997760.408878:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:32 count 1 00010000:00010000:0.0:1789997760.408906:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.408929:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.408945:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1789997760.408950:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997760.408955:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.408986:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.409002:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 5 pid: 6656 timeout: 2049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997760.409016:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946713036416:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997760.409085:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6840 going to sleep for 11 seconds 00000100:00080000:2.0:1789997760.409349:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997760.413341:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946713036416:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997760.413444:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997760.416415:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997760.416844:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704552832 00000100:00100000:0.0:1789997760.416854:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704552832 00010000:00010000:0.0:1789997760.416923:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 6 pid: 6656 timeout: 2049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997760.416964:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 408 00000100:00100000:0.0:1789997760.416974:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704552832:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789997760.416989:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997760.416995:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 6 pid: 6656 timeout: 2049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417008:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 6 pid: 6656 timeout: 2049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417033:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000884bcb53/0x65b43101d592da23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefcf expref: 6 pid: 6656 timeout: 2049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417048:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997760.417054:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997760.417059:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417068:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417101:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997760.417146:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704552832:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 174us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997760.417154:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 408 00010000:00010000:3.0:1789997760.417177:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997760.417188:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997760.417197:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997760.417203:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789997760.417224:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789997760.417234:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997760.417598:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997760.417605:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417614:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997760.417619:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417627:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417689:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417698:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592da46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997760.417725:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997760.417727:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997760.417729:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997760.421212:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713036288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12378us (12785us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789997760.421225:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000004:00080000:3.0:1789997760.422141:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3a8a80/2, rc 0, transno 4294967361 00000100:00100000:3.0:1789997760.422216:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713036288:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789997760.429289:0:92451:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1949121631949ns, next at 1927111221767ns, rc = 0 00000004:00080000:2.0:1789997760.448124:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 93 committed 00000100:00100000:3.0:1789997760.971160:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997760.971289:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713036672:0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.971380:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997760.971480:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997760.971487:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713036800:0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.971510:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997760.971541:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713036672 00000100:00100000:1.0:1789997760.971548:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713036672 00000100:00100000:1.0:1789997760.971604:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1789997760.971613:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713036672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.971686:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713036672:12345-0@lo:400:kworker.0 Request processed in 74us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997760.971693:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:2.0:1789997760.971809:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997760.971820:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713036928:0@lo:400:kworker.0 00000100:00100000:2.0:1789997760.971864:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997760.972240:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713036800 00000100:00100000:1.0:1789997760.972244:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713036800 00000100:00100000:1.0:1789997760.972287:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1789997760.972294:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713036800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.972329:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713036800:12345-0@lo:400:kworker.0 Request processed in 36us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997760.972335:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:1.0:1789997760.972360:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713036928 00000100:00100000:1.0:1789997760.972364:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713036928 00000100:00100000:1.0:1789997760.972391:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:1.0:1789997760.972398:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713036928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.972445:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713036928:12345-0@lo:400:kworker.0 Request processed in 47us (580us total) trans 0 rc 0/0 00000100:00080000:2.0:1789997760.972535:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997760.972539:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997760.972615:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:1.0:1789997760.972698:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713036928:0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.972898:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713036800:0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.972911:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713036672:0@lo:400:kworker.0 00000100:00100000:0.0:1789997760.983425:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713037056:0@lo:400:kworker.0 00000100:00100000:0.0:1789997760.983501:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997760.983685:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713037056 00000100:00100000:1.0:1789997760.983693:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713037056 00000100:00100000:1.0:1789997760.983751:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1789997760.983760:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713037056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.983806:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713037056:12345-0@lo:400:kworker.0 Request processed in 48us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997760.983813:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00080000:0.0:1789997760.984416:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997760.984451:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713037056:0@lo:400:kworker.0 00000100:00100000:2.0:1789997760.987063:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713036544:0@lo:400:kworker.0 00000100:00100000:2.0:1789997760.987145:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997760.987451:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713036544 00000100:00100000:1.0:1789997760.987470:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713036544 00000100:00100000:1.0:1789997760.987534:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1789997760.987546:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713036544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997760.987626:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713036544:12345-0@lo:400:kworker.0 Request processed in 84us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997760.987641:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1789997760.987800:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713036544:0@lo:400:kworker.0 00010000:00010000:2.0:1789997761.292299:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997762.316566:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997762.849293:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997762.849377:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997762.849407:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997762.849432:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997762.849458:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704553088 00000100:00100000:1.0:1789997762.849468:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704553088 00000100:00100000:1.0:1789997762.849525:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1429 00000100:00100000:1.0:1789997762.849535:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704553088:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997762.849615:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704553088:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 80us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997762.849622:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1429 00000100:00100000:1.0:1789997762.849684:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704553216 00000100:00100000:1.0:1789997762.849689:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704553216 00000100:00100000:1.0:1789997762.849715:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704553344 00000100:00100000:1.0:1789997762.849719:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704553344 00000100:00100000:1.0:1789997762.849739:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 954 00000100:00100000:1.0:1789997762.849746:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704553216:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997762.849772:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704553216:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997762.849779:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 954 00000100:00100000:1.0:1789997762.849789:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 955 00000100:00100000:1.0:1789997762.849795:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704553344:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997762.849831:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704553344:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997762.849841:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 955 00000100:00080000:0.0:1789997762.850442:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997762.850448:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997762.850451:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997762.850569:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704552960 00000100:00100000:3.0:1789997762.850575:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704552960 00000100:00100000:3.0:1789997762.850829:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1162 00000100:00100000:3.0:1789997762.850838:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704552960:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997762.850900:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704552960:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 57us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997762.850908:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1162 00000100:00100000:3.0:1789997763.024694:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997763.024719:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713037184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997763.024789:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997763.024872:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713037184 00000100:00100000:3.0:1789997763.024882:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713037184 00000100:00100000:3.0:1789997763.024949:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1789997763.024960:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713037184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997763.024996:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997763.025044:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713037184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997763.025051:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00080000:3.0:1789997763.025074:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997763.025118:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713037184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997763.025308:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997763.025320:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713037312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997763.025352:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997763.025436:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713037312 00000100:00100000:1.0:1789997763.025441:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713037312 00000100:00100000:1.0:1789997763.025550:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1789997763.025559:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713037312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997763.025580:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789997763.025617:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713037312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997763.025623:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1789997763.025686:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713037312:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997763.025758:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997763.339173:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997763.588544:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00010000:00010000:2.0:1789997764.362875:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997765.387259:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997766.090933:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713037824:0@lo:400:kworker.0 00000100:00100000:2.0:1789997766.091005:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997766.091019:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713037568:0@lo:400:kworker.0 00000100:00100000:1.0:1789997766.091062:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997766.091077:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997766.091086:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713037696:0@lo:400:kworker.0 00000100:00100000:1.0:1789997766.091088:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713038080:0@lo:400:kworker.0 00000100:00100000:2.0:1789997766.091125:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997766.091133:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713037824 00000100:00100000:1.0:1789997766.091142:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713037824 00000100:00100000:2.0:1789997766.091176:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713037568 00000100:00100000:2.0:1789997766.091182:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713037568 00000100:00100000:1.0:1789997766.091207:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1789997766.091220:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713037824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997766.091221:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713037696 00000100:00100000:2.0:1789997766.091227:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713037696 00000100:00100000:2.0:1789997766.091254:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:2.0:1789997766.091262:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713037568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997766.091356:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:3.0:1789997766.091367:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713037696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997766.091420:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713037440:0@lo:400:kworker.0 00000100:00100000:2.0:1789997766.091467:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713037568:12345-0@lo:400:kworker.0 Request processed in 206us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997766.091474:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00080000:2.0:1789997766.091515:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997766.091520:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997766.092085:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713037824:12345-0@lo:400:kworker.0 Request processed in 868us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997766.092093:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1789997766.092120:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997766.092167:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713037568:0@lo:400:kworker.0 00000100:00100000:1.0:1789997766.092193:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713038080 00000100:00100000:1.0:1789997766.092198:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713038080 00000100:00100000:1.0:1789997766.092232:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1789997766.092238:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713038080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997766.092494:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:2.0:1789997766.092499:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3a8a80, transno 4294967361 00000100:00100000:2.0:1789997766.092513:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713037824:0@lo:400:kworker.0 00000100:00080000:2.0:1789997766.092547:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997766.092931:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713038080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997766.093428:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713038080:12345-0@lo:400:kworker.0 Request processed in 1187us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997766.093437:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1789997766.095437:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713037696:12345-0@lo:400:kworker.0 Request processed in 4065us (4304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997766.095465:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1789997766.095631:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713037696:0@lo:400:kworker.0 00000100:00100000:0.0:1789997766.095983:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997766.096094:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713037952:0@lo:400:kworker.0 00000100:00100000:0.0:1789997766.096126:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997766.096208:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713037952 00000100:00100000:2.0:1789997766.096216:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713037952 00000100:00100000:2.0:1789997766.096278:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1789997766.096286:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713037952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997766.096339:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713037952:12345-0@lo:400:kworker.0 Request processed in 54us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997766.096345:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1789997766.096422:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713037952:0@lo:400:kworker.0 00000100:00080000:3.0:1789997766.101364:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997766.102937:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713037440 00000100:00100000:1.0:1789997766.102952:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713037440 00000100:00100000:1.0:1789997766.103084:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1789997766.103094:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713037440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997766.103212:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713037440:12345-0@lo:400:kworker.0 Request processed in 119us (7228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997766.103220:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1789997766.103314:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713037440:0@lo:400:kworker.0 00010000:00010000:0.0:1789997766.412362:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997767.436541:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997767.962986:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997767.963107:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704553472 00000100:00100000:0.0:1789997767.963118:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704553472 00000100:00100000:0.0:1789997767.963177:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1164 00000100:00100000:0.0:1789997767.963188:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704553472:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997767.963497:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704553472:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 309us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997767.963506:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1164 00000100:00100000:0.0:1789997767.975238:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997767.975766:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997767.975865:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997767.975902:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704553856 00000100:00100000:0.0:1789997767.975912:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704553856 00000100:00100000:3.0:1789997767.975942:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704553728 00000100:00100000:3.0:1789997767.975948:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704553728 00000100:00100000:0.0:1789997767.976442:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 958 00000100:00100000:0.0:1789997767.976455:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704553856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997767.976523:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704553856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997767.976530:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 958 00000100:00100000:2.0:1789997767.976620:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704553600 00000100:00100000:2.0:1789997767.976625:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704553600 00000100:00080000:0.0:1789997767.979562:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997767.979571:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997767.979574:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997767.979753:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 959 00000100:00100000:2.0:1789997767.979766:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1433 00000100:00100000:3.0:1789997767.979773:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704553728:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997767.979781:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704553600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997767.980170:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704553600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 392us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997767.980177:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1433 00000100:00100000:3.0:1789997767.980489:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704553728:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 723us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997767.980499:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 959 00000100:00100000:2.0:1789997768.139263:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713038336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997768.139329:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997768.139421:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713038336 00000100:00100000:3.0:1789997768.139429:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713038336 00000100:00100000:3.0:1789997768.139496:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1789997768.139507:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713038336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997768.139541:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997768.139602:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713038208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997768.139651:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789997768.139728:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997768.139748:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713038208 00000100:00100000:0.0:1789997768.139754:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713038208 00000100:00100000:0.0:1789997768.139781:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1789997768.139788:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713038208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997768.139821:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997768.139858:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713038208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997768.139865:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1789997768.139908:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713038208:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997768.139930:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997768.144438:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713038336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4923us (5098us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997768.144453:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1789997768.145428:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713038336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997768.459165:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997769.484861:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997770.509451:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997771.210958:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713038464:0@lo:400:kworker.0 00000100:00100000:0.0:1789997771.211031:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997771.211060:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713038592:0@lo:400:kworker.0 00000100:00100000:2.0:1789997771.211092:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997771.211105:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713038976:0@lo:400:kworker.0 00000100:00100000:2.0:1789997771.211111:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713039104:0@lo:400:kworker.0 00000100:00100000:2.0:1789997771.211128:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997771.211129:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997771.211152:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713038848:0@lo:400:kworker.0 00000100:00100000:0.0:1789997771.211156:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713038976 00000100:00100000:0.0:1789997771.211163:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713038976 00000100:00100000:2.0:1789997771.211173:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997771.211189:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997771.211194:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713038720:0@lo:400:kworker.0 00000100:00100000:0.0:1789997771.211207:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713038848 00000100:00100000:0.0:1789997771.211210:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713038848 00000100:00100000:2.0:1789997771.211213:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997771.211231:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1789997771.211234:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713038592 00000100:00100000:2.0:1789997771.211237:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713038592 00000100:00100000:0.0:1789997771.211239:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713038976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997771.211260:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713039104 00000100:00100000:2.0:1789997771.211262:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713039104 00000100:00100000:2.0:1789997771.211276:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713038720 00000100:00100000:2.0:1789997771.211279:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713038720 00000100:00100000:0.0:1789997771.211284:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713038976:12345-0@lo:400:kworker.0 Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997771.211292:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:2.0:1789997771.211295:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1789997771.211300:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713038592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997771.211305:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1789997771.211310:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713038848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997771.211331:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713038592:12345-0@lo:400:kworker.0 Request processed in 31us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997771.211333:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713038848:12345-0@lo:400:kworker.0 Request processed in 24us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997771.211338:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:2.0:1789997771.211352:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1789997771.211363:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1789997771.211369:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713039104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997771.211376:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713038976:0@lo:400:kworker.0 00000100:00100000:2.0:1789997771.211394:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713039104:12345-0@lo:400:kworker.0 Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997771.211399:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1789997771.211406:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713038848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997771.211408:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1789997771.211414:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713038720:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997771.211424:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997771.211429:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997771.211432:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997771.211441:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713038720:12345-0@lo:400:kworker.0 Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997771.211446:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1789997771.211492:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713038592:0@lo:400:kworker.0 00000100:00100000:2.0:1789997771.211502:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713039104:0@lo:400:kworker.0 00000100:00100000:0.0:1789997771.211525:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713038720:0@lo:400:kworker.0 00000100:00100000:3.0:1789997771.211706:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713038464 00000100:00100000:3.0:1789997771.211711:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713038464 00000100:00100000:3.0:1789997771.211749:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:3.0:1789997771.211756:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713038464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997771.211818:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713038464:12345-0@lo:400:kworker.0 Request processed in 64us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997771.211824:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1789997771.212214:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713038464:0@lo:400:kworker.0 00010000:00010000:0.0:1789997771.530873:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997772.556992:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997773.087880:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997773.087928:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997773.087950:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704553984 00000100:00100000:2.0:1789997773.087963:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704553984 00000100:00100000:0.0:1789997773.087969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997773.088008:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997773.088030:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1166 00000100:00100000:0.0:1789997773.088040:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704554240 00000100:00100000:0.0:1789997773.088046:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704554240 00000100:00100000:2.0:1789997773.088055:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704553984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997773.088096:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704554368 00000100:00100000:0.0:1789997773.088100:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704554368 00000100:00100000:0.0:1789997773.088127:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 962 00000100:00100000:2.0:1789997773.088136:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704553984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997773.088137:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704554240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997773.088152:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1166 00000100:00100000:0.0:1789997773.088181:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704554240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997773.088189:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 962 00000100:00100000:0.0:1789997773.088204:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 963 00000100:00100000:0.0:1789997773.088212:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704554368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1789997773.088215:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997773.088220:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997773.088419:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704554112 00000100:00100000:3.0:1789997773.088424:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704554112 00000100:00100000:3.0:1789997773.088477:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1437 00000100:00100000:3.0:1789997773.088484:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704554112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997773.088520:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704554112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997773.088527:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1437 00000100:00100000:0.0:1789997773.088628:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704554368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 416us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997773.088635:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 963 00000100:00080000:2.0:1789997773.089350:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997773.259816:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713039232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997773.259891:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997773.260342:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713039232 00000100:00100000:2.0:1789997773.260351:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713039232 00000100:00100000:1.0:1789997773.260472:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997773.260482:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713039360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997773.260517:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997773.260556:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713039360 00000100:00100000:1.0:1789997773.260561:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713039360 00000100:00100000:2.0:1789997773.260649:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1789997773.260679:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713039232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997773.260727:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997773.260776:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713039232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997773.260783:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1789997773.260832:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713039232:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997773.261402:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997773.261407:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997773.261535:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1789997773.261544:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713039360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997773.261567:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997773.261637:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713039360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997773.261643:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1789997773.262034:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713039360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789997773.579465:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997774.603354:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997775.628023:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997776.330924:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997776.330999:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713039616:0@lo:400:kworker.0 00000100:00100000:0.0:1789997776.331072:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997776.331103:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713039616 00000100:00100000:1.0:1789997776.331113:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713039616 00000100:00100000:0.0:1789997776.331151:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713039488:0@lo:400:kworker.0 00000100:00100000:1.0:1789997776.331164:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1789997776.331175:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713039616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997776.331185:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997776.331240:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713039616:12345-0@lo:400:kworker.0 Request processed in 67us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997776.331248:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1789997776.331257:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713039616:0@lo:400:kworker.0 00000100:00100000:0.0:1789997776.331298:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713039488 00000100:00100000:0.0:1789997776.331303:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713039488 00000100:00100000:0.0:1789997776.331340:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1789997776.331348:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713039488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997776.331388:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713039488:12345-0@lo:400:kworker.0 Request processed in 41us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997776.331399:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1789997776.331436:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713039488:0@lo:400:kworker.0 00000100:00100000:2.0:1789997776.331820:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713039744:0@lo:400:kworker.0 00000100:00100000:2.0:1789997776.331851:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997776.331914:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713039744 00000100:00100000:1.0:1789997776.331919:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713039744 00000100:00100000:1.0:1789997776.331961:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1789997776.331968:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713039744:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997776.332065:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997776.332109:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713039872:0@lo:400:kworker.0 00000100:00100000:0.0:1789997776.332140:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997776.332179:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713039872 00000100:00100000:0.0:1789997776.332184:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713039872 00000100:00100000:0.0:1789997776.332215:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:0.0:1789997776.332222:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713039872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997776.332257:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713039872:12345-0@lo:400:kworker.0 Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997776.332263:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:0.0:1789997776.332291:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713039872:0@lo:400:kworker.0 00000100:00080000:0.0:1789997776.332311:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997776.332438:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713039744:12345-0@lo:400:kworker.0 Request processed in 469us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997776.332446:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:0.0:1789997776.332586:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713040000:0@lo:400:kworker.0 00000100:00100000:0.0:1789997776.332613:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997776.332642:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997776.332648:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713040128:0@lo:400:kworker.0 00000100:00100000:0.0:1789997776.332692:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997776.333173:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713039744:0@lo:400:kworker.0 00000100:00100000:3.0:1789997776.333228:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713040128 00000100:00100000:3.0:1789997776.333234:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713040128 00000100:00100000:3.0:1789997776.333330:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1789997776.333338:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713040128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997776.333340:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713040000 00000100:00100000:2.0:1789997776.333344:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713040000 00000100:00100000:2.0:1789997776.333370:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1789997776.333376:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713040000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997776.333384:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713040128:12345-0@lo:400:kworker.0 Request processed in 48us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997776.333391:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00080000:0.0:1789997776.333437:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997776.333441:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997776.333478:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713040128:0@lo:400:kworker.0 00000100:00100000:2.0:1789997776.333479:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713040000:12345-0@lo:400:kworker.0 Request processed in 103us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997776.333485:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:0.0:1789997776.333487:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713040000:0@lo:400:kworker.0 00010000:00010000:2.0:1789997776.651017:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997777.481027:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997777.481151:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704554496 00000100:00100000:1.0:1789997777.481161:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704554496 00000100:00100000:1.0:1789997777.481294:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1026 00000100:00100000:1.0:1789997777.481304:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54699:x1876946704554496:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997777.481451:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54699:x1876946704554496:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 148us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997777.481459:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1026 00000100:00080000:0.0:1789997777.481728:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997777.485155:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997777.485309:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704554624 00000100:00100000:0.0:1789997777.485319:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704554624 00000100:00100000:0.0:1789997777.485402:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 553 00000100:00100000:0.0:1789997777.485413:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54699:x1876946704554624:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997777.485860:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54699:x1876946704554624:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 447us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997777.485868:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 553 00000100:00080000:2.0:1789997777.485932:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997777.489459:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997777.489693:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704554752 00000100:00100000:0.0:1789997777.489701:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704554752 00000100:00100000:0.0:1789997777.489913:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 554 00000100:00100000:0.0:1789997777.489923:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54699:x1876946704554752:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997777.490268:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54699:x1876946704554752:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 345us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997777.490276:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 554 00000100:00080000:2.0:1789997777.491691:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997777.492675:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997777.492908:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704554880 00000100:00100000:0.0:1789997777.492919:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704554880 00000100:00100000:0.0:1789997777.493012:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1027 00000100:00100000:0.0:1789997777.493022:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54699:x1876946704554880:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997777.493432:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54699:x1876946704554880:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 411us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997777.493440:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1027 00000100:00100000:1.0:1789997777.496538:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997777.496626:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704555008 00000100:00100000:2.0:1789997777.496635:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704555008 00000100:00100000:2.0:1789997777.496758:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1028 00000100:00100000:2.0:1789997777.496836:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54699:x1876946704555008:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997777.496970:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54699:x1876946704555008:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 201us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997777.496979:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1028 00000100:00100000:3.0:1789997777.498842:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997777.498962:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704555136 00000100:00100000:0.0:1789997777.498969:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704555136 00000100:00100000:0.0:1789997777.499072:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 555 00000100:00100000:0.0:1789997777.499082:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54699:x1876946704555136:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997777.499565:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54699:x1876946704555136:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 484us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997777.499574:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 555 00000100:00100000:3.0:1789997777.501138:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997777.501268:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704555264 00000100:00100000:0.0:1789997777.501275:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704555264 00000100:00100000:0.0:1789997777.501316:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 556 00000100:00100000:0.0:1789997777.501323:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54699:x1876946704555264:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997777.501962:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54699:x1876946704555264:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 636us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997777.501970:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 556 00000100:00100000:1.0:1789997777.504101:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997777.504459:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704555392 00000100:00100000:2.0:1789997777.504468:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704555392 00000100:00100000:2.0:1789997777.504539:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1029 00000100:00100000:2.0:1789997777.504550:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54699:x1876946704555392:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997777.505112:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54699:x1876946704555392:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 562us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997777.505120:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1029 00000100:00100000:3.0:1789997777.526474:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997777.526573:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704555520 00000100:00100000:1.0:1789997777.526583:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704555520 00000100:00100000:1.0:1789997777.526734:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1030 00000100:00100000:1.0:1789997777.526746:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54700:x1876946704555520:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997777.526766:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997777.526856:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592da4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefd6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997777.526953:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592da54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997777.526968:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592da54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997777.526982:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592da54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997777.527026:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:1.0:1789997777.527030:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997777.527050:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592da54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997777.527080:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592da4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefd6 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997777.527116:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592da54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefd6 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997777.527125:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:1.0:1789997777.527127:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997777.527140:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997777.527274:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54700:x1876946704555520:12345-192.168.204.4@tcp:101:rm.0 Request processed in 530us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997777.527282:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1030 00000100:00100000:3.0:1789997777.531151:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997777.531293:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704555776 00000100:00100000:0.0:1789997777.531303:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704555776 00000100:00100000:0.0:1789997777.531536:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1031 00000100:00100000:0.0:1789997777.531549:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54700:x1876946704555776:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997777.531571:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997777.531593:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefdd expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997777.531711:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:0.0:1789997777.531959:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefdd expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.531996:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997777.532000:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789997777.532006:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefdd expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.532032:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997777.532094:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54700:x1876946704555776:12345-192.168.204.4@tcp:101:rm.0 Request processed in 547us (952us total) trans 4294967690 rc 301/301 00000100:00100000:0.0:1789997777.532101:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1031 00000100:00100000:2.0:1789997777.537785:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997777.537893:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704555904 00000100:00100000:1.0:1789997777.537904:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704555904 00000100:00100000:1.0:1789997777.537964:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 104 00000100:00100000:1.0:1789997777.537975:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54700:x1876946704555904:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:1.0:1789997777.542821:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54700:x1876946704555904:12345-192.168.204.4@tcp:37:rm.0 Request processed in 4837us (5040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997777.542835:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 104 00000100:00100000:3.0:1789997777.546143:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997777.546195:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704556160 00000100:00100000:0.0:1789997777.546206:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704556160 00000100:00100000:0.0:1789997777.546324:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:0.0:1789997777.546336:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de232c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54700:x1876946704556160:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:0.0:1789997777.546717:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de232c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:54700:x1876946704556160:12345-192.168.204.4@tcp:35:rm.0 Request processed in 382us (594us total) trans 4294967691 rc 0/0 00000100:00100000:0.0:1789997777.546725:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 105 00000100:00100000:2.0:1789997777.548984:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997777.549062:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704556416 00000100:00100000:0.0:1789997777.549069:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704556416 00000100:00100000:0.0:1789997777.549117:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1032 00000100:00100000:0.0:1789997777.549127:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:54700:x1876946704556416:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789997777.549176:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789997777.549216:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592da54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefd6 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549240:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592d9f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefc1 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549251:0:5810:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592d64f) 00010000:00010000:0.0:1789997777.549256:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:0.0:1789997777.549266:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997777.549286:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549299:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549306:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549354:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549359:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549363:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549626:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549635:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549643:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549759:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549764:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549769:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549776:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997777.549779:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549784:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549789:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38c28e9300) 00010000:00010000:0.0:1789997777.549791:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997777.549793:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549797:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592da77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549814:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549817:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549821:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549824:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997777.549826:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549829:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549835:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997777.549836:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997777.549838:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549841:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592da69 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549846:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549850:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549853:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549856:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997777.549857:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549861:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549864:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38c28e9200) 00010000:00010000:0.0:1789997777.549866:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997777.549867:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997777.549870:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592da70 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997777.549927:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54700:x1876946704556416:12345-192.168.204.4@tcp:36:rm.0 Request processed in 800us (946us total) trans 0 rc -13/-13 00000100:00100000:0.0:1789997777.549934:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1032 00010000:00010000:3.0:1789997777.676667:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997778.208465:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997778.208526:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997778.208567:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997778.208648:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997778.208699:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704556928 00000100:00100000:0.0:1789997778.208699:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704556544 00000100:00100000:2.0:1789997778.208711:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704556928 00000100:00100000:0.0:1789997778.208711:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704556544 00000100:00100000:2.0:1789997778.208766:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704556800 00000100:00100000:2.0:1789997778.208771:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704556800 00000100:00100000:0.0:1789997778.208777:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1168 00000100:00100000:0.0:1789997778.208789:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704556544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997778.208801:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 966 00000100:00100000:2.0:1789997778.208812:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704556928:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997778.208864:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704556544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 77us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997778.208873:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1168 00000100:00100000:1.0:1789997778.208890:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704556672 00000100:00100000:1.0:1789997778.208896:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704556672 00000100:00100000:1.0:1789997778.208932:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1441 00000100:00100000:1.0:1789997778.208939:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704556672:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997778.209191:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704556928:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 380us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997778.209202:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 966 00000100:00100000:2.0:1789997778.209219:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 967 00000100:00100000:2.0:1789997778.209225:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704556800:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997778.209267:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704556800:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997778.209274:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 967 00000100:00100000:1.0:1789997778.215579:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704556672:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 6631us (7043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997778.215596:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1441 00000100:00100000:3.0:1789997778.378793:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713040256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997778.378872:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997778.378960:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713040256 00000100:00100000:3.0:1789997778.378968:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713040256 00000100:00100000:3.0:1789997778.379026:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:3.0:1789997778.379038:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713040256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997778.379073:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997778.379142:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713040256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997778.379150:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00080000:3.0:1789997778.379174:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997778.379216:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713040256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997778.379823:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997778.379834:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713040384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997778.379873:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997778.379917:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713040384 00000100:00100000:3.0:1789997778.379922:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713040384 00000100:00100000:3.0:1789997778.379958:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:3.0:1789997778.379966:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713040384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997778.379989:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997778.380030:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713040384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997778.380037:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00080000:3.0:1789997778.380056:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997778.380086:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713040384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997778.698879:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997779.723808:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997780.024495:0:92814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff535f2b40 20000000:00000080:1.0:1789997780.024513:0:92814:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c2dbc000 uarg=0000000000000000 00010000:00010000:1.0:1789997780.025065:0:92814:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997780.025081:0:92814:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997780.025095:0:92814:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997780.025113:0:92814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997780.025129:0:92814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592d9cf expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997780.025136:0:92814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997780.025178:0:92814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592d9cf expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997780.025192:0:92814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592d9cf expref: 18 pid: 5803 timeout: 2068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997780.025205:0:92814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92814:1876946713040512:0@lo:104: 00000100:00100000:1.0:1789997780.025267:0:92814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997780.025329:0:92814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789997780.025397:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713040512 00000100:00100000:2.0:1789997780.025405:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713040512 00000100:00100000:2.0:1789997780.025452:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789997780.025461:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:92814:x1876946713040512:12345-0@lo:104: 00010000:00010000:2.0:1789997780.027341:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.027432:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997780.027441:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:92814:x1876946713040512:12345-0@lo:104: Request processed in 1979us (2172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997780.027451:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:3.0:1789997780.027505:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997780.027514:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997780.027522:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997780.027527:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997780.027537:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997780.027544:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997780.027550:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1789997780.027628:0:92814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f42d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92814:1876946713040512:0@lo:104: 00010000:00010000:1.0:1789997780.027649:0:92814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.029434:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.029447:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997780.029473:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.029492:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592d9cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592d9d6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.029518:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997780.029521:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997780.029523:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997780.029538:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713040640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997780.029608:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997780.030039:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713040640 00000100:00100000:2.0:1789997780.030046:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713040640 00010000:00010000:2.0:1789997780.030082:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d9cf expref: 19 pid: 5803 timeout: 2068 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997780.030219:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1789997780.030229:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713040640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997780.030242:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997780.030248:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592d9cf expref: 19 pid: 5803 timeout: 2068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030259:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592d9cf expref: 19 pid: 5803 timeout: 2068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030272:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592d9d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592d9cf expref: 19 pid: 5803 timeout: 2068 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030287:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030295:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030310:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030320:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030327:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030334:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030340:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997780.030344:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030352:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030374:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.030384:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997780.030427:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713040640:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997780.030434:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1789997780.030510:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713040640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997780.030857:0:92814:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997780.030869:0:92814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997780.030877:0:92814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da7e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789997780.668334:0:92862:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff4f8f5e90 20000000:00000080:2.0:1789997780.668352:0:92862:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faaf3800 uarg=0000000000000000 10000000:01000000:2.0:1789997780.668400:0:92862:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997780.668421:0:92862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668439:0:92862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668451:0:92862:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668458:0:92862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668477:0:92862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668484:0:92862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668490:0:92862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997780.668494:0:92862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668502:0:92862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668515:0:92862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668522:0:92862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997780.668529:0:92862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592da85 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997780.746876:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997780.962526:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967691 is committed 00000100:00100000:0.0:1789997781.450943:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713040768:0@lo:400:kworker.0 00000100:00100000:0.0:1789997781.451017:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997781.452564:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713041280:0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.452567:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713041152:0@lo:400:kworker.0 00000100:00100000:2.0:1789997781.452646:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713040768 00000100:00100000:2.0:1789997781.452672:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713040768 00000100:00100000:2.0:1789997781.452712:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1789997781.452720:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713040768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997781.453622:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997781.453769:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997781.453806:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713040896:0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.453837:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997781.453857:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713041408:0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.453876:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997781.453895:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997781.453902:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713041024:0@lo:400:kworker.0 00000100:00100000:0.0:1789997781.454343:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713041280 00000100:00100000:0.0:1789997781.454350:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713041280 00000100:00100000:0.0:1789997781.454401:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713041152 00000100:00100000:0.0:1789997781.454404:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713041152 00000100:00100000:0.0:1789997781.454426:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1789997781.454435:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713041280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.454740:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997781.454787:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713040896 00000100:00100000:3.0:1789997781.454791:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713040896 00000100:00100000:3.0:1789997781.454818:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713041408 00000100:00100000:3.0:1789997781.454821:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713041408 00000100:00100000:3.0:1789997781.454839:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713041024 00000100:00100000:3.0:1789997781.454843:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713041024 00000100:00100000:3.0:1789997781.454863:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1789997781.454869:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713040896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.454920:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713040896:12345-0@lo:400:kworker.0 Request processed in 51us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997781.454930:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:3.0:1789997781.454945:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:3.0:1789997781.454951:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713041408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.454974:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713041408:12345-0@lo:400:kworker.0 Request processed in 24us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997781.454980:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:3.0:1789997781.454989:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:3.0:1789997781.454995:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713041024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.455019:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713041024:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997781.455024:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00080000:3.0:1789997781.455041:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789997781.455045:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997781.455284:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713041280:12345-0@lo:400:kworker.0 Request processed in 793us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997781.455292:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1789997781.455306:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1789997781.455312:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713041152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997781.455346:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713041152:12345-0@lo:400:kworker.0 Request processed in 34us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997781.455351:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1789997781.455391:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713041280:0@lo:400:kworker.0 00000100:00080000:3.0:1789997781.455455:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997781.455486:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713041152:0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.455510:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713041024:0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.455520:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713040896:0@lo:400:kworker.0 00000100:00100000:3.0:1789997781.455529:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713041408:0@lo:400:kworker.0 00000100:00100000:2.0:1789997781.455778:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713040768:12345-0@lo:400:kworker.0 Request processed in 3057us (4760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997781.455787:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1789997781.455851:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713040768:0@lo:400:kworker.0 10000000:01000000:3.0:1789997781.713386:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997781.713394:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997781.713399:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997781.713477:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997781.713489:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997781.713501:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997781.713526:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713041536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997781.713592:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997781.713650:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa55a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789997781.713778:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713041536 00000100:00100000:1.0:1789997781.713787:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713041536 00000100:00100000:1.0:1789997781.713840:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:1.0:1789997781.713849:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713041536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997781.713862:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997781.713876:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592da8c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997781.713900:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592da8c expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997781.713911:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592da8c expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997781.713919:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997781.713958:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713041536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997781.713964:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1789997781.716613:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6defb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713041536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997781.716641:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997781.716674:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997781.716698:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997781.716703:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997781.716709:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997781.770830:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997782.719863:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997782.719982:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704557056 00000100:00100000:1.0:1789997782.719992:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704557056 00000100:00100000:1.0:1789997782.720060:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1033 00000100:00100000:1.0:1789997782.720071:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54813:x1876946704557056:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997782.720092:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997782.720115:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592da9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefe4 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.720175:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592daa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.720189:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.720203:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997782.720245:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997782.720249:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997782.720268:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592daa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.720292:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592da9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefe4 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.720309:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592daa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefe4 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.720317:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:1.0:1789997782.720320:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997782.720323:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789997782.720379:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54813:x1876946704557056:12345-192.168.204.4@tcp:101:rm.0 Request processed in 310us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997782.720387:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1033 00000100:00080000:3.0:1789997782.721308:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997782.729987:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997782.730023:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704557184 00000100:00100000:2.0:1789997782.730032:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704557184 00000100:00100000:2.0:1789997782.730084:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1034 00000100:00100000:2.0:1789997782.730094:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54813:x1876946704557184:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997782.730115:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997782.730134:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592daa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaefeb expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.730193:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.730208:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.730220:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.730235:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.730247:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.730258:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.730897:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dabd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.730910:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.731570:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997782.731605:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00000004:00200000:2.0:1789997782.731609:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997782.731627:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dabd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.731639:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.731646:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732057:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732066:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997782.732070:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732078:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732092:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:2.0:1789997782.732095:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997782.732101:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732107:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2200/0x65b43101d592daaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732119:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732125:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732131:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732135:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997782.732138:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732144:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732150:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997782.732152:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997782.732155:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732161:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592dab6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732199:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592daa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefeb expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732211:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dabd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefeb expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.732218:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997782.732220:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997782.732223:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2a00, rc 0) 00000100:00100000:2.0:1789997782.732285:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54813:x1876946704557184:12345-192.168.204.4@tcp:101:rm.0 Request processed in 2193us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997782.732294:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1034 00000100:00100000:2.0:1789997782.739619:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997782.740072:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704557440 00000100:00100000:3.0:1789997782.740083:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704557440 00000100:00100000:3.0:1789997782.740131:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1035 00000100:00100000:3.0:1789997782.740138:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54813:x1876946704557440:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997782.740157:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997782.740173:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dac4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeff2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997782.740242:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:3.0:1789997782.740586:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dac4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeff2 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.740601:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:3.0:1789997782.740604:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789997782.740610:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dac4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeff2 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.740622:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ba00, rc 0) 00000100:00100000:3.0:1789997782.740713:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54813:x1876946704557440:12345-192.168.204.4@tcp:101:rm.0 Request processed in 573us (1098us total) trans 4294967692 rc 301/301 00000100:00100000:3.0:1789997782.740721:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1035 00000100:00100000:2.0:1789997782.745314:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997782.745532:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704557568 00000100:00100000:3.0:1789997782.745542:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704557568 00000100:00100000:3.0:1789997782.745607:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:3.0:1789997782.745618:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54813:x1876946704557568:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:0.0:1789997782.753608:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54813:x1876946704557568:12345-192.168.204.4@tcp:37:rm.0 Request processed in 7980us (8292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997782.753621:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 106 00000100:00100000:0.0:1789997782.758866:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997782.761829:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704557824 00000100:00100000:2.0:1789997782.761846:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704557824 00000100:00100000:2.0:1789997782.761922:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 107 00000100:00100000:2.0:1789997782.761934:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54813:x1876946704557824:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:2.0:1789997782.762181:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:54813:x1876946704557824:12345-192.168.204.4@tcp:35:rm.0 Request processed in 249us (3322us total) trans 4294967693 rc 0/0 00000100:00100000:2.0:1789997782.762189:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 107 00000100:00100000:2.0:1789997782.767378:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997782.767487:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704558080 00000100:00100000:1.0:1789997782.767497:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704558080 00000100:00100000:1.0:1789997782.767551:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1036 00000100:00100000:1.0:1789997782.767560:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:54813:x1876946704558080:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997782.767613:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997782.767641:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dabd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefeb expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.767697:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:1.0:1789997782.767717:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592daa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaefe4 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.767727:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:1.0:1789997782.767733:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997782.767755:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.767768:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.767777:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.767789:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.767796:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.767802:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768099:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768108:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768116:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997782.768862:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 16384 00010000:00010000:1.0:1789997782.768880:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768887:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768894:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768901:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997782.768905:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768913:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768925:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff8a38e062d400) 00010000:00010000:1.0:1789997782.768928:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997782.768933:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768939:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dae0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768958:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768964:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768969:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768974:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997782.768978:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768984:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.768991:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997782.768994:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997782.768997:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.769003:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592dad2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997782.769014:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc9429f4 reply state 00000000b6366d14 transno 4294967694 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997782.769022:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997782.769094:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:54813:x1876946704558080:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1532us (1724us total) trans 4294967694 rc 0/0 00000100:00100000:1.0:1789997782.769102:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1036 00010000:00010000:2.0:1789997782.772070:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.772100:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.772108:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.772115:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997782.772119:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.772127:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.772141:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38e062d700) 00010000:00010000:2.0:1789997782.772144:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997782.772149:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.772155:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592dad9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.794879:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997782.812064:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997782.812172:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704558208 00000100:00100000:3.0:1789997782.812182:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704558208 00000100:00100000:3.0:1789997782.812238:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1037 00000100:00100000:3.0:1789997782.812249:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:54817:x1876946704558208:12345-192.168.204.4@tcp:101:mkdir.0 00010000:00010000:3.0:1789997782.812272:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997782.812295:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaeff9 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.812362:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592daee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.812375:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592daee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.812387:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592daee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997782.812432:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997782.812436:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997782.812457:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592daee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.812479:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeff9 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.812498:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592daee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeff9 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.812506:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e700) 00010000:00010000:3.0:1789997782.812509:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997782.812512:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997782.812579:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:54817:x1876946704558208:12345-192.168.204.4@tcp:101:mkdir.0 Request processed in 332us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997782.812585:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1037 00000100:00100000:1.0:1789997782.819993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997782.820037:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997782.820116:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704558336 00000100:00100000:3.0:1789997782.820124:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704558592 00000100:00100000:0.0:1789997782.820127:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704558336 00000100:00100000:3.0:1789997782.820130:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704558592 00000100:00100000:0.0:1789997782.820334:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1038 00000100:00100000:0.0:1789997782.820345:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2355:x1876946704558336:12345-192.168.204.4@tcp:41:mkdir.0 00000004:00000024:0.0:1789997782.820388:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789997782.820484:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:2355:x1876946704558336:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 133us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997782.820492:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1038 00000100:00100000:1.0:1789997782.821600:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1039 00000100:00100000:1.0:1789997782.821615:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:54817:x1876946704558592:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:1.0:1789997782.821673:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997782.821698:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592daee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaeff9 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.821719:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e700) 00010000:00010000:1.0:1789997782.821730:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997782.821799:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.821812:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.821824:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.821836:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.821843:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.821850:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997782.825764:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00010000:1.0:1789997782.825783:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.825794:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.825802:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.825813:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997782.825818:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.825830:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.825846:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997782.825849:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997782.825854:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997782.825861:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592daf5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997782.825883:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e3f6d6f reply state 000000004c949b1d transno 4294967695 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997782.825893:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997782.826116:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:54817:x1876946704558592:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 4502us (6074us total) trans 4294967695 rc 0/0 00000100:00100000:1.0:1789997782.826125:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1039 00010000:00010000:3.0:1789997782.829397:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.829414:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.829435:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.829443:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997782.829447:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.829455:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.829471:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38e062d400) 00010000:00010000:3.0:1789997782.829835:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997782.829842:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.829848:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592dafc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997782.864150:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997782.864724:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704558720 00000100:00100000:3.0:1789997782.864735:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704558720 00000100:00100000:3.0:1789997782.864793:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1040 00000100:00100000:3.0:1789997782.864804:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:54821:x1876946704558720:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:3.0:1789997782.864829:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997782.864849:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592db03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf000 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.864911:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592db0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.864925:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592db0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.864936:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592db0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997782.864968:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997782.864972:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997782.864990:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592db0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.865010:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592db03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf000 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.865027:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592db0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf000 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.865035:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:3.0:1789997782.865038:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997782.865041:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997782.865204:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:54821:x1876946704558720:12345-192.168.204.4@tcp:101:chown.0 Request processed in 400us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997782.865212:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1040 00000100:00100000:1.0:1789997782.876497:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997782.876580:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704558848 00000100:00100000:3.0:1789997782.876774:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704558848 00000100:00100000:3.0:1789997782.876991:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1041 00000100:00100000:3.0:1789997782.877003:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:54821:x1876946704558848:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:3.0:1789997782.877038:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997782.877080:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592db11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf007 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877159:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877182:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877199:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877212:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877224:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877231:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877379:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592db26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877388:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592db26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877395:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592db26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997782.877442:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789997782.877446:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997782.877472:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592db26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877483:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877490:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877497:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877503:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997782.877507:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877514:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877525:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:3.0:1789997782.877528:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997782.877532:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877538:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877551:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877560:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877565:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877570:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997782.877573:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877578:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877607:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997782.877610:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997782.877612:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877618:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877646:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592db11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf007 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877716:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592db26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf007 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.877723:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997782.877725:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997782.877728:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789997782.877811:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:54821:x1876946704558848:12345-192.168.204.4@tcp:101:chown.0 Request processed in 810us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997782.877819:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1041 00000100:00100000:0.0:1789997782.881190:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997782.881311:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704559104 00000100:00100000:3.0:1789997782.881321:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704559104 00000100:00100000:3.0:1789997782.881408:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1042 00000100:00100000:3.0:1789997782.881428:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:54821:x1876946704559104:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:3.0:1789997782.881476:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997782.881503:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592db26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf007 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.881526:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997782.881608:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997782.881633:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.881648:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997782.881686:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997782.929345:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967695 is committed 00000001:00080000:2.0:1789997782.929367:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967696 is committed 00000004:00010000:3.0:1789997782.929458:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000210586ad reply state 00000000c54733dc transno 4294967696 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997782.929472:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997782.929487:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00080000:3.0:1789997782.929587:0:5812:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997782.930051:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54821:x1876946704559104:12345-192.168.204.4@tcp:36:chown.0 Request processed in 48631us (48886us total) trans 4294967696 rc 0/0 00000100:00100000:3.0:1789997782.930061:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1042 00010000:00010000:2.0:1789997782.930490:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.930502:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.930510:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.930517:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997782.930522:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.930531:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.930548:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:2.0:1789997782.930552:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997782.930558:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997782.930566:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592db2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997783.328854:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997783.328888:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997783.328909:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997783.328933:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997783.328960:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704559232 00000100:00100000:0.0:1789997783.328969:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704559232 00000100:00100000:0.0:1789997783.329018:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1171 00000100:00100000:0.0:1789997783.329028:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704559232:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997783.329093:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704559232:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997783.329100:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1171 00000100:00100000:0.0:1789997783.329132:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704559488 00000100:00100000:0.0:1789997783.329136:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704559488 00000100:00100000:0.0:1789997783.329170:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704559616 00000100:00100000:0.0:1789997783.329173:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704559616 00000100:00100000:0.0:1789997783.329191:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 970 00000100:00100000:0.0:1789997783.329197:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704559488:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997783.329222:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704559488:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997783.329228:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 970 00000100:00100000:0.0:1789997783.329239:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 971 00000100:00100000:0.0:1789997783.329244:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704559616:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997783.329265:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704559616:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 21us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997783.329271:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 971 00000100:00080000:0.0:1789997783.329288:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997783.329292:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997783.330754:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704559360 00000100:00100000:1.0:1789997783.330764:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704559360 00000100:00100000:1.0:1789997783.330945:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1445 00000100:00100000:1.0:1789997783.330954:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704559360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997783.331145:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704559360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 191us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997783.331152:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1445 00000100:00100000:2.0:1789997783.500646:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713041664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997783.500733:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997783.500810:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713041664 00000100:00100000:2.0:1789997783.500819:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713041664 00000100:00100000:2.0:1789997783.500874:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1789997783.500883:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713041664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997783.500918:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997783.500966:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713041664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997783.500973:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00080000:2.0:1789997783.500995:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997783.501038:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713041664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997783.502168:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997783.502185:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713041792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997783.502230:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997783.502274:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713041792 00000100:00100000:1.0:1789997783.502279:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713041792 00000100:00100000:1.0:1789997783.502330:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1789997783.502338:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713041792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997783.502362:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997783.502402:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713041792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997783.502419:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1789997783.502460:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713041792:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997783.502506:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1789997783.548993:0:93059:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd72402f90 20000000:00000080:3.0:1789997783.549012:0:93059:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4d7f800 uarg=0000000000000000 00010000:00010000:3.0:1789997783.549528:0:93059:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997783.549563:0:93059:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ea00) 00010000:00010000:3.0:1789997783.549566:0:93059:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997783.549577:0:93059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592db0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf000 expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997783.549600:0:93059:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997783.549619:0:93059:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997783.549891:0:93059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997783.549908:0:93059:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592da8c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997783.549916:0:93059:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997783.549957:0:93059:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592da8c expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997783.549973:0:93059:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592da8c expref: 18 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997783.549987:0:93059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ded180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93059:1876946713041920:0@lo:104: 00000100:00100000:3.0:1789997783.550058:0:93059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997783.550165:0:93059:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa55ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789997783.550214:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789997783.550227:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713041920 00000100:00100000:0.0:1789997783.550235:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713041920 00000100:00100000:0.0:1789997783.550300:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789997783.550308:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c4dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93059:x1876946713041920:12345-0@lo:104: 00010000:00010000:0.0:1789997783.550318:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.550371:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997783.550375:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c4dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93059:x1876946713041920:12345-0@lo:104: Request processed in 68us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997783.550380:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:1.0:1789997783.550466:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997783.550472:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997783.550479:0:93059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ded180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93059:1876946713041920:0@lo:104: 00010000:00010000:1.0:1789997783.550479:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997783.550483:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997783.550491:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997783.550497:0:93059:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997783.550498:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997783.550505:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997783.550535:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997783.550543:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789997783.550598:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713042048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997783.550640:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997783.550648:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592da8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592da93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997783.550718:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789997783.550770:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997783.550772:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997783.550773:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997783.550878:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713042048 00000100:00100000:0.0:1789997783.550881:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713042048 00010000:00010000:0.0:1789997783.550896:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592da8c expref: 19 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997783.550971:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1789997783.550977:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713042048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997783.550985:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997783.550988:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592da8c expref: 19 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.550995:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592da8c expref: 19 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551003:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592da93 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592da8c expref: 19 pid: 5805 timeout: 2072 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551014:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551020:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551028:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551032:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551037:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551041:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551044:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997783.551047:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551051:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551063:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997783.551070:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997783.551089:0:93059:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997783.551097:0:93059:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997783.551103:0:93059:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052be00/0x65b43101d592db34 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997783.551108:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713042048:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997783.551115:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1789997783.551255:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713042048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997783.819610:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997784.224886:0:93108:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc849ce1e0 20000000:00000080:3.0:1789997784.224905:0:93108:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4d7f800 uarg=0000000000000000 10000000:01000000:3.0:1789997784.224952:0:93108:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997784.224972:0:93108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.224989:0:93108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225001:0:93108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225009:0:93108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225016:0:93108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225024:0:93108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225030:0:93108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997784.225035:0:93108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225044:0:93108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225292:0:93108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225304:0:93108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997784.225310:0:93108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ba00/0x65b43101d592db3b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997784.843194:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997784.970804:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997784.970812:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997784.970896:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997784.970945:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997784.970959:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997784.970972:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997784.970999:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713042176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997784.971066:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997784.972219:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb4afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789997784.976017:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713042176 00000100:00100000:1.0:1789997784.976033:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713042176 00000100:00100000:1.0:1789997784.976092:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1789997784.976103:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713042176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997784.976121:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997784.976142:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592db42 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997784.976169:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592db42 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997784.976180:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592db42 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997784.976189:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997784.976259:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713042176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (5193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997784.976266:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1789997784.976327:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713042176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997784.976345:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997784.976354:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997784.976375:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997784.976393:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997784.976401:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997785.867203:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997786.455085:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997786.455200:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704559744 00000100:00100000:2.0:1789997786.455212:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704559744 00000100:00100000:2.0:1789997786.455299:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:2.0:1789997786.455311:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704559744:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997786.455327:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997786.455330:0:6674:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592db0a) 00010000:00010000:2.0:1789997786.455332:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789997786.455490:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997786.455567:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5580:x1876946704559744:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 257us (489us total) trans 0 rc 116/116 00000100:00100000:2.0:1789997786.455575:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 16 00000100:00100000:2.0:1789997786.573916:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713042304:0@lo:400:kworker.0 00000100:00100000:3.0:1789997786.574261:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713042560:0@lo:400:kworker.0 00000100:00100000:3.0:1789997786.574309:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997786.574379:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997786.574385:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713042688:0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574404:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997786.574410:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997786.574443:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713042816:0@lo:400:kworker.0 00000100:00100000:3.0:1789997786.574448:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713042432:0@lo:400:kworker.0 00000100:00100000:3.0:1789997786.574467:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997786.574467:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997786.574484:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713042944:0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574503:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713042560 00000100:00100000:3.0:1789997786.574504:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997786.574511:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713042560 00000100:00100000:3.0:1789997786.574531:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713042688 00000100:00100000:3.0:1789997786.574534:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713042688 00000100:00100000:3.0:1789997786.574558:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713042816 00000100:00100000:2.0:1789997786.574558:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713042432 00000100:00100000:3.0:1789997786.574560:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713042816 00000100:00100000:2.0:1789997786.574561:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713042432 00000100:00100000:2.0:1789997786.574575:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713042944 00000100:00100000:2.0:1789997786.574578:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713042944 00000100:00100000:2.0:1789997786.574601:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1789997786.574622:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713042560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574713:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713042560:12345-0@lo:400:kworker.0 Request processed in 103us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997786.574720:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1789997786.574736:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1789997786.574743:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713042432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574775:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713042432:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997786.574781:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:3.0:1789997786.574784:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1789997786.574792:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713042688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574792:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:2.0:1789997786.574797:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713042944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574820:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713042944:12345-0@lo:400:kworker.0 Request processed in 23us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997786.574821:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713042688:12345-0@lo:400:kworker.0 Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997786.574826:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1789997786.574826:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:3.0:1789997786.574838:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:3.0:1789997786.574843:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713042816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574843:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713042304 00000100:00100000:2.0:1789997786.574846:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713042304 00000100:00100000:3.0:1789997786.574873:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713042816:12345-0@lo:400:kworker.0 Request processed in 30us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997786.574873:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1789997786.574879:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1789997786.574879:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713042304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574907:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713042304:12345-0@lo:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997786.574913:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:2.0:1789997786.574941:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997786.574945:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997786.574948:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997786.574982:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713042688:0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.574992:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713042560:0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.575025:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713042432:0@lo:400:kworker.0 00000100:00100000:2.0:1789997786.575033:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713042944:0@lo:400:kworker.0 00000100:00100000:3.0:1789997786.575229:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713042304:0@lo:400:kworker.0 00000100:00100000:3.0:1789997786.575242:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713042816:0@lo:400:kworker.0 00010000:00010000:3.0:1789997786.894305:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997787.839370:0:93351:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0a189fa0 20000000:00000080:2.0:1789997787.839389:0:93351:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faaf1c00 uarg=0000000000000000 00010000:00010000:2.0:1789997787.840008:0:93351:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997787.840025:0:93351:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997787.840041:0:93351:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997787.840059:0:93351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997787.840075:0:93351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592db42 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997787.840084:0:93351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997787.840121:0:93351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592db42 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997787.840136:0:93351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592db42 expref: 18 pid: 5805 timeout: 2076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997787.840150:0:93351:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93351:1876946713043072:0@lo:104: 00000100:00100000:2.0:1789997787.840212:0:93351:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997787.840260:0:93351:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997787.841037:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713043072 00000100:00100000:0.0:1789997787.841046:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713043072 00000100:00100000:0.0:1789997787.841130:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789997787.841140:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93351:x1876946713043072:12345-0@lo:104: 00010000:00010000:0.0:1789997787.841153:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997787.841226:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997787.841233:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93351:x1876946713043072:12345-0@lo:104: Request processed in 95us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997787.841240:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1789997787.841315:0:93351:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93351:1876946713043072:0@lo:104: 00010000:00010000:3.0:1789997787.841349:0:93351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841409:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997787.841417:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841425:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997787.841430:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841449:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997787.841456:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997787.841462:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997787.841509:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841521:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997787.841543:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841550:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3000/0x65b43101d592db42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592db49 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841576:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997787.841578:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997787.841580:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997787.841591:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713043200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997787.841645:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997787.841710:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713043200 00000100:00100000:1.0:1789997787.841714:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713043200 00010000:00010000:1.0:1789997787.841734:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592db42 expref: 19 pid: 5805 timeout: 2076 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997787.841756:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789997787.841762:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713043200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997787.841771:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997787.841781:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592db42 expref: 19 pid: 5805 timeout: 2076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841789:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592db42 expref: 19 pid: 5805 timeout: 2076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841802:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592db49 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592db42 expref: 19 pid: 5805 timeout: 2076 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841818:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841826:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841838:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841845:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841851:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841857:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841862:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997787.841865:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841873:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841884:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.841892:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997787.841919:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713043200:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997787.841926:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789997787.841953:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713043200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997787.842024:0:93351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997787.842032:0:93351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997787.842038:0:93351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592db50 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997787.917826:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997788.439385:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997788.439815:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997788.439864:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997788.439891:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704560000 00000100:00100000:1.0:1789997788.439900:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704560000 00000100:00100000:3.0:1789997788.440190:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704559872 00000100:00100000:3.0:1789997788.440195:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704559872 00000100:00100000:3.0:1789997788.440240:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1174 00000100:00100000:3.0:1789997788.440265:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704559872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997788.440297:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1449 00000100:00100000:1.0:1789997788.440308:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704560000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997788.440363:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704559872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 111us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997788.440365:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704560000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 58us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997788.440380:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1174 00000100:00100000:1.0:1789997788.440381:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1449 00000100:00100000:1.0:1789997788.440417:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704560256 00000100:00100000:1.0:1789997788.440421:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704560256 00000100:00100000:1.0:1789997788.440452:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 974 00000100:00100000:1.0:1789997788.440458:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704560256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997788.440484:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704560256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997788.440491:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 974 00000100:00080000:1.0:1789997788.440508:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997788.440512:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997788.442500:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997788.442706:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704560128 00000100:00100000:3.0:1789997788.442714:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704560128 00000100:00100000:3.0:1789997788.442773:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 975 00000100:00100000:3.0:1789997788.442783:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704560128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:1.0:1789997788.442826:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997788.442846:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704560128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 63us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997788.442856:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 975 00000100:00100000:1.0:1789997788.621169:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713043328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997788.621242:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997788.621328:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713043456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997788.621354:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997788.621389:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713043328 00000100:00100000:1.0:1789997788.621397:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713043328 00000100:00100000:1.0:1789997788.621445:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713043456 00000100:00100000:1.0:1789997788.621448:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713043456 00000100:00100000:1.0:1789997788.621465:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1789997788.621472:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713043328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997788.621506:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997788.621550:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713043328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997788.621557:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1789997788.621575:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:1.0:1789997788.621581:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713043456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997788.621598:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997788.621629:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713043456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997788.621635:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00080000:1.0:1789997788.621676:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997788.621679:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997788.621712:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713043456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997788.621741:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713043328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789997788.938826:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997789.514765:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997789.514772:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997789.514777:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997789.514819:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997789.514832:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997789.514844:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997789.514868:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713043584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997789.514933:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997789.515000:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee505780 going to sleep for 11 seconds 00000100:00100000:2.0:1789997789.515182:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713043584 00000100:00100000:2.0:1789997789.515199:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713043584 00000100:00100000:2.0:1789997789.515329:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1789997789.515340:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713043584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997789.515353:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997789.515366:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592db57 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997789.515389:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592db57 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997789.515400:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592db57 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997789.515410:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997789.515673:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713043584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 334us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997789.515680:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:1.0:1789997789.522002:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713043584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997789.522035:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997789.522049:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997789.522080:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997789.522086:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997789.522095:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997789.964040:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997790.484930:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997790.485002:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704560384 00000100:00100000:2.0:1789997790.485012:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704560384 00000100:00100000:2.0:1789997790.485084:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1043 00000100:00100000:2.0:1789997790.485096:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:54998:x1876946704560384:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997790.485117:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997790.485139:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592db65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf00e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997790.485209:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592db6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997790.485223:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592db6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997790.485237:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592db6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997790.485291:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789997790.485295:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997790.485312:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592db6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997790.485333:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592db65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf00e expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997790.485356:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592db6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf00e expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997790.485364:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997790.485367:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997790.485371:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3800, rc 0) 00000100:00100000:2.0:1789997790.485432:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54998:x1876946704560384:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 339us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997790.485439:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1043 00000100:00080000:1.0:1789997790.485483:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997790.488564:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997790.488634:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704560512 00000100:00100000:3.0:1789997790.488642:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704560512 00000100:00100000:3.0:1789997790.488851:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1044 00000100:00100000:3.0:1789997790.488862:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:54998:x1876946704560512:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997790.488880:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997790.488899:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592db73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf015 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.488953:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.488966:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.488978:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.488991:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.488998:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489005:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489323:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592db88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489333:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592db88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489340:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592db88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997790.489371:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789997790.489375:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997790.489394:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592db88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489405:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489412:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489419:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489425:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997790.489429:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489436:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489447:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997790.489451:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997790.489456:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489462:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592db7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489473:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489478:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489483:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489488:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997790.489490:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489495:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489501:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38ee49e600) 00010000:00010000:3.0:1789997790.489503:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997790.489505:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489511:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592db81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489537:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592db73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf015 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489550:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592db88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf015 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997790.489556:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997790.489559:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997790.489561:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789997790.489812:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54998:x1876946704560512:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 951us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997790.489819:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1044 00000100:00100000:0.0:1789997790.494965:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997790.495041:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704560768 00000100:00100000:1.0:1789997790.495051:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704560768 00000100:00100000:1.0:1789997790.495108:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1045 00000100:00100000:1.0:1789997790.495117:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54998:x1876946704560768:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997790.495164:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997790.495319:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592db88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf015 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997790.495338:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:1.0:1789997790.495349:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997790.495372:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997790.495386:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997790.495398:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789997790.547973:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967697 is committed 00000004:00010000:2.0:1789997790.547989:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008272cca1 reply state 0000000061d15bbe transno 4294967697 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997790.548003:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997790.548020:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00080000:2.0:1789997790.548126:0:12471:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789997790.548151:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:54998:x1876946704560768:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 53030us (53190us total) trans 4294967697 rc 0/0 00000100:00100000:2.0:1789997790.548159:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1045 00010000:00010000:0.0:1789997790.548338:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997790.548348:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997790.548356:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997790.548363:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997790.548368:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997790.548380:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997790.548396:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:0.0:1789997790.548399:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997790.548404:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997790.548411:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592db8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997790.986837:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997791.289914:0:93549:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfc2121c0 20000000:00000080:0.0:1789997791.289933:0:93549:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fabb4c00 uarg=0000000000000000 00010000:00010000:0.0:1789997791.290408:0:93549:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997791.290440:0:93549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:0.0:1789997791.290443:0:93549:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997791.290454:0:93549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592db6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf00e expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997791.290477:0:93549:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997791.290492:0:93549:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997791.290508:0:93549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997791.290521:0:93549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592db57 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997791.290529:0:93549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997791.290574:0:93549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592db57 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997791.290588:0:93549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592db57 expref: 18 pid: 5803 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997791.290602:0:93549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93549:1876946713043712:0@lo:104: 00000100:00100000:0.0:1789997791.290849:0:93549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997791.290955:0:93549:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61000 going to sleep for 11 seconds 00000100:00100000:3.0:1789997791.291023:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713043712 00000100:00100000:3.0:1789997791.291030:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713043712 00000100:00100000:3.0:1789997791.291104:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789997791.291113:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93549:x1876946713043712:12345-0@lo:104: 00010000:00010000:3.0:1789997791.291126:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997791.291252:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997791.291267:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93549:x1876946713043712:12345-0@lo:104: Request processed in 156us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997791.291275:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:2.0:1789997791.291321:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997791.291329:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291338:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997791.291342:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291351:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997791.291360:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997791.291365:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997791.291393:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291399:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997791.291416:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291424:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592db57 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592db5e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291439:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997791.291440:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997791.291442:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997791.291458:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713043840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997791.291489:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997791.291526:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713043840 00000100:00100000:2.0:1789997791.291530:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713043840 00010000:00010000:2.0:1789997791.291548:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592db57 expref: 19 pid: 5803 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997791.291575:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789997791.291583:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713043840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997791.291592:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997791.291596:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592db57 expref: 19 pid: 5803 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291605:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592db57 expref: 19 pid: 5803 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291620:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291629:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291642:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291650:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291678:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291685:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291690:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997791.291694:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291701:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291710:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997791.291724:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997791.291755:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713043840:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997791.291761:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:2.0:1789997791.291806:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713043840:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997791.291996:0:93549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592db5e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592db57 expref: 18 pid: 5803 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997791.292008:0:93549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93549:1876946713043712:0@lo:104: 00010000:00010000:1.0:1789997791.292022:0:93549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997791.292030:0:93549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997791.292037:0:93549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997791.292044:0:93549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592db96 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997791.691848:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713044224:0@lo:400:kworker.0 00000100:00100000:2.0:1789997791.691936:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997791.691999:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997791.692006:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713044352:0@lo:400:kworker.0 00000100:00100000:2.0:1789997791.692034:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997791.692067:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713044224 00000100:00100000:2.0:1789997791.692076:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713044224 00000100:00100000:2.0:1789997791.692134:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1789997791.692146:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713044224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997791.692196:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713044224:12345-0@lo:400:kworker.0 Request processed in 53us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997791.692203:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:2.0:1789997791.692268:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713044224:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693156:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713043968:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693206:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997791.693241:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713044480:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693282:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997791.693307:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789997791.693314:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713044096:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693335:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997791.693352:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713044608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693374:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997791.693403:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713044352 00000100:00100000:1.0:1789997791.693409:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713044352 00000100:00100000:1.0:1789997791.693442:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713044480 00000100:00100000:1.0:1789997791.693445:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713044480 00000100:00100000:1.0:1789997791.693465:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1789997791.693473:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713044352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693516:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713044352:12345-0@lo:400:kworker.0 Request processed in 44us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997791.693523:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:1.0:1789997791.693537:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1789997791.693544:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713044480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693574:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713044480:12345-0@lo:400:kworker.0 Request processed in 31us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997791.693580:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00080000:1.0:1789997791.693595:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997791.693598:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997791.693601:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997791.693616:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713044096 00000100:00100000:1.0:1789997791.693619:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713044096 00000100:00100000:1.0:1789997791.693642:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713044608 00000100:00100000:1.0:1789997791.693644:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713044608 00000100:00100000:1.0:1789997791.693751:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1789997791.693758:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713044096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693790:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713044096:12345-0@lo:400:kworker.0 Request processed in 33us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997791.693796:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1789997791.693808:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:1.0:1789997791.693814:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713044608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.693840:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713044608:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997791.693846:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1789997791.693964:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713043968 00000100:00100000:2.0:1789997791.693969:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713043968 00000100:00100000:2.0:1789997791.693998:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1789997791.694006:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713043968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997791.694041:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713043968:12345-0@lo:400:kworker.0 Request processed in 36us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997791.694051:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00080000:1.0:1789997791.694122:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997791.694152:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713044096:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.694163:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713044608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.694171:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713043968:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.694180:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713044480:0@lo:400:kworker.0 00000100:00100000:1.0:1789997791.694226:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713044352:0@lo:400:kworker.0 00010000:00010000:1.0:1789997792.010852:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997792.650787:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997792.650795:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997792.650800:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997792.650847:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997792.650860:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997792.650872:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997792.650898:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713044736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997792.651183:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997792.651250:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60540 going to sleep for 11 seconds 00000100:00100000:1.0:1789997792.652458:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713044736 00000100:00100000:1.0:1789997792.652470:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713044736 00000100:00100000:1.0:1789997792.652532:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1789997792.652542:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713044736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997792.652557:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997792.652573:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592db9d expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997792.652598:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592db9d expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997792.652609:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592db9d expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997792.652617:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997792.652699:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713044736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997792.652706:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1789997792.652772:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3531500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713044736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997792.652791:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997792.652801:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997792.652822:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997792.652827:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997792.652834:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997793.036509:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997793.559003:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997793.559050:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997793.559059:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704560896 00000100:00100000:3.0:1789997793.559080:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704560896 00000100:00100000:1.0:1789997793.559080:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997793.559111:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997793.559139:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704561152 00000100:00100000:3.0:1789997793.559142:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1178 00000100:00100000:1.0:1789997793.559145:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704561152 00000100:00100000:3.0:1789997793.559155:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704560896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997793.559207:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704561280 00000100:00100000:1.0:1789997793.559222:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704561280 00000100:00100000:3.0:1789997793.559234:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704560896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997793.559241:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1178 00000100:00100000:1.0:1789997793.559250:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 978 00000100:00100000:1.0:1789997793.559259:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704561152:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997793.559307:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704561152:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997793.559315:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 978 00000100:00100000:1.0:1789997793.559333:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 979 00000100:00100000:1.0:1789997793.559340:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704561280:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997793.559367:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704561280:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997793.559375:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 979 00000100:00100000:1.0:1789997793.559396:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704561024 00000100:00100000:1.0:1789997793.559400:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704561024 00000100:00100000:1.0:1789997793.559437:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1453 00000100:00100000:1.0:1789997793.559444:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704561024:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997793.559490:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704561024:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997793.559498:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1453 00000100:00080000:1.0:1789997793.559532:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997793.559538:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997793.559540:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997793.650607:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997793.650646:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704561408 00000100:00100000:2.0:1789997793.650677:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704561408 00000100:00100000:2.0:1789997793.650733:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1046 00000100:00100000:2.0:1789997793.650744:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55074:x1876946704561408:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997793.650765:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997793.650787:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592dbab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf01c expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.650859:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.650874:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.650889:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.650907:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.650914:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.650920:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651207:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dbc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651228:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651236:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997793.651258:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:2.0:1789997793.651262:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997793.651282:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651294:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651301:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651312:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651318:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997793.651322:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651331:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651342:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997793.651345:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997793.651350:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651357:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592dbb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651367:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651373:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651378:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651384:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997793.651387:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651396:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651404:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997793.651406:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997793.651409:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651415:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592dbb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651647:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592dbab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf01c expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651753:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dbc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf01c expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.651761:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997793.651764:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997793.651766:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2a00, rc 0) 00000100:00100000:2.0:1789997793.651867:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55074:x1876946704561408:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1124us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997793.651874:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1046 00000100:00100000:2.0:1789997793.670110:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997793.670935:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704561664 00000100:00100000:3.0:1789997793.670947:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704561664 00000100:00100000:3.0:1789997793.671010:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1047 00000100:00100000:3.0:1789997793.671022:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55074:x1876946704561664:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997793.671042:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997793.671064:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dbc7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf023 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.671336:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.671353:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.671364:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.671379:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.671387:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.671393:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997793.674796:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:3.0:1789997793.675607:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dbdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675624:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675636:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675692:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675700:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675707:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675715:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997793.675719:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675727:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675741:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997793.675744:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997793.675749:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675756:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dbce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997793.675768:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b0b1501 reply state 00000000e7246e7a transno 4294967698 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997793.675777:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997793.675811:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dbc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf023 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675838:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf023 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.675845:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997793.675847:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997793.675850:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997793.675924:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:55074:x1876946704561664:12345-192.168.204.4@tcp:101:touch.0 Request processed in 4903us (5823us total) trans 4294967698 rc 0/0 00000100:00100000:3.0:1789997793.675934:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1047 00010000:00010000:3.0:1789997793.681346:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.681364:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.681372:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.681378:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997793.681383:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.681390:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.681406:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997793.681409:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997793.681414:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.681420:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997793.686449:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997793.688405:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704561920 00000100:00100000:3.0:1789997793.688420:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704561920 00000100:00100000:3.0:1789997793.688487:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1048 00000100:00100000:3.0:1789997793.688499:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:55074:x1876946704561920:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:3.0:1789997793.688557:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997793.688584:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dbdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf023 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.688605:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997793.688617:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997793.688676:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.688690:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.688702:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997793.688838:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000889d57ca reply state 0000000058175133 transno 4294967699 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997793.688847:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997793.688950:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:55074:x1876946704561920:12345-192.168.204.4@tcp:36:touch.0 Request processed in 454us (2770us total) trans 4294967699 rc 0/0 00000100:00100000:3.0:1789997793.688958:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1048 00010000:00010000:0.0:1789997793.695782:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997793.695798:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997793.695807:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997793.695813:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997793.695819:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997793.695827:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997793.695846:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:0.0:1789997793.695849:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997793.695855:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997793.695865:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dbea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997793.696101:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997793.696803:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704562048 00000100:00100000:3.0:1789997793.696814:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704562048 00000100:00100000:2.0:1789997793.697032:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1049 00000100:00100000:2.0:1789997793.697043:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:55074:x1876946704562048:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997793.697070:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997793.697091:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592dbf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf02a expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.697155:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592dbf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf02a expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.697169:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592dbf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf02a expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.697188:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:2.0:1789997793.697191:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997793.697195:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3000, rc 0) 00000100:00100000:2.0:1789997793.697275:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:55074:x1876946704562048:12345-192.168.204.4@tcp:101:touch.0 Request processed in 234us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997793.697283:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1049 00000100:00100000:2.0:1789997793.700021:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997793.700118:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704562176 00000100:00100000:3.0:1789997793.700128:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704562176 00000100:00100000:3.0:1789997793.700176:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 557 00000100:00100000:3.0:1789997793.700187:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704562176:12345-192.168.204.4@tcp:2:touch.0 00000100:00100000:0.0:1789997793.701225:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704562176:12345-192.168.204.4@tcp:2:touch.0 Request processed in 1035us (1208us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789997793.701237:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 557 00000100:00100000:0.0:1789997793.703415:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997793.703562:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704562432 00000100:00100000:2.0:1789997793.703572:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704562432 00000100:00100000:2.0:1789997793.703628:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 108 00000100:00100000:2.0:1789997793.703639:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:55074:x1876946704562432:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:2.0:1789997793.704175:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:55074:x1876946704562432:12345-192.168.204.4@tcp:35:touch.0 Request processed in 535us (765us total) trans 4294967700 rc 0/0 00000100:00100000:2.0:1789997793.704184:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 108 00000100:00100000:2.0:1789997793.738865:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997793.738893:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713044864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997793.738965:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997793.739041:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713044992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997793.739043:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713044864 00000100:00100000:1.0:1789997793.739052:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713044864 00000100:00100000:2.0:1789997793.739072:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789997793.739086:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997793.739110:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:1.0:1789997793.739120:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713044864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997793.739155:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997793.739194:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713044992 00000100:00100000:0.0:1789997793.739199:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713044992 00000100:00100000:1.0:1789997793.739231:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713044864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997793.739239:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1789997793.739253:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1789997793.739283:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713044864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997793.739332:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713044992:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789997793.739412:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789997793.739552:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997793.739594:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713044992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 335us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997793.739601:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1789997793.739926:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713044992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997793.750080:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997793.750169:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704562560 00000100:00100000:3.0:1789997793.750181:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704562560 00000100:00100000:3.0:1789997793.750259:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1050 00000100:00100000:3.0:1789997793.750271:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:55078:x1876946704562560:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997793.750297:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997793.750317:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dbf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf031 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750410:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750424:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750435:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750457:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750464:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750471:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750563:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750572:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750579:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997793.750618:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x56:0x0]: returning size 0 00000004:00200000:3.0:1789997793.750622:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997793.750640:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750688:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750697:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750703:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750710:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750716:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997793.750720:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750727:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750739:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997793.750742:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997793.750747:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750753:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dbff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750771:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750777:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750783:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750788:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997793.750790:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750796:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750803:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38ee49e800) 00010000:00010000:3.0:1789997793.750805:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997793.750808:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750825:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750855:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dbf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf031 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750870:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf031 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.750882:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:3.0:1789997793.750884:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997793.750887:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997793.750951:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:55078:x1876946704562560:12345-192.168.204.4@tcp:101:rm.0 Request processed in 681us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997793.750958:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1050 00000100:00100000:3.0:1789997793.754387:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997793.754458:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704562688 00000100:00100000:1.0:1789997793.754468:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704562688 00000100:00100000:1.0:1789997793.754538:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 558 00000100:00100000:1.0:1789997793.754549:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704562688:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:1.0:1789997793.754565:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997793.754586:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf038 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997793.754613:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x6ab132e1, atime: 0x6ab132e1, ctime: 0x6ab132e1, blocks: 0x1 00010000:00010000:1.0:1789997793.754638:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=1982s v=(0 0) 00010000:00010000:1.0:1789997793.754643:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997793.754687:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.754707:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 7 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.754720:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997793.754941:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704562688:12345-192.168.204.4@tcp:101:rm.0 Request processed in 393us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997793.754948:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 558 00000100:00100000:2.0:1789997793.757290:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997793.757406:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704562944 00000100:00100000:1.0:1789997793.757415:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704562944 00000100:00100000:1.0:1789997793.757775:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1051 00000100:00100000:1.0:1789997793.757786:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:55078:x1876946704562944:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997793.757844:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997793.757942:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf031 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.757964:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592dbf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x56:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf02a expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.757972:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff8a38d0bdf600) 00010000:00010000:1.0:1789997793.757980:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997793.758001:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.758014:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.758024:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.758039:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.758046:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.758053:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.758150:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.758158:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.758166:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997793.759202:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].33, 64 off10304 00000004:00080000:1.0:1789997793.759226:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1982451571834ns, next at 1983451569209ns, rc = 0 00010000:00010000:1.0:1789997793.759284:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759296:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759305:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759313:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759320:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759326:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759348:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997793.759368:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759374:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759386:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759392:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997793.759398:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759405:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759416:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789997793.759420:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997793.759424:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759430:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592dc29 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759447:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759454:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759459:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759464:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997793.759466:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759476:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759484:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:1.0:1789997793.759486:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997793.759490:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997793.759495:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592dc1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997793.759504:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee84686d reply state 00000000e000ac94 transno 4294967701 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997793.759513:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997793.759600:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:55078:x1876946704562944:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1814us (2315us total) trans 4294967701 rc 0/0 00000100:00100000:1.0:1789997793.759608:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1051 00010000:00010000:2.0:1789997793.759625:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997793.759632:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.759637:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997793.759641:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.759648:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.759675:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x56:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:2.0:1789997793.759678:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997793.759681:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.759685:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592dc30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997793.759698:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997793.759700:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997793.759702:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997793.762320:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.762337:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.762343:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.762348:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997793.762351:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.762358:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.762373:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38e062df00) 00010000:00010000:3.0:1789997793.762377:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997793.762382:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997793.762387:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dc22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997794.060062:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997794.292703:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000020:00000080:0.0:1789997795.050413:0:93795:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffece12c100 20000000:00000080:0.0:1789997795.050432:0:93795:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e5400 uarg=0000000000000000 00010000:00010000:1.0:1789997795.051422:0:93795:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789997795.051458:0:93795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:1.0:1789997795.051463:0:93795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997795.051474:0:93795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592dbc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf01c expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.051499:0:93795:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1789997795.051516:0:93795:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997795.051530:0:93795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.051548:0:93795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592db9d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.051555:0:93795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.051592:0:93795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592db9d expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.051605:0:93795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592db9d expref: 18 pid: 5803 timeout: 2083 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997795.052166:0:93795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93795:1876946713045120:0@lo:104: 00000100:00100000:1.0:1789997795.052261:0:93795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997795.052326:0:93795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b5e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789997795.052504:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713045120 00000100:00100000:0.0:1789997795.052512:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713045120 00000100:00100000:0.0:1789997795.052565:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789997795.052575:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93795:x1876946713045120:12345-0@lo:104: 00010000:00010000:0.0:1789997795.052589:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997795.053360:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997795.053371:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93795:x1876946713045120:12345-0@lo:104: Request processed in 797us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997795.053381:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789997795.053462:0:93795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93795:1876946713045120:0@lo:104: 00010000:00010000:1.0:1789997795.053482:0:93795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.053524:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997795.053530:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.053538:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997795.053543:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.053552:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997795.053559:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997795.053566:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997795.053646:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.053681:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997795.053712:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.053719:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2600/0x65b43101d592db9d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dba4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.053745:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997795.053748:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997795.053750:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997795.053754:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997795.053773:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713045248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997795.053817:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997795.053908:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713045248 00000100:00100000:0.0:1789997795.053914:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713045248 00010000:00010000:0.0:1789997795.053936:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592db9d expref: 19 pid: 5803 timeout: 2083 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997795.053968:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1789997795.053977:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713045248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997795.053987:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997795.054006:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592db9d expref: 19 pid: 5803 timeout: 2083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054016:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592db9d expref: 19 pid: 5803 timeout: 2083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054030:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592dba4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592db9d expref: 19 pid: 5803 timeout: 2083 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054043:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054051:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054065:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054085:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054092:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054098:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054103:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997795.054107:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054115:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054137:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.054146:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997795.054177:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713045248:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997795.054196:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1789997795.054235:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713045248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997795.054273:0:93795:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997795.054281:0:93795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997795.054287:0:93795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592dc37 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997795.084815:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997795.823791:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967701 is committed 00000004:00080000:3.0:1789997795.823804:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 94 committed 00000100:00100000:1.0:1789997795.823998:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997795.824023:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713045376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789997795.824094:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997795.824215:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713045376 00000100:00100000:0.0:1789997795.824223:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713045376 00000100:00100000:0.0:1789997795.824291:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:0.0:1789997795.824300:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713045376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789997795.824326:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:33 count 1 00010000:00010000:0.0:1789997795.824351:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.824373:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.824381:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789997795.824385:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997795.824390:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.824429:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 5 pid: 6658 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.824444:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 5 pid: 6658 timeout: 2084 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997795.824457:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946713045504:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997795.824525:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0a77f00 going to sleep for 11 seconds 00000100:00080000:1.0:1789997795.824583:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997795.827530:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997795.827710:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704563072 00000100:00100000:1.0:1789997795.827719:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704563072 00010000:00010000:1.0:1789997795.827782:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 6 pid: 6658 timeout: 2084 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997795.827823:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 414 00000100:00100000:1.0:1789997795.827833:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704563072:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997795.827846:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997795.827853:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 6 pid: 6658 timeout: 2084 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.827865:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 6 pid: 6658 timeout: 2084 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.827892:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997795.827897:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997795.827903:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.827913:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.827936:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997795.827989:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704563072:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 157us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997795.827997:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 414 00010000:00010000:0.0:1789997795.828115:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915f3946/0x65b43101d592dc14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf038 expref: 5 pid: 6658 timeout: 2084 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997795.828129:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946713045504:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997795.828149:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.828161:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.828180:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.828191:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.828200:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997795.828226:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997795.828853:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713045376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4553us (4758us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789997795.828865:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000004:00080000:0.0:1789997795.828912:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38f9fddf80/2, rc 0, transno 4294967363 00000100:00100000:0.0:1789997795.828918:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713045376:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1789997795.829436:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789997795.829495:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997795.829506:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.829522:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997795.829526:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.829536:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.829555:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.829561:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5caac31/0x65b43101d592dc3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997795.829588:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997795.829591:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997795.829593:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997796.107214:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997796.810730:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997796.810740:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997796.810744:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997796.810787:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997796.810800:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997796.810812:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997796.810845:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713045632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997796.810913:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997796.810959:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997796.811928:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713045632 00000100:00100000:2.0:1789997796.811937:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713045632 00000100:00100000:2.0:1789997796.811987:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1789997796.811996:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713045632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997796.812010:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997796.812025:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dc45 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997796.812050:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dc45 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997796.812062:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dc45 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997796.812072:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997796.812133:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713045632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997796.812140:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1789997796.812257:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713045888:0@lo:400:kworker.0 00000100:00100000:1.0:1789997796.812289:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997796.812294:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713046144:0@lo:400:kworker.0 00000100:00100000:1.0:1789997796.812314:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789997796.812320:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713045760:0@lo:400:kworker.0 00000100:00100000:3.0:1789997796.812325:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997796.812379:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713045888 00000100:00100000:2.0:1789997796.812383:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713045888 00000100:00100000:2.0:1789997796.812420:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1789997796.812427:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997796.817062:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997796.817087:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997796.817100:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713046016:0@lo:400:kworker.0 00000100:00100000:1.0:1789997796.817102:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713046272:0@lo:400:kworker.0 00000100:00100000:3.0:1789997796.817189:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997796.817189:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997796.817226:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713046144 00000100:00100000:1.0:1789997796.817226:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713045760 00000100:00100000:3.0:1789997796.817233:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713046144 00000100:00100000:1.0:1789997796.817233:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713045760 00000100:00100000:3.0:1789997796.817269:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713046016 00000100:00100000:1.0:1789997796.817269:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713046272 00000100:00100000:3.0:1789997796.817272:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713046016 00000100:00100000:1.0:1789997796.817272:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713046272 00000100:00100000:3.0:1789997796.817294:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1789997796.817294:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1789997796.817303:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713046144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997796.817303:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713045760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997796.817349:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713046144:12345-0@lo:400:kworker.0 Request processed in 47us (5022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997796.817349:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713045760:12345-0@lo:400:kworker.0 Request processed in 47us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997796.817357:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1789997796.817357:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1789997796.817374:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1789997796.817374:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1789997796.817381:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713046016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997796.817381:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713046272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997796.817405:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713046016:12345-0@lo:400:kworker.0 Request processed in 25us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997796.817405:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713046272:12345-0@lo:400:kworker.0 Request processed in 25us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997796.817412:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1789997796.817412:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00080000:3.0:1789997796.817445:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997796.817450:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997796.817462:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713045760:0@lo:400:kworker.0 00000100:00100000:1.0:1789997796.817472:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713046272:0@lo:400:kworker.0 00000100:00100000:3.0:1789997796.817473:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713046016:0@lo:400:kworker.0 00000100:00100000:3.0:1789997796.817482:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713046144:0@lo:400:kworker.0 00000100:00100000:2.0:1789997796.817616:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713045888:12345-0@lo:400:kworker.0 Request processed in 5188us (5325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997796.817624:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1789997796.817730:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d73800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713045632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997796.817731:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713045888:0@lo:400:kworker.0 00010000:00010000:2.0:1789997796.817752:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997796.817776:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997796.817815:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997796.817821:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997796.818043:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997797.131986:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997797.226900:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997797.227065:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704563200 00000100:00100000:3.0:1789997797.227076:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704563200 00000100:00100000:3.0:1789997797.227173:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1052 00000100:00100000:3.0:1789997797.227185:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55166:x1876946704563200:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997797.227210:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997797.227244:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf03f expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.227314:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.227328:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.227343:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997797.227395:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000100:00080000:1.0:1789997797.227396:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1789997797.227401:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997797.227423:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.227448:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf03f expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.227473:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf03f expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.227482:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997797.227485:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997797.227489:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997797.227556:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55166:x1876946704563200:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 373us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997797.227564:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1052 00000100:00100000:2.0:1789997797.231302:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997797.231382:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704563456 00000100:00100000:3.0:1789997797.231391:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704563456 00000100:00100000:3.0:1789997797.231455:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1053 00000100:00100000:3.0:1789997797.231466:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55166:x1876946704563456:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997797.231514:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997797.231539:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf03f expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.231560:0:5810:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592dbc0) 00010000:00010000:3.0:1789997797.231565:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997797.231575:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997797.231597:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.231609:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997797.231617:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997797.286650:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4205479 reply state 00000000f9821b3b transno 4294967702 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997797.286676:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967702 is committed 00000100:00100000:3.0:1789997797.286754:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997797.286772:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00080000:3.0:1789997797.286918:0:5810:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997797.286945:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55166:x1876946704563456:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 55476us (55647us total) trans 4294967702 rc 0/0 00000100:00100000:3.0:1789997797.286953:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1053 00010000:00010000:1.0:1789997797.287732:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.287744:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.287807:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.287814:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997797.287820:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.287828:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.287843:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:1.0:1789997797.287846:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997797.287851:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.287858:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789997797.979208:0:93992:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca8a5ba30 20000000:00000080:2.0:1789997797.979227:0:93992:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c770e000 uarg=0000000000000000 00010000:00010000:2.0:1789997797.979812:0:93992:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997797.979828:0:93992:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997797.979843:0:93992:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997797.979862:0:93992:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997797.979879:0:93992:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dc45 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997797.979887:0:93992:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997797.979929:0:93992:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dc45 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997797.979944:0:93992:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dc45 expref: 18 pid: 5803 timeout: 2086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997797.979959:0:93992:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93992:1876946713046400:0@lo:104: 00000100:00100000:2.0:1789997797.980101:0:93992:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997797.980208:0:93992:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789997797.980254:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713046400 00000100:00100000:0.0:1789997797.980262:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713046400 00000100:00100000:0.0:1789997797.980345:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789997797.980355:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93992:x1876946713046400:12345-0@lo:104: 00010000:00010000:0.0:1789997797.980368:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997797.980435:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997797.980441:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:93992:x1876946713046400:12345-0@lo:104: Request processed in 89us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997797.980447:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:1.0:1789997797.980501:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997797.980510:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997797.980519:0:93992:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93992:1876946713046400:0@lo:104: 00010000:00010000:1.0:1789997797.980522:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997797.980529:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.980539:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997797.980542:0:93992:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997797.980549:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997797.980558:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997797.980593:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.980600:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997797.980637:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.980644:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2400/0x65b43101d592dc45 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dc4c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997797.980680:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997797.980695:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713046528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997797.980697:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997797.980701:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997797.980704:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997797.980732:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997797.980874:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713046528 00000100:00100000:1.0:1789997797.980879:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713046528 00010000:00010000:1.0:1789997797.980900:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dc45 expref: 19 pid: 5803 timeout: 2086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997797.980972:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1789997797.980981:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713046528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997797.980992:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997797.980998:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dc45 expref: 19 pid: 5803 timeout: 2086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981009:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dc45 expref: 19 pid: 5803 timeout: 2086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981022:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592dc4c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dc45 expref: 19 pid: 5803 timeout: 2086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981034:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981042:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981054:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981061:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981069:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981075:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981080:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997797.981084:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981092:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981114:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997797.981133:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997797.981176:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713046528:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997797.981184:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:2.0:1789997797.981240:0:93992:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997797.981256:0:93992:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997797.981263:0:93992:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592dc68 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93992 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997797.982152:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713046528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997798.154767:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997798.678500:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997798.678547:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997798.678581:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997798.678605:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997798.678791:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704563584 00000100:00100000:0.0:1789997798.678802:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704563584 00000100:00100000:0.0:1789997798.678852:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1180 00000100:00100000:0.0:1789997798.678861:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704563584:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997798.678925:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704563584:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 66us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997798.678933:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1180 00000100:00100000:3.0:1789997798.679331:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704563712 00000100:00100000:3.0:1789997798.679348:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704563712 00000100:00100000:3.0:1789997798.679392:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1457 00000100:00100000:3.0:1789997798.679400:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704563712:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997798.679452:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704563712:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 53us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997798.679459:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1457 00000100:00100000:3.0:1789997798.679481:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704563968 00000100:00100000:3.0:1789997798.679485:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704563968 00000100:00100000:3.0:1789997798.679517:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704563840 00000100:00100000:3.0:1789997798.679520:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704563840 00000100:00100000:3.0:1789997798.679541:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 982 00000100:00100000:3.0:1789997798.679547:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704563968:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997798.679572:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704563968:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997798.679578:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 982 00000100:00100000:3.0:1789997798.679591:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 560 00000100:00100000:3.0:1789997798.679597:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704563840:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:3.0:1789997798.679617:0:6656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592d9dd 00000100:00080000:3.0:1789997798.679628:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789997798.679692:0:6656:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967361 00000100:00100000:3.0:1789997798.679919:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704563840:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 321us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997798.679926:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 560 00000100:00080000:3.0:1789997798.679946:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997798.679950:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789997798.679963:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997798.858831:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713046656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997798.858836:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713046784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997798.859069:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997798.859318:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713046656 00000100:00100000:1.0:1789997798.860012:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713046656 00000100:00100000:1.0:1789997798.860084:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1789997798.860312:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713046656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997798.860612:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997798.860697:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713046656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 604us (1629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997798.860705:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1789997798.860764:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713046656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997798.860857:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997798.864731:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997798.864779:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713046784 00000100:00100000:1.0:1789997798.864791:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713046784 00000100:00100000:1.0:1789997798.864866:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1789997798.864878:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713046784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997798.864919:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997798.864975:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713046784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997798.864984:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00080000:1.0:1789997798.865017:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997798.865204:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713046784:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1789997799.179743:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997799.179750:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997799.179755:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997799.179800:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997799.179813:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997799.179826:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997799.179851:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713046912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997799.180095:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997799.180138:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713046912 00000100:00100000:0.0:1789997799.180147:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713046912 00000100:00100000:3.0:1789997799.180301:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c604b3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789997799.180302:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997799.181396:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1789997799.181411:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713046912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997799.181428:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997799.181445:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dc6f expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997799.181471:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dc6f expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997799.181483:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dc6f expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997799.181492:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997799.181567:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713046912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997799.181574:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1789997799.181610:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713046912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997799.181706:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997799.181776:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997799.181799:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997799.181804:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997799.181812:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789997799.398813:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997799.398824:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a37c6ec5000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997799.398852:0:84165:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c6ec5000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:0.0:1789997799.398890:0:84165:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c6ec0800 for lustre-OST0000 00000001:00080000:3.0:1789997799.407565:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00010000:00010000:0.0:1789997800.204442:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997800.259514:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997800.259681:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704564096 00000100:00100000:3.0:1789997800.259693:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704564096 00000100:00100000:3.0:1789997800.259762:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1054 00000100:00100000:3.0:1789997800.259773:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55242:x1876946704564096:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997800.259792:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997800.259812:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf046 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.259875:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.259890:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.259904:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.259918:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.259925:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.259931:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789997800.260001:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997800.262378:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262405:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262422:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997800.262471:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789997800.262476:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997800.262498:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262511:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262517:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262525:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262530:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997800.262534:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262542:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262554:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997800.262558:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.262562:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262567:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dc84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262582:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262587:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262593:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262598:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997800.262601:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262607:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262615:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38ee49e800) 00010000:00010000:3.0:1789997800.262618:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.262621:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262627:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dc8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262683:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf046 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262700:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf046 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.262713:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997800.262716:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997800.262719:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997800.262796:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55242:x1876946704564096:12345-192.168.204.4@tcp:101:touch.0 Request processed in 3023us (3288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997800.262806:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1054 00000100:00100000:1.0:1789997800.273456:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997800.273932:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704564352 00000100:00100000:3.0:1789997800.273944:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704564352 00000100:00100000:3.0:1789997800.274045:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1055 00000100:00100000:3.0:1789997800.274056:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55242:x1876946704564352:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997800.274089:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997800.274109:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf04d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274195:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274210:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274222:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274237:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274245:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274255:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997800.274268:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00010000:3.0:1789997800.274287:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274293:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274311:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274318:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997800.274322:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274330:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274342:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997800.274345:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.274350:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274356:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dca0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274367:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274377:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274383:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274389:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997800.274392:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274398:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274405:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997800.274407:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.274410:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274416:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dca7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274463:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc99 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf04d expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274474:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997800.274477:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.274480:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dc99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf04d expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.274494:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ac00, rc 0) 00000100:00100000:3.0:1789997800.274560:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55242:x1876946704564352:12345-192.168.204.4@tcp:101:touch.0 Request processed in 506us (1109us total) trans 0 rc 301/301 00000100:00100000:3.0:1789997800.274567:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1055 00000100:00100000:2.0:1789997800.281067:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997800.284135:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704564480 00000100:00100000:3.0:1789997800.284148:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704564480 00000100:00100000:3.0:1789997800.284209:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1056 00000100:00100000:3.0:1789997800.284225:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55242:x1876946704564480:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997800.284246:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997800.284268:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dcae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf054 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284334:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284350:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284364:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284380:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284387:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284393:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284413:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284420:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284426:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284433:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997800.284437:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284445:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.284994:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997800.285000:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.285005:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285013:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dcb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285027:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285033:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285039:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285045:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997800.285048:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285054:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285062:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997800.285065:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.285068:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285074:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dcbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285123:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dcae lrc: 1/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf054 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285133:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997800.285136:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.285140:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dcae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf054 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.285149:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ac00, rc 0) 00000100:00100000:3.0:1789997800.285220:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55242:x1876946704564480:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1002us (4157us total) trans 0 rc 301/301 00000100:00100000:3.0:1789997800.285228:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1056 00000100:00100000:3.0:1789997800.289732:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997800.289789:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704564608 00000100:00100000:3.0:1789997800.289799:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704564608 00000100:00100000:3.0:1789997800.289847:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1057 00000100:00100000:3.0:1789997800.289858:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55242:x1876946704564608:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997800.289879:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997800.289899:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dcc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf05b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.289962:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.289976:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.289987:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290000:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290007:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290013:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290032:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290038:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290048:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290054:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997800.290058:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290065:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290075:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997800.290089:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.290095:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290101:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dcca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290113:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290118:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290124:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290128:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997800.290131:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290141:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290149:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38ee49e800) 00010000:00010000:3.0:1789997800.290151:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.290154:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290159:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dcd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290190:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dcc3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf05b expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290201:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997800.290203:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997800.290207:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592dcc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf05b expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997800.290216:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997800.290278:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55242:x1876946704564608:12345-192.168.204.4@tcp:101:touch.0 Request processed in 422us (554us total) trans 0 rc 301/301 00000100:00100000:3.0:1789997800.290285:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1057 00010000:00010000:3.0:1789997801.228082:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997801.528399:0:94239:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe271c1690 20000000:00000080:0.0:1789997801.528416:0:94239:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c12a8000 uarg=0000000000000000 00010000:00010000:0.0:1789997801.529306:0:94239:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997801.529344:0:94239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:0.0:1789997801.529348:0:94239:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997801.529360:0:94239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592dc92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf046 expref: 5 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997801.529381:0:94239:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997801.529396:0:94239:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997801.529409:0:94239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997801.529423:0:94239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dc6f expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997801.529431:0:94239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997801.530091:0:94239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dc6f expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997801.530108:0:94239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dc6f expref: 18 pid: 7594 timeout: 2090 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997801.530124:0:94239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94239:1876946713047040:0@lo:104: 00000100:00100000:0.0:1789997801.530189:0:94239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997801.530343:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713047040 00000100:00100000:1.0:1789997801.530352:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713047040 00000100:00100000:1.0:1789997801.530399:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789997801.530409:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:94239:x1876946713047040:12345-0@lo:104: 00010000:00010000:1.0:1789997801.530422:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997801.530504:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997801.530512:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:94239:x1876946713047040:12345-0@lo:104: Request processed in 104us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997801.530518:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:3.0:1789997801.530594:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997801.530601:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997801.530614:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997801.530618:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997801.530626:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997801.530633:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997801.530638:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997801.530699:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997801.530705:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997801.530727:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997801.530734:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dc6f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dc76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997801.530750:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997801.530752:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997801.530754:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997801.530761:0:94239:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789997801.530766:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713047168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997801.530784:0:94239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94239:1876946713047040:0@lo:104: 00000100:00100000:3.0:1789997801.530797:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789997801.530801:0:94239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997801.533304:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713047168 00000100:00100000:2.0:1789997801.533321:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713047168 00010000:00010000:2.0:1789997801.533369:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dc6f expref: 19 pid: 7594 timeout: 2090 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997801.533447:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789997801.533466:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713047168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997801.533481:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997801.533487:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dc6f expref: 19 pid: 7594 timeout: 2090 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533500:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dc6f expref: 19 pid: 7594 timeout: 2090 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533518:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592dc76 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dc6f expref: 19 pid: 7594 timeout: 2090 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533550:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533559:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533577:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533584:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533592:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533598:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533604:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997801.533608:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533615:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533638:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997801.533648:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997801.533699:0:94239:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997801.533707:0:94239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997801.533713:0:94239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dcd8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997801.533730:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713047168:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997801.533738:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789997801.533844:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713047168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997801.930970:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713047680:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.931033:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997801.931096:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789997801.931102:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713047296:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932235:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997801.932284:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713047808:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932310:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997801.932341:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713047424:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932364:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997801.932385:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997801.932392:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713047552:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932415:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997801.932445:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713047680 00000100:00100000:1.0:1789997801.932453:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713047680 00000100:00100000:1.0:1789997801.932500:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713047552 00000100:00100000:1.0:1789997801.932503:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713047552 00000100:00100000:1.0:1789997801.932524:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1789997801.932533:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713047680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932581:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713047680:12345-0@lo:400:kworker.0 Request processed in 50us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997801.932588:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1789997801.932604:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1789997801.932611:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713047552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932642:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713047552:12345-0@lo:400:kworker.0 Request processed in 31us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997801.932645:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713047296 00000100:00100000:1.0:1789997801.932647:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1789997801.932649:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713047296 00000100:00100000:1.0:1789997801.932679:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713047808 00000100:00100000:1.0:1789997801.932682:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713047808 00000100:00100000:0.0:1789997801.932692:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713047424 00000100:00100000:0.0:1789997801.932694:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713047424 00000100:00100000:1.0:1789997801.932703:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1789997801.932708:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713047296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997801.932714:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:0.0:1789997801.932719:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713047808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932739:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713047296:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997801.932745:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:0.0:1789997801.932747:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713047808:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997801.932752:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1789997801.932757:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1789997801.932762:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713047424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932787:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713047424:12345-0@lo:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997801.932793:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00080000:1.0:1789997801.932814:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997801.932819:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997801.932820:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997801.932853:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713047552:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932863:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713047424:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932889:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713047296:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932897:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713047808:0@lo:400:kworker.0 00000100:00100000:1.0:1789997801.932904:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:1.0:1789997801.932908:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38f9fddf80, transno 4294967363 00000100:00100000:1.0:1789997801.932929:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713047680:0@lo:400:kworker.0 00010000:00010000:0.0:1789997802.251804:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997802.957926:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997802.957934:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997802.957939:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997802.957986:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997802.957999:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997802.958010:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997802.958045:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713047936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997802.958112:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997802.958850:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d057b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789997802.962422:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713047936 00000100:00100000:0.0:1789997802.962439:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713047936 00000100:00100000:0.0:1789997802.962505:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1789997802.962516:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713047936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997802.962534:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997802.962554:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dcdf expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997802.962581:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dcdf expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997802.962593:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dcdf expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997802.962604:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997802.962702:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713047936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (4589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997802.962708:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1789997802.962776:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713047936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997802.962794:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997802.962804:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997802.962831:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997802.962837:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997802.962846:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997803.274840:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997803.764160:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997803.764348:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704564736 00000100:00100000:0.0:1789997803.764359:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704564736 00000100:00100000:0.0:1789997803.764429:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1058 00000100:00100000:0.0:1789997803.764440:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55329:x1876946704564736:12345-192.168.204.4@tcp:101:chmod.0 00000100:00080000:1.0:1789997803.764456:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997803.764462:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997803.764484:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf062 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.764554:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dcf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.764569:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.764584:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997803.764618:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:0.0:1789997803.764622:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997803.764642:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.764692:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf062 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.764722:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf062 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.764731:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997803.764734:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997803.764737:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997803.764803:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55329:x1876946704564736:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 365us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997803.764810:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1058 00000100:00100000:2.0:1789997803.768764:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997803.768847:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704564992 00000100:00100000:0.0:1789997803.768856:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704564992 00000100:00100000:0.0:1789997803.768915:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1059 00000100:00100000:0.0:1789997803.768925:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55329:x1876946704564992:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997803.768971:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997803.768998:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dcf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf062 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.769025:0:12471:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592dc92) 00010000:00010000:0.0:1789997803.769029:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997803.769042:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997803.769068:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.769080:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997803.769091:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997803.769427:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af7edded reply state 00000000a47725aa transno 4294967703 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997803.769438:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997803.769446:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000100:00100000:0.0:1789997803.769528:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55329:x1876946704564992:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 604us (768us total) trans 4294967703 rc 0/0 00000100:00100000:0.0:1789997803.769536:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1059 00010000:00010000:3.0:1789997803.772484:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997803.772498:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997803.772507:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997803.772513:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997803.772518:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997803.772525:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997803.772540:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:3.0:1789997803.772543:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997803.772549:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997803.772554:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dcfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997803.799207:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997803.799374:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997803.799594:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704565120 00000100:00100000:3.0:1789997803.799604:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704565120 00000100:00100000:3.0:1789997803.799706:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1183 00000100:00100000:3.0:1789997803.799718:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704565120:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997803.799796:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704565120:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 80us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997803.799803:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1183 00000100:00100000:1.0:1789997803.800216:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704565248 00000100:00100000:1.0:1789997803.800222:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704565248 00000100:00100000:1.0:1789997803.800363:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 985 00000100:00100000:1.0:1789997803.800371:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704565248:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997803.800416:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704565248:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997803.800423:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 985 00000100:00080000:2.0:1789997803.800931:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997803.978910:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713048064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997803.978982:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997803.979142:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713048064 00000100:00100000:3.0:1789997803.979151:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713048064 00000100:00100000:3.0:1789997803.979209:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:3.0:1789997803.979218:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713048064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997803.979256:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997803.981403:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713048064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2178us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997803.981417:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00080000:3.0:1789997803.981451:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997803.981524:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713048192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997803.981586:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997803.982781:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713048192 00000100:00100000:1.0:1789997803.982791:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713048192 00000100:00100000:1.0:1789997803.982904:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1789997803.982913:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713048192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997803.982948:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997803.983018:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713048192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997803.983026:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00080000:3.0:1789997803.983166:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997803.983207:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713048192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997803.984184:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713048064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997804.298761:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997804.386212:0:94435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd049fb7b0 20000000:00000080:1.0:1789997804.386299:0:94435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38e03ab800 uarg=0000000000000000 00010000:00010000:1.0:1789997804.386883:0:94435:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997804.386899:0:94435:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997804.386912:0:94435:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997804.386930:0:94435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997804.386952:0:94435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dcdf expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997804.386960:0:94435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997804.386996:0:94435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dcdf expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997804.387023:0:94435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dcdf expref: 18 pid: 5805 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997804.387037:0:94435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94435:1876946713048320:0@lo:104: 00000100:00100000:1.0:1789997804.387098:0:94435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997804.387200:0:94435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789997804.387300:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713048320 00000100:00100000:3.0:1789997804.387307:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713048320 00000100:00100000:3.0:1789997804.387383:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789997804.387392:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:94435:x1876946713048320:12345-0@lo:104: 00010000:00010000:3.0:1789997804.387404:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997804.387515:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997804.387521:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:94435:x1876946713048320:12345-0@lo:104: Request processed in 131us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997804.387529:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00010000:00010000:2.0:1789997804.387589:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997804.387597:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387605:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997804.387610:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387619:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997804.387627:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997804.387633:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997804.387680:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387687:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997804.387707:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387714:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592dcdf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dce6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387731:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997804.387733:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997804.387735:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997804.387745:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713048448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997804.387776:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997804.387814:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713048448 00000100:00100000:2.0:1789997804.387818:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713048448 00010000:00010000:2.0:1789997804.387837:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dcdf expref: 19 pid: 5805 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997804.387861:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789997804.387869:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713048448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997804.387878:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997804.387882:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dcdf expref: 19 pid: 5805 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387891:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dcdf expref: 19 pid: 5805 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387905:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387913:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387929:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387937:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387944:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387950:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387956:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997804.387960:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387968:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387978:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997804.387988:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997804.388025:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713048448:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997804.388032:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789997804.388075:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713048448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997804.388208:0:94435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dce6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dcdf expref: 18 pid: 5805 timeout: 2093 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997804.388336:0:94435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d71180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94435:1876946713048320:0@lo:104: 00010000:00010000:1.0:1789997804.388351:0:94435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997804.388359:0:94435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997804.388365:0:94435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997804.388371:0:94435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592dd02 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997805.322811:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997806.283995:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997806.284003:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997806.284008:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997806.284061:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997806.284075:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997806.284086:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997806.284113:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713048576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997806.284182:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997806.284264:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e293a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789997806.284288:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713048576 00000100:00100000:3.0:1789997806.284295:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713048576 00000100:00100000:3.0:1789997806.284341:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1789997806.284351:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713048576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997806.284365:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997806.284378:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dd09 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997806.284403:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dd09 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997806.284414:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dd09 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997806.284423:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789997806.284468:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713048576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997806.284476:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1789997806.284540:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713048576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997806.284559:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997806.284567:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997806.284594:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997806.284599:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997806.284608:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997806.346775:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997806.883369:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997806.883500:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704565376 00000100:00100000:1.0:1789997806.883510:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704565376 00000100:00100000:1.0:1789997806.883578:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1060 00000100:00100000:1.0:1789997806.883587:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704565376:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997806.883710:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704565376:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 124us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997806.883717:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1060 00000100:00080000:3.0:1789997806.884049:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997806.885582:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997806.885696:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704565504 00000100:00100000:1.0:1789997806.885704:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704565504 00000100:00100000:1.0:1789997806.885750:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 561 00000100:00100000:1.0:1789997806.885757:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876946704565504:12345-192.168.204.4@tcp:8:lfs.0 00010000:00080000:1.0:1789997806.885789:0:8169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 1995 last 0 00000020:00000080:1.0:1789997806.885823:0:8169:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592dd17 00002000:00100000:1.0:1789997806.885836:0:8169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a37c6ec5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789997806.885861:0:8169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789997806.886090:0:8169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789997806.886116:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789997806.886193:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704565504:12345-192.168.204.4@tcp:8:lfs.0 Request processed in 434us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997806.886200:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 561 00000100:00100000:0.0:1789997806.888826:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997806.888923:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704565632 00000100:00100000:1.0:1789997806.888933:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704565632 00000100:00080000:3.0:1789997806.889062:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997806.889897:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 562 00000100:00100000:1.0:1789997806.889913:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704565632:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997806.890288:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704565632:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 379us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997806.890296:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 562 00000100:00100000:2.0:1789997806.892899:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997806.892995:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704565760 00000100:00100000:3.0:1789997806.893004:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704565760 00000100:00100000:3.0:1789997806.893079:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 563 00000100:00100000:3.0:1789997806.893091:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55413:x1876946704565760:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997806.893470:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55413:x1876946704565760:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 380us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997806.893477:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 563 00000100:00080000:0.0:1789997806.894060:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997806.895585:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997806.895915:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704565888 00000100:00100000:0.0:1789997806.895924:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704565888 00000100:00100000:0.0:1789997806.895992:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1061 00000100:00100000:0.0:1789997806.896002:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704565888:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997806.896587:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704565888:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 584us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997806.896596:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1061 00000100:00100000:3.0:1789997806.902070:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997806.902175:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704566016 00000100:00100000:0.0:1789997806.902186:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704566016 00000100:00100000:0.0:1789997806.902244:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1062 00000100:00100000:0.0:1789997806.902255:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704566016:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997806.902363:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704566016:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 110us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997806.902371:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1062 00000100:00100000:3.0:1789997806.906784:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997806.906964:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704566144 00000100:00100000:0.0:1789997806.906974:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704566144 00000100:00100000:0.0:1789997806.907028:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 564 00000100:00100000:0.0:1789997806.907040:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704566144:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997806.907447:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704566144:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 409us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997806.907456:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 564 00000100:00100000:1.0:1789997806.911819:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997806.911908:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704566272 00000100:00100000:2.0:1789997806.911919:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704566272 00000100:00100000:2.0:1789997806.911984:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 565 00000100:00100000:2.0:1789997806.911995:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55413:x1876946704566272:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997806.912433:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55413:x1876946704566272:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 438us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997806.912441:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 565 00000100:00100000:1.0:1789997806.920629:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997806.921929:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704566400 00000100:00100000:3.0:1789997806.921943:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704566400 00000100:00100000:3.0:1789997806.922025:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1063 00000100:00100000:3.0:1789997806.922037:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704566400:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997806.922485:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55413:x1876946704566400:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 449us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997806.922494:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1063 00000100:00100000:3.0:1789997806.983135:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997806.983342:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704566528 00000100:00100000:0.0:1789997806.983354:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704566528 00000100:00100000:0.0:1789997806.983420:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1064 00000100:00100000:0.0:1789997806.983431:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55417:x1876946704566528:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997806.983453:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997806.983476:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592dd1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf069 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.983543:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.983557:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.983571:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.983585:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.983593:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.983600:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984130:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dd33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984140:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984147:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997806.984170:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:0.0:1789997806.984175:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997806.984319:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984332:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984339:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984345:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984351:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997806.984355:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984363:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984376:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997806.984378:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997806.984383:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984389:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592dd25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984409:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984416:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984422:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984428:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997806.984432:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984437:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984445:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38c28e9500) 00010000:00010000:0.0:1789997806.984447:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997806.984450:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984455:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592dd2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984530:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592dd1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf069 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984550:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf069 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.984558:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997806.984560:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997806.984562:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997806.984957:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55417:x1876946704566528:12345-192.168.204.4@tcp:101:dd.0 Request processed in 1516us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997806.984965:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1064 00000100:00100000:1.0:1789997806.989607:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997806.989742:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704566784 00000100:00100000:0.0:1789997806.989753:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704566784 00000100:00100000:0.0:1789997806.989814:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1065 00000100:00100000:0.0:1789997806.989824:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55417:x1876946704566784:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997806.989846:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997806.989866:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592dd3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf070 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.990463:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.990481:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.990494:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.990509:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.990517:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.990524:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997806.991547:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:0.0:1789997806.991896:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592dd4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.991910:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592dd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.991925:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592dd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.991974:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.991981:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.992189:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.992198:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997806.992202:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.992210:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.992223:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997806.992226:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997806.992300:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.992308:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592dd41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997806.992325:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036523f81 reply state 00000000f1f7e65e transno 4294967704 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997806.992334:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997806.992374:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592dd3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf070 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.992399:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592dd4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf070 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.992406:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997806.992408:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997806.992411:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997806.992553:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:55417:x1876946704566784:12345-192.168.204.4@tcp:101:dd.0 Request processed in 2729us (2955us total) trans 4294967704 rc 0/0 00000100:00100000:0.0:1789997806.992561:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1065 00010000:00010000:0.0:1789997806.995639:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.995726:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.995735:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.995741:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997806.995746:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.995753:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.995768:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997806.995771:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997806.995776:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.995783:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592dd48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997806.999142:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997806.999352:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704566912 00000100:00100000:0.0:1789997806.999364:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704566912 00000100:00100000:0.0:1789997806.999425:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 566 00000100:00100000:0.0:1789997806.999438:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55417:x1876946704566912:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997806.999458:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997806.999478:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf077 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997806.999502:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789997806.999520:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=1995s v=(0 0) 00010000:00010000:0.0:1789997806.999525:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997806.999534:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.999552:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 7 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997806.999564:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789997806.999621:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55417:x1876946704566912:12345-192.168.204.4@tcp:101:dd.0 Request processed in 186us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997806.999629:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 566 00000100:00100000:1.0:1789997807.018904:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997807.024923:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704567040 00000100:00100000:3.0:1789997807.024940:0:6664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704567040 00002000:00100000:2.0:1789997807.025114:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x21:0x0] (0->1048575) req@ffff8a37c6064e00 x1876946704567040/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:28/0 lens 488/0 e 0 to 0 dl 1789997818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997807.025127:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c6064e00 with x1876946704567040 ext(0->1048575) 00002000:00010000:2.0:1789997807.025133:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c6064e00 00000100:00100000:2.0:1789997807.025168:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 26 00000100:00100000:2.0:1789997807.025298:0:6664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704567040:12345-192.168.204.4@tcp:4:dd.0 00000100:00100000:3.0:1789997807.051110:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713048960:0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.051310:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997807.051374:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789997807.051381:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713048832:0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.051407:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997807.051428:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713049344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.051448:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997807.051478:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713048960 00000100:00100000:3.0:1789997807.051485:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713048960 00000100:00100000:3.0:1789997807.051532:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713048832 00000100:00100000:3.0:1789997807.051535:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713048832 00000100:00100000:3.0:1789997807.051552:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713049344 00000100:00100000:3.0:1789997807.051566:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713049344 00000100:00100000:3.0:1789997807.051588:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1789997807.051604:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713048960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.051675:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713048960:12345-0@lo:400:kworker.0 Request processed in 53us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997807.051682:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1789997807.051700:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1789997807.051707:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713048832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997807.051897:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713049088:0@lo:400:kworker.0 00000100:00100000:1.0:1789997807.051933:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997807.051980:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789997807.051986:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713048704:0@lo:400:kworker.0 00000100:00100000:1.0:1789997807.052013:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997807.052034:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713049216:0@lo:400:kworker.0 00000100:00100000:1.0:1789997807.052054:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997807.052081:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713049088 00000100:00100000:1.0:1789997807.052085:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713049088 00000100:00100000:1.0:1789997807.052113:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713049216 00000100:00100000:1.0:1789997807.052116:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713049216 00000100:00100000:1.0:1789997807.052135:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1789997807.052142:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713049088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.052313:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713048832:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997807.052321:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1789997807.052339:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1789997807.052347:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713049344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.052381:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713049344:12345-0@lo:400:kworker.0 Request processed in 35us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997807.052387:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00080000:3.0:1789997807.052410:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997807.052414:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997807.052417:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997807.052447:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713048832:0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.052458:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713049344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.052467:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713048960:0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.052515:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1789997807.052524:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713049216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997807.052931:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713049216:12345-0@lo:400:kworker.0 Request processed in 406us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997807.052938:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1789997807.053066:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7410850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713049088:12345-0@lo:400:kworker.0 Request processed in 922us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997807.053073:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1789997807.053302:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713049216:0@lo:400:kworker.0 00000100:00100000:1.0:1789997807.053318:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713049088:0@lo:400:kworker.0 00000100:00100000:0.0:1789997807.053318:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713048704 00000100:00100000:0.0:1789997807.053327:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713048704 00000100:00100000:0.0:1789997807.053368:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1789997807.053377:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713048704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997807.053431:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713048704:12345-0@lo:400:kworker.0 Request processed in 56us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997807.053438:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1789997807.054502:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713048704:0@lo:400:kworker.0 00000001:00100000:0.0:1789997807.135380:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:2.0:1789997807.139959:0:6664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704567040:12345-192.168.204.4@tcp:4:dd.0 Request processed in 114757us (121039us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789997807.139974:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 26 00002000:00100000:2.0:1789997807.139990:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x21:0x0] (0->1048575) req@ffff8a37c6064e00 x1876946704567040/t4294967362(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:28/0 lens 488/448 e 0 to 0 dl 1789997818 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997807.140000:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a37c6064e00 with x1876946704567040 ext(0->1048575) 00002000:00010000:2.0:1789997807.140006:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a37c6064e00 00000100:00100000:1.0:1789997807.143985:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997807.144077:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704567168 00000100:00100000:3.0:1789997807.144087:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704567168 00000100:00100000:2.0:1789997807.145379:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1066 00000100:00100000:2.0:1789997807.145398:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:55417:x1876946704567168:12345-192.168.204.4@tcp:44:dd.0 00000100:00100000:3.0:1789997807.179694:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:55417:x1876946704567168:12345-192.168.204.4@tcp:44:dd.0 Request processed in 34292us (35707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997807.179708:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1066 00000001:00080000:0.0:1789997807.179785:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967704 is committed 00000100:00100000:3.0:1789997807.182170:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997807.182446:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704567296 00000100:00100000:2.0:1789997807.182457:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704567296 00000100:00100000:2.0:1789997807.182515:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 567 00000100:00100000:2.0:1789997807.182525:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704567296:12345-192.168.204.4@tcp:16:dd.0 00000001:00080000:0.0:1789997807.216738:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 00000100:00100000:3.0:1789997807.217004:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704567296:12345-192.168.204.4@tcp:16:dd.0 Request processed in 34474us (34839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997807.217017:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 567 00000100:00100000:2.0:1789997807.219735:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997807.219818:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704567552 00000100:00100000:3.0:1789997807.219827:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704567552 00000100:00100000:3.0:1789997807.219883:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 109 00000100:00100000:3.0:1789997807.219894:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55417:x1876946704567552:12345-192.168.204.4@tcp:35:dd.0 00000001:00080000:3.0:1789997807.220427:0:5814:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967705 00000100:00100000:3.0:1789997807.220650:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:55417:x1876946704567552:12345-192.168.204.4@tcp:35:dd.0 Request processed in 757us (922us total) trans 4294967706 rc 0/0 00000100:00100000:3.0:1789997807.220691:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 109 00000020:00080000:3.0:1789997807.220697:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789997807.373246:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997808.229009:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967706 is committed 00010000:00010000:3.0:1789997808.394764:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997808.919437:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997808.920352:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704567680 00000100:00100000:3.0:1789997808.920363:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704567680 00000100:00100000:3.0:1789997808.920424:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1186 00000100:00100000:3.0:1789997808.920435:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704567680:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997808.921413:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704567680:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 974us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997808.921423:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1186 00000100:00100000:2.0:1789997808.926087:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997808.926145:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997808.926176:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997808.926208:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704568064 00000100:00100000:2.0:1789997808.926218:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704568064 00000100:00100000:2.0:1789997808.926338:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704567936 00000100:00100000:3.0:1789997808.926342:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704567808 00000100:00100000:2.0:1789997808.926342:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704567936 00000100:00100000:3.0:1789997808.926345:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704567808 00000100:00100000:2.0:1789997808.926371:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 988 00000100:00100000:3.0:1789997808.926373:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1464 00000100:00100000:3.0:1789997808.926380:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704567808:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997808.926380:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704568064:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997808.926439:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 989 00000100:00100000:0.0:1789997808.926451:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704567936:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997808.926532:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704568064:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 152us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997808.926539:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 988 00000100:00080000:2.0:1789997808.926561:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997808.926566:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997808.926567:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997808.931103:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704567808:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 4708us (5012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997808.931103:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704567936:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 4639us (4910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997808.931127:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1464 00000100:00100000:0.0:1789997808.931127:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 989 00000100:00100000:0.0:1789997809.099124:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713049472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997809.099202:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997809.099309:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713049472 00000100:00100000:2.0:1789997809.099317:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713049472 00000100:00100000:2.0:1789997809.099381:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:2.0:1789997809.099391:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713049472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997809.099428:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00080000:3.0:1789997809.099519:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997809.100101:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713049472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 708us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997809.100110:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:0.0:1789997809.100188:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713049472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997809.100345:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713049600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997809.100381:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997809.100447:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713049600 00000100:00100000:0.0:1789997809.100453:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713049600 00000100:00100000:0.0:1789997809.100491:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1789997809.100498:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713049600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997809.100522:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997809.100591:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997809.101932:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713049600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1430us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997809.101944:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1789997809.102153:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713049600:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789997809.154397:0:94681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1997846739956ns, next at 1948251401232ns, rc = 0 00000004:00080000:2.0:1789997809.154555:0:94681:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1997846900484ns, next at 1983451569209ns, rc = 0 00000004:00080000:1.0:1789997809.157419:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00000004:00080000:1.0:1789997809.157450:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 92 committed 00010000:00010000:3.0:1789997809.418858:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997810.203490:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997810.203594:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704568192 00000100:00100000:2.0:1789997810.203604:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704568192 00000100:00080000:3.0:1789997810.203719:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997810.203897:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1067 00000100:00100000:2.0:1789997810.203911:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55610:x1876946704568192:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997810.204010:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55610:x1876946704568192:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 103us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997810.204017:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1067 00000100:00100000:2.0:1789997810.205927:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997810.206063:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704568320 00000100:00100000:3.0:1789997810.206073:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704568320 00000100:00100000:3.0:1789997810.206139:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 568 00000100:00100000:3.0:1789997810.206149:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55610:x1876946704568320:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997810.206499:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55610:x1876946704568320:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 351us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997810.206511:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 568 00000100:00080000:2.0:1789997810.207023:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997810.208126:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997810.208298:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704568448 00000100:00100000:2.0:1789997810.208305:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704568448 00000100:00100000:2.0:1789997810.208359:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 569 00000100:00100000:2.0:1789997810.208369:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55610:x1876946704568448:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997810.208696:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55610:x1876946704568448:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 327us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997810.208703:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 569 00000100:00080000:3.0:1789997810.209350:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997810.211032:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997810.211308:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704568576 00000100:00100000:0.0:1789997810.211319:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704568576 00000100:00100000:0.0:1789997810.211405:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1068 00000100:00100000:0.0:1789997810.211415:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55610:x1876946704568576:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997810.211816:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55610:x1876946704568576:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 401us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997810.211824:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1068 00000100:00100000:2.0:1789997810.214480:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997810.214634:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704568704 00000100:00100000:3.0:1789997810.214643:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704568704 00000100:00100000:3.0:1789997810.214853:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1069 00000100:00100000:3.0:1789997810.214867:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55610:x1876946704568704:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997810.214974:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55610:x1876946704568704:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 109us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997810.214981:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1069 00000100:00100000:3.0:1789997810.220476:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997810.220613:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704568832 00000100:00100000:0.0:1789997810.220624:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704568832 00000100:00100000:0.0:1789997810.220691:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 570 00000100:00100000:0.0:1789997810.220701:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55610:x1876946704568832:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997810.221333:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55610:x1876946704568832:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 631us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997810.221342:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 570 00000100:00100000:0.0:1789997810.224177:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997810.224291:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704568960 00000100:00100000:3.0:1789997810.224304:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704568960 00000100:00100000:3.0:1789997810.224353:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 571 00000100:00100000:3.0:1789997810.224363:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55610:x1876946704568960:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997810.224968:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55610:x1876946704568960:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 604us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997810.224976:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 571 00000100:00100000:3.0:1789997810.227302:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997810.227409:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704569088 00000100:00100000:0.0:1789997810.227420:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704569088 00000100:00100000:0.0:1789997810.227485:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1070 00000100:00100000:0.0:1789997810.227495:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55610:x1876946704569088:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997810.228325:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55610:x1876946704569088:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 828us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997810.228334:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1070 00000100:00100000:0.0:1789997810.287941:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997810.288020:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704569344 00000100:00100000:3.0:1789997810.288031:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704569344 00000100:00100000:3.0:1789997810.288093:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1071 00000100:00100000:3.0:1789997810.288104:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:55614:x1876946704569344:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997810.288422:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997810.288452:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592dd4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf070 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.288478:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:3.0:1789997810.288489:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997810.288511:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.288524:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.288533:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.288545:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.288551:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.288557:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.289477:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.289490:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.289498:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997810.290568:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].33, 64 off10304 00000004:00080000:3.0:1789997810.290580:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1998982925807ns, next at 1999982923335ns, rc = 0 00010000:00010000:3.0:1789997810.291366:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291384:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291395:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291404:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291410:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291415:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291432:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997810.291455:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291462:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291467:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291473:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997810.291477:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291488:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291499:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997810.291502:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997810.291508:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291513:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dd72 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291531:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291537:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291543:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291549:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997810.291551:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291558:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291565:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:3.0:1789997810.291568:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997810.291571:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.291581:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592dd64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997810.291591:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb711659 reply state 000000009346bd5f transno 4294967707 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997810.291601:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997810.291718:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:55614:x1876946704569344:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3612us (3782us total) trans 4294967707 rc 0/0 00000100:00100000:3.0:1789997810.291727:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1071 00010000:00010000:0.0:1789997810.291849:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997810.291856:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997810.291863:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997810.291866:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997810.291873:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997810.291882:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:0.0:1789997810.291894:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997810.291897:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997810.291903:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592dd79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997810.291916:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997810.291918:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997810.291919:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997810.295070:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997810.295093:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997810.295101:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997810.295107:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997810.295112:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997810.295121:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997810.295140:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38ee49e100) 00010000:00010000:2.0:1789997810.295143:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997810.295148:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997810.295154:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592dd6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997810.443629:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997811.466916:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997811.859503:0:94826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2000551846113ns, next at 1999982923335ns, rc = 0 00000004:00080000:1.0:1789997811.897317:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00000001:00080000:1.0:1789997811.897354:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967707 is committed 00000004:00080000:1.0:1789997811.897359:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 93 committed 00000100:00100000:3.0:1789997811.897739:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997811.897759:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713049728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789997811.897828:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997811.897911:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713049728 00000100:00100000:3.0:1789997811.897920:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713049728 00000100:00100000:3.0:1789997811.898053:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:3.0:1789997811.898064:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713049728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789997811.898103:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:33 count 1 00010000:00010000:3.0:1789997811.898130:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997811.898151:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997811.898160:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1789997811.898166:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997811.898172:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997811.898202:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997811.898216:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 5 pid: 6658 timeout: 2100 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997811.898228:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946713049856:192.168.204.4@tcp:104: 00000100:00100000:3.0:1789997811.898285:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3581300 going to sleep for 11 seconds 00000100:00080000:3.0:1789997811.898297:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997811.906268:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946713049856:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997811.906300:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997811.913024:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997811.913137:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704569472 00000100:00100000:1.0:1789997811.913148:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704569472 00010000:00010000:1.0:1789997811.913189:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 6 pid: 6658 timeout: 2100 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997811.913241:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 418 00000100:00100000:1.0:1789997811.913252:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704569472:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997811.913269:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997811.913275:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 6 pid: 6658 timeout: 2100 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997811.913290:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 6 pid: 6658 timeout: 2100 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997811.913317:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592dd5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf077 expref: 6 pid: 6658 timeout: 2100 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997811.913345:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997811.913350:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997811.913355:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997811.913367:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997811.913396:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997811.913462:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704569472:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 211us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997811.913470:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 418 00010000:00010000:3.0:1789997811.913583:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997811.913593:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997811.913603:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997811.913616:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997811.913641:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789997811.914391:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713049728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16327us (16560us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789997811.914400:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000004:00080000:3.0:1789997811.914450:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c774dc00/2, rc 0, transno 4294967363 00000100:00100000:3.0:1789997811.914461:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713049728:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789997811.914909:0:94826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2000607254201ns, next at 1983451569209ns, rc = 0 00010000:00010000:2.0:1789997811.915566:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997811.915575:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997811.915586:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997811.915590:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997811.915604:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997811.915623:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997811.915630:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000915dbfe5/0x65b43101d592dd80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997811.915647:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997811.915649:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997811.915683:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997811.920748:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000100:00100000:2.0:1789997812.171027:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713049984:0@lo:400:kworker.0 00000100:00100000:2.0:1789997812.171136:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997812.171276:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713049984 00000100:00100000:1.0:1789997812.171285:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713049984 00000100:00100000:1.0:1789997812.171335:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1789997812.171346:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713049984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997812.171421:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713050112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997812.171456:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997812.171494:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713050112 00000100:00100000:0.0:1789997812.171498:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713050112 00000100:00100000:0.0:1789997812.171528:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1789997812.171534:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713050112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997812.171570:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713050112:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997812.171579:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1789997812.171623:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713050112:0@lo:400:kworker.0 00000100:00100000:0.0:1789997812.171714:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713050240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997812.171745:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713050368:0@lo:400:kworker.0 00000100:00100000:0.0:1789997812.171745:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997812.171782:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997812.171825:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713050368 00000100:00100000:3.0:1789997812.171829:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713050368 00000100:00100000:3.0:1789997812.171879:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1789997812.171887:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713050368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997812.171935:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713050368:12345-0@lo:400:kworker.0 Request processed in 49us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997812.171941:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00080000:3.0:1789997812.172057:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997812.172230:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713050368:0@lo:400:kworker.0 00000100:00100000:3.0:1789997812.172258:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997812.172266:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713050496:0@lo:400:kworker.0 00000100:00100000:2.0:1789997812.172423:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713049984:0@lo:400:kworker.0 00000100:00100000:3.0:1789997812.172474:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713050240 00000100:00100000:3.0:1789997812.172478:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713050240 00000100:00100000:3.0:1789997812.172508:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:3.0:1789997812.172514:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713050240:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789997812.172554:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997812.173425:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713049984:12345-0@lo:400:kworker.0 Request processed in 2077us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997812.173436:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1789997812.174557:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997812.174736:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713050240:12345-0@lo:400:kworker.0 Request processed in 2220us (2990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997812.174748:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:3.0:1789997812.174773:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713050496 00000100:00100000:3.0:1789997812.174781:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713050496 00000100:00100000:0.0:1789997812.174889:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713050240:0@lo:400:kworker.0 00000100:00100000:3.0:1789997812.174972:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1789997812.174981:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713050496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997812.175028:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713050496:12345-0@lo:400:kworker.0 Request processed in 49us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997812.175034:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1789997812.175071:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713050496:0@lo:400:kworker.0 00000100:00080000:2.0:1789997812.175398:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789997812.490771:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997813.514847:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997814.040600:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997814.040693:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997814.040729:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997814.040766:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704569600 00000100:00100000:1.0:1789997814.040779:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997814.040780:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704569600 00000100:00100000:0.0:1789997814.040805:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704569728 00000100:00100000:0.0:1789997814.040824:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704569728 00000100:00100000:3.0:1789997814.040869:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1188 00000100:00100000:3.0:1789997814.040885:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704569600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997814.040894:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1468 00000100:00100000:0.0:1789997814.040904:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704569728:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997814.040973:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704569728:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997814.040980:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704569600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 97us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997814.040987:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1468 00000100:00100000:3.0:1789997814.040994:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1188 00000100:00080000:0.0:1789997814.041026:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997814.041048:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704569856 00000100:00100000:3.0:1789997814.041053:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704569856 00000100:00100000:3.0:1789997814.041089:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704569984 00000100:00100000:3.0:1789997814.041093:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704569984 00000100:00080000:0.0:1789997814.041107:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997814.041111:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997814.041122:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 991 00000100:00100000:3.0:1789997814.041133:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704569856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997814.041172:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 992 00000100:00100000:3.0:1789997814.041174:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704569856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997814.041185:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704569984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997814.041213:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704569984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997814.042609:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 991 00000100:00100000:1.0:1789997814.043221:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 992 00000100:00100000:2.0:1789997814.218970:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997814.218995:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713050624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997814.219199:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713050752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997814.219260:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997814.219334:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713050752 00000100:00100000:0.0:1789997814.219342:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713050752 00000100:00100000:0.0:1789997814.219398:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1789997814.219407:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713050752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997814.219456:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789997814.219505:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713050752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997814.219512:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00080000:0.0:1789997814.219533:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997814.219566:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713050752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997814.219678:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997814.220003:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713050624 00000100:00100000:0.0:1789997814.220008:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713050624 00000100:00100000:0.0:1789997814.221681:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1789997814.221693:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713050624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997814.221725:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997814.221794:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713050624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997814.221801:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1789997814.221892:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713050624:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789997814.222387:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997814.539843:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997815.309538:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00010000:00010000:3.0:1789997815.562993:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997816.586805:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997817.291786:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713051136:0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.291856:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997817.291916:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789997817.291922:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713051008:0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.291944:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997817.291973:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713051520:0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.291992:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997817.292017:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713051136 00000100:00100000:0.0:1789997817.292023:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713051136 00000100:00100000:0.0:1789997817.292069:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713051008 00000100:00100000:0.0:1789997817.292073:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713051008 00000100:00100000:0.0:1789997817.292088:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713051520 00000100:00100000:0.0:1789997817.292091:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713051520 00000100:00100000:0.0:1789997817.292112:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1789997817.292119:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713051136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.292167:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713051136:12345-0@lo:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997817.292174:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1789997817.292190:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1789997817.292196:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713051008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.292218:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713051008:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997817.292223:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1789997817.292233:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1789997817.292238:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713051520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.292261:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713051520:12345-0@lo:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997817.292266:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1789997817.292309:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713051008:0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.292320:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713051520:0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.292327:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713051136:0@lo:400:kworker.0 00000100:00100000:3.0:1789997817.292408:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713050880:0@lo:400:kworker.0 00000100:00100000:3.0:1789997817.292441:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997817.292473:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713051392:0@lo:400:kworker.0 00000100:00100000:3.0:1789997817.292496:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997817.292518:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997817.292523:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713051264:0@lo:400:kworker.0 00000100:00100000:3.0:1789997817.292543:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997817.292569:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713051392 00000100:00100000:3.0:1789997817.292572:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713051392 00000100:00100000:3.0:1789997817.292598:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1789997817.292605:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713051392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997817.292638:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713051392:12345-0@lo:400:kworker.0 Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997817.292644:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1789997817.292673:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713051264 00000100:00100000:3.0:1789997817.292677:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713051264 00000100:00100000:3.0:1789997817.292696:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1789997817.292701:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713051264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997817.292734:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713051264:12345-0@lo:400:kworker.0 Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997817.292740:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1789997817.292778:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:3.0:1789997817.292784:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c774dc00, transno 4294967363 00000100:00100000:3.0:1789997817.292793:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713051264:0@lo:400:kworker.0 00000100:00100000:3.0:1789997817.292803:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713051392:0@lo:400:kworker.0 00000100:00080000:2.0:1789997817.292882:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997817.292887:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997817.292889:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997817.294260:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713050880 00000100:00100000:0.0:1789997817.294270:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713050880 00000100:00100000:0.0:1789997817.294321:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1789997817.294330:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713050880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997817.294604:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713050880:12345-0@lo:400:kworker.0 Request processed in 275us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997817.294611:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1789997817.296089:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713050880:0@lo:400:kworker.0 00010000:00010000:0.0:1789997817.610842:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997818.635363:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997819.160420:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997819.160473:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997819.160512:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997819.160545:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997819.160579:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704570496 00000100:00100000:0.0:1789997819.160589:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704570496 00000100:00100000:0.0:1789997819.160641:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704570368 00000100:00100000:0.0:1789997819.160644:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704570368 00000100:00100000:0.0:1789997819.160698:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 995 00000100:00100000:0.0:1789997819.160708:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704570496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997819.160782:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704570112 00000100:00100000:1.0:1789997819.160787:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704570112 00000100:00100000:0.0:1789997819.160789:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704570496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 83us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997819.160796:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 995 00000100:00100000:0.0:1789997819.160814:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 996 00000100:00100000:1.0:1789997819.160816:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1190 00000100:00100000:0.0:1789997819.160820:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704570368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997819.160821:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704570112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997819.160844:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704570368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997819.160850:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 996 00000100:00100000:1.0:1789997819.161203:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704570112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 380us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997819.161211:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1190 00000100:00100000:2.0:1789997819.162024:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704570240 00000100:00100000:2.0:1789997819.162032:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704570240 00000100:00100000:2.0:1789997819.162080:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1472 00000100:00100000:2.0:1789997819.162089:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704570240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997819.162140:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704570240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 53us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997819.162146:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1472 00000100:00080000:2.0:1789997819.162164:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997819.162169:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997819.162171:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997819.338866:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997819.339095:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997819.339114:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713051776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997819.339193:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997819.339261:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713051776 00000100:00100000:2.0:1789997819.339268:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713051776 00000100:00080000:1.0:1789997819.339324:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997819.339334:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1789997819.339344:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713051776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997819.339379:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997819.339454:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713051776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997819.339462:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1789997819.339571:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713051776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997819.339788:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713051648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997819.339821:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997819.339979:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713051648 00000100:00100000:1.0:1789997819.339984:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713051648 00000100:00100000:1.0:1789997819.340072:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:1.0:1789997819.340080:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713051648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997819.340101:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997819.340148:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713051648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997819.340154:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1789997819.340265:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713051648:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789997819.340353:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789997819.658811:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997820.682889:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997821.706937:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997822.411300:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713051904:0@lo:400:kworker.0 00000100:00100000:1.0:1789997822.411397:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997822.411509:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713051904 00000100:00100000:1.0:1789997822.411517:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713051904 00000100:00100000:1.0:1789997822.411560:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1789997822.411570:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713051904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997822.411615:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713051904:12345-0@lo:400:kworker.0 Request processed in 47us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997822.411622:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1789997822.411714:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713051904:0@lo:400:kworker.0 00000100:00100000:1.0:1789997822.412363:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713052160:0@lo:400:kworker.0 00000100:00100000:1.0:1789997822.412398:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997822.412520:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713052288:0@lo:400:kworker.0 00000100:00100000:3.0:1789997822.412551:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997822.412573:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997822.412578:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713052416:0@lo:400:kworker.0 00000100:00100000:3.0:1789997822.412596:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997822.412599:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713052160 00000100:00100000:0.0:1789997822.412606:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713052160 00000100:00100000:3.0:1789997822.412696:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:3.0:1789997822.412705:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713052160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997822.412717:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713052288 00000100:00100000:0.0:1789997822.412723:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713052288 00000100:00100000:3.0:1789997822.412743:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713052160:12345-0@lo:400:kworker.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997822.412750:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1789997822.412770:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713052416 00000100:00100000:0.0:1789997822.412775:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713052416 00000100:00100000:1.0:1789997822.412785:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789997822.412803:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1789997822.412827:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713052288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997822.412875:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713052288:12345-0@lo:400:kworker.0 Request processed in 65us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997822.412886:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1789997822.412902:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1789997822.412910:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713052416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997822.412940:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713052416:12345-0@lo:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997822.412946:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1789997822.412966:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713052032:0@lo:400:kworker.0 00000100:00100000:1.0:1789997822.413003:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997822.413030:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713052544:0@lo:400:kworker.0 00000100:00100000:0.0:1789997822.413043:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713052032 00000100:00100000:0.0:1789997822.413049:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713052032 00000100:00100000:1.0:1789997822.413065:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997822.413069:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713052416:0@lo:400:kworker.0 00000100:00100000:0.0:1789997822.413078:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713052544 00000100:00100000:0.0:1789997822.413083:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713052544 00000100:00100000:3.0:1789997822.413086:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713052288:0@lo:400:kworker.0 00000100:00100000:1.0:1789997822.413105:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713052160:0@lo:400:kworker.0 00000100:00100000:0.0:1789997822.413123:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1789997822.413131:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713052032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997822.413143:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:1.0:1789997822.413154:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713052544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997822.413174:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713052032:12345-0@lo:400:kworker.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997822.413181:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:0.0:1789997822.413222:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713052032:0@lo:400:kworker.0 00000100:00100000:1.0:1789997822.413352:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713052544:12345-0@lo:400:kworker.0 Request processed in 200us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997822.413359:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00080000:1.0:1789997822.413406:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997822.413410:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997822.413413:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997822.413638:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713052544:0@lo:400:kworker.0 00010000:00010000:3.0:1789997822.733264:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997823.754877:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997824.278411:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997824.278456:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997824.278493:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704570624 00000100:00100000:3.0:1789997824.278504:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704570624 00000100:00100000:3.0:1789997824.278622:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1192 00000100:00100000:3.0:1789997824.278634:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704570624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997824.278747:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704570624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 115us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997824.278755:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1192 00000100:00100000:0.0:1789997824.279898:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997824.279957:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997824.279967:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704570752 00000100:00100000:2.0:1789997824.279976:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704570752 00000100:00080000:3.0:1789997824.280120:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997824.280175:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1476 00000100:00100000:2.0:1789997824.280185:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704570752:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997824.280261:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704570752:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997824.280269:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1476 00000100:00100000:1.0:1789997824.281915:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704570880 00000100:00100000:1.0:1789997824.281927:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704570880 00000100:00100000:2.0:1789997824.281961:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704571008 00000100:00100000:2.0:1789997824.281968:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704571008 00000100:00080000:3.0:1789997824.282145:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997824.282149:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997824.282805:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 999 00000100:00100000:1.0:1789997824.282822:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704570880:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997824.282852:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1000 00000100:00100000:2.0:1789997824.282867:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704571008:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997824.282899:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704570880:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (4441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997824.282907:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 999 00000100:00100000:2.0:1789997824.282912:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704571008:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997824.282923:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1000 00000100:00100000:2.0:1789997824.459024:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997824.459048:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713052672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997824.459117:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997824.459518:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713052672 00000100:00100000:3.0:1789997824.459527:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713052672 00000100:00080000:2.0:1789997824.459587:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997824.459592:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1789997824.459602:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713052672:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997824.459913:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997824.459926:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713052800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997824.459963:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997824.460154:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713052800 00000100:00100000:0.0:1789997824.460159:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713052800 00000100:00100000:0.0:1789997824.460201:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1789997824.460208:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713052800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997824.460230:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997824.460279:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713052800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997824.460286:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:0.0:1789997824.460335:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713052800:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997824.460400:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997824.460440:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713052672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 840us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997824.460446:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00080000:1.0:1789997824.460817:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997824.460884:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713052672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997824.778788:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997825.802838:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997826.827158:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997827.531092:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713052928:0@lo:400:kworker.0 00000100:00100000:3.0:1789997827.531169:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713053056:0@lo:400:kworker.0 00000100:00100000:0.0:1789997827.531178:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997827.531242:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713053440:0@lo:400:kworker.0 00000100:00100000:2.0:1789997827.531589:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713053184:0@lo:400:kworker.0 00000100:00100000:1.0:1789997827.531687:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713053312:0@lo:400:kworker.0 00000100:00100000:0.0:1789997827.532211:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997827.532252:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713053440 00000100:00100000:0.0:1789997827.532261:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713053440 00000100:00100000:2.0:1789997827.532381:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997827.532416:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713052928 00000100:00100000:2.0:1789997827.532420:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713052928 00000100:00100000:2.0:1789997827.532461:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1789997827.532471:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713052928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997827.532523:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713052928:12345-0@lo:400:kworker.0 Request processed in 53us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997827.532530:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:2.0:1789997827.532581:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713053184 00000100:00100000:2.0:1789997827.532585:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713053184 00000100:00100000:2.0:1789997827.532616:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1789997827.532624:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713053184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997827.532682:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713053184:12345-0@lo:400:kworker.0 Request processed in 59us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997827.532688:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1789997827.532731:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713053184:0@lo:400:kworker.0 00000100:00080000:2.0:1789997827.532789:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997827.533071:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1789997827.533078:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997827.533133:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713053440:12345-0@lo:400:kworker.0 Request processed in 52us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997827.533140:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00080000:0.0:1789997827.533160:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997827.533185:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713053440:0@lo:400:kworker.0 00000100:00100000:0.0:1789997827.533197:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713052928:0@lo:400:kworker.0 00000100:00100000:1.0:1789997827.533227:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997827.533256:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713053312 00000100:00100000:0.0:1789997827.533261:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713053312 00000100:00100000:3.0:1789997827.533282:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997827.533316:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713053568:0@lo:400:kworker.0 00000100:00100000:1.0:1789997827.533332:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713053056 00000100:00100000:1.0:1789997827.533338:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713053056 00000100:00100000:3.0:1789997827.533348:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997827.533447:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1789997827.533454:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713053312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997827.533507:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713053312:12345-0@lo:400:kworker.0 Request processed in 53us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997827.533514:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00080000:0.0:1789997827.533536:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997827.533618:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713053568 00000100:00100000:1.0:1789997827.533622:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713053568 00000100:00080000:2.0:1789997827.533710:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997827.534918:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713053312:0@lo:400:kworker.0 00000100:00100000:1.0:1789997827.535242:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:1.0:1789997827.535255:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713053056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997827.535331:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713053056:12345-0@lo:400:kworker.0 Request processed in 80us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997827.535338:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1789997827.535354:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:3.0:1789997827.535378:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713053568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997827.535395:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713053056:0@lo:400:kworker.0 00000100:00100000:3.0:1789997827.535427:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713053568:12345-0@lo:400:kworker.0 Request processed in 55us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997827.535432:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713053568:0@lo:400:kworker.0 00000100:00100000:3.0:1789997827.535438:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00010000:00010000:3.0:1789997827.850806:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997828.438675:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997828.439395:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704571136 00000100:00100000:0.0:1789997828.439407:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704571136 00000100:00100000:0.0:1789997828.439577:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1072 00000100:00100000:0.0:1789997828.439589:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55873:x1876946704571136:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997828.439907:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55873:x1876946704571136:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 320us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997828.439916:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1072 00000100:00080000:2.0:1789997828.440524:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997828.443698:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997828.444008:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704571264 00000100:00100000:0.0:1789997828.444019:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704571264 00000100:00100000:0.0:1789997828.444160:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 573 00000100:00100000:0.0:1789997828.444172:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55873:x1876946704571264:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:2.0:1789997828.444370:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997828.445972:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55873:x1876946704571264:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1797us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997828.445983:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 573 00000100:00100000:3.0:1789997828.449235:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997828.449869:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704571392 00000100:00100000:0.0:1789997828.449879:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704571392 00000100:00100000:0.0:1789997828.449997:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 574 00000100:00100000:0.0:1789997828.450007:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55873:x1876946704571392:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997828.450353:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55873:x1876946704571392:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 346us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997828.450361:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 574 00000100:00080000:2.0:1789997828.452635:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997828.452999:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997828.453120:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704571520 00000100:00100000:1.0:1789997828.453129:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704571520 00000100:00100000:1.0:1789997828.453223:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1073 00000100:00100000:1.0:1789997828.453233:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55873:x1876946704571520:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997828.453703:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55873:x1876946704571520:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 470us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997828.453710:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1073 00000100:00100000:1.0:1789997828.457301:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997828.460123:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704571648 00000100:00100000:0.0:1789997828.460139:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704571648 00000100:00100000:0.0:1789997828.460275:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1074 00000100:00100000:0.0:1789997828.460286:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55873:x1876946704571648:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997828.460404:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55873:x1876946704571648:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 120us (3112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997828.460412:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1074 00000100:00100000:0.0:1789997828.466495:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997828.466843:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704571776 00000100:00100000:1.0:1789997828.466854:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704571776 00000100:00100000:1.0:1789997828.466955:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 575 00000100:00100000:1.0:1789997828.466966:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55873:x1876946704571776:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997828.467503:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55873:x1876946704571776:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 538us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997828.467511:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 575 00000100:00100000:3.0:1789997828.470938:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997828.471283:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704571904 00000100:00100000:0.0:1789997828.471293:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704571904 00000100:00100000:0.0:1789997828.471414:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 576 00000100:00100000:0.0:1789997828.471424:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55873:x1876946704571904:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997828.472774:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55873:x1876946704571904:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1327us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997828.472785:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 576 00000100:00100000:2.0:1789997828.480425:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997828.480544:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704572032 00000100:00100000:1.0:1789997828.480556:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704572032 00000100:00100000:1.0:1789997828.481693:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1075 00000100:00100000:1.0:1789997828.481707:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55873:x1876946704572032:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997828.482202:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55873:x1876946704572032:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 497us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997828.482210:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1075 00010000:00010000:1.0:1789997828.877040:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997829.398827:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997829.398871:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997829.398905:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997829.398940:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997829.398950:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704572160 00000100:00100000:2.0:1789997829.398961:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704572160 00000100:00100000:3.0:1789997829.398967:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704572288 00000100:00100000:3.0:1789997829.398971:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704572288 00000100:00100000:3.0:1789997829.399010:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1480 00000100:00100000:2.0:1789997829.399011:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1194 00000100:00100000:3.0:1789997829.399021:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704572288:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997829.399021:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704572160:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997829.399119:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704572416 00000100:00100000:1.0:1789997829.399124:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704572416 00000100:00100000:1.0:1789997829.399154:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704572544 00000100:00100000:1.0:1789997829.399156:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704572544 00000100:00100000:1.0:1789997829.399176:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1003 00000100:00100000:1.0:1789997829.399183:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704572416:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997829.399245:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704572288:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 225us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997829.399254:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1480 00000100:00100000:2.0:1789997829.399550:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704572160:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 529us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997829.399633:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1194 00000100:00100000:0.0:1789997829.400857:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1004 00000100:00100000:0.0:1789997829.400872:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704572544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997829.401569:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704572544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 59us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997829.401649:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1004 00000100:00100000:1.0:1789997829.403310:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704572416:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 4117us (4428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997829.403323:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1003 00000100:00100000:0.0:1789997829.579113:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713053696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997829.579185:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997829.579279:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713053696 00000100:00100000:0.0:1789997829.579286:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713053696 00000100:00100000:0.0:1789997829.579343:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1789997829.579352:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713053696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997829.579390:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997829.579439:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713053696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997829.579446:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00080000:0.0:1789997829.579470:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997829.579522:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713053696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997829.579624:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997829.579635:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713053824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997829.579718:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997829.580005:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713053824 00000100:00100000:3.0:1789997829.580010:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713053824 00000100:00100000:3.0:1789997829.580055:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1789997829.580062:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713053824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997829.580082:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997829.580121:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713053824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997829.580127:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1789997829.580155:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713053824:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997829.581000:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997829.899046:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997830.175081:0:95142:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbfb256b0 20000000:00000080:0.0:1789997830.175099:0:95142:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa4400 uarg=0000000000000000 00010000:00010000:0.0:1789997830.176852:0:95142:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789997830.176893:0:95142:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997830.176897:0:95142:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997830.176908:0:95142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592dd33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf069 expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997830.176933:0:95142:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1789997830.176951:0:95142:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997830.176964:0:95142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997830.176991:0:95142:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dd09 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997830.176999:0:95142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997830.177041:0:95142:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dd09 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997830.177057:0:95142:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dd09 expref: 18 pid: 5805 timeout: 2118 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997830.177073:0:95142:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95142:1876946713053952:0@lo:104: 00000100:00100000:0.0:1789997830.177225:0:95142:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997830.177407:0:95142:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa55a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789997830.178564:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789997830.178587:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713053952 00000100:00100000:2.0:1789997830.178594:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713053952 00000100:00100000:2.0:1789997830.178674:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789997830.178686:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c63e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:95142:x1876946713053952:12345-0@lo:104: 00010000:00010000:2.0:1789997830.178702:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.178784:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997830.178791:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c63e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:95142:x1876946713053952:12345-0@lo:104: Request processed in 108us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997830.178798:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00010000:00010000:3.0:1789997830.178825:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997830.178836:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997830.178847:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997830.178852:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997830.178864:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997830.178872:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997830.178883:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1789997830.179079:0:95142:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f57800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95142:1876946713053952:0@lo:104: 00010000:00010000:1.0:1789997830.179178:0:95142:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.179461:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.179469:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789997830.179532:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713054080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997830.179576:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789997830.179650:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997830.179680:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713054080 00000100:00100000:3.0:1789997830.179686:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713054080 00010000:00010000:2.0:1789997830.179696:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592dd09 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dd10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997830.179714:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dd09 expref: 19 pid: 5805 timeout: 2118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.179715:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997830.179719:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997830.179722:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997830.179750:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789997830.179759:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713054080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997830.179770:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997830.179776:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dd09 expref: 19 pid: 5805 timeout: 2118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997830.179788:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dd09 expref: 19 pid: 5805 timeout: 2118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997830.179803:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592dd10 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dd09 expref: 19 pid: 5805 timeout: 2118 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997830.179818:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997830.179827:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.181210:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.181225:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.181232:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.181239:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.181249:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997830.181254:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.181261:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.181276:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997830.181288:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997830.181361:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713054080:12345-0@lo:103:ldlm_bl.0 Request processed in 1602us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997830.181371:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789997830.181457:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713054080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997830.181740:0:95142:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997830.181749:0:95142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997830.181755:0:95142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dd87 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997830.926078:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997831.306749:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997831.306757:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997831.306763:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997831.306817:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997831.306830:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997831.306843:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997831.306868:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713054208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997831.306946:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997831.307007:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997831.307079:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713054208 00000100:00100000:2.0:1789997831.307088:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713054208 00000100:00100000:2.0:1789997831.307200:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1789997831.307213:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713054208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997831.307230:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997831.307244:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dd8e expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997831.307269:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dd8e expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997831.307281:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dd8e expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997831.307291:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997831.307345:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713054208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997831.307352:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1789997831.307433:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713054208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997831.307448:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997831.307457:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997831.307496:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997831.307501:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997831.307509:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997831.954680:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997832.427536:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997832.427710:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704572672 00000100:00100000:2.0:1789997832.427722:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704572672 00000100:00100000:2.0:1789997832.427800:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1076 00000100:00100000:2.0:1789997832.427811:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:55959:x1876946704572672:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997832.427832:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997832.427855:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592dd9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf07e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997832.427925:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592dda3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997832.427939:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997832.427954:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997832.427992:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:2.0:1789997832.427996:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997832.428016:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592dda3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997832.428042:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592dd9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf07e expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997832.428064:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592dda3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf07e expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997832.428073:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:2.0:1789997832.428077:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997832.428081:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997832.428161:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55959:x1876946704572672:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 351us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997832.428168:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1076 00000100:00080000:0.0:1789997832.428547:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997832.436930:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997832.449213:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704572928 00000100:00100000:0.0:1789997832.449226:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704572928 00000100:00100000:0.0:1789997832.449303:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1077 00000100:00100000:0.0:1789997832.449314:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55959:x1876946704572928:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997832.449365:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997832.449392:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592dda3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf07e expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.449407:0:5812:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592dd33) 00010000:00010000:0.0:1789997832.449411:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf500) 00010000:00010000:0.0:1789997832.449423:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997832.449449:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.449476:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.449486:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789997832.511333:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967708 is committed 00000004:00010000:1.0:1789997832.511400:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062c48a08 reply state 00000000ed89a1e5 transno 4294967708 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997832.511415:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997832.511430:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00080000:1.0:1789997832.511674:0:5812:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789997832.511708:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:55959:x1876946704572928:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 62391us (74786us total) trans 4294967708 rc 0/0 00000100:00100000:1.0:1789997832.511718:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1077 00010000:00010000:0.0:1789997832.511858:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.511868:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.511877:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.511883:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997832.511887:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.511895:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.511910:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997832.511913:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997832.511918:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997832.511924:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592ddaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997832.651145:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713054720:0@lo:400:kworker.0 00000100:00100000:3.0:1789997832.651216:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997832.651253:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713054592:0@lo:400:kworker.0 00000100:00100000:0.0:1789997832.651293:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997832.651349:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713054336:0@lo:400:kworker.0 00000100:00100000:0.0:1789997832.651350:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713054592 00000100:00100000:0.0:1789997832.651359:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713054592 00000100:00100000:1.0:1789997832.651390:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997832.651417:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:0.0:1789997832.651427:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713054592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997832.651443:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713054464:0@lo:400:kworker.0 00000100:00100000:2.0:1789997832.651492:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997832.651501:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713054592:12345-0@lo:400:kworker.0 Request processed in 74us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997832.651510:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1789997832.651515:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713054976:0@lo:400:kworker.0 00000100:00100000:0.0:1789997832.651527:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713054464 00000100:00100000:2.0:1789997832.651537:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997832.651565:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713054720 00000100:00100000:3.0:1789997832.651569:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713054720 00000100:00100000:0.0:1789997832.651598:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713054464 00000100:00100000:1.0:1789997832.652379:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713054848:0@lo:400:kworker.0 00000100:00100000:1.0:1789997832.652415:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997832.652841:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713054976 00000100:00100000:0.0:1789997832.652847:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713054976 00000100:00100000:3.0:1789997832.653551:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713054848 00000100:00100000:3.0:1789997832.653558:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713054848 00000100:00100000:3.0:1789997832.653603:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1789997832.653612:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713054720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997832.653699:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713054720:12345-0@lo:400:kworker.0 Request processed in 88us (2483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997832.653705:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1789997832.653719:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1789997832.653724:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713054848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997832.653758:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713054848:12345-0@lo:400:kworker.0 Request processed in 33us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997832.653764:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1789997832.653784:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713054336 00000100:00100000:3.0:1789997832.653788:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713054336 00000100:00100000:0.0:1789997832.653811:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:0.0:1789997832.653823:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713054464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997832.653824:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1789997832.653836:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713054336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997832.653906:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1789997832.653915:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713054976:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789997832.654376:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997832.654382:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997832.654384:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997832.659251:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713054592:0@lo:400:kworker.0 00000100:00100000:3.0:1789997832.659401:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713054336:12345-0@lo:400:kworker.0 Request processed in 5565us (8007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997832.659413:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1789997832.659515:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713054720:0@lo:400:kworker.0 00000100:00100000:3.0:1789997832.659542:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713054336:0@lo:400:kworker.0 00000100:00100000:3.0:1789997832.659553:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713054848:0@lo:400:kworker.0 00000100:00100000:2.0:1789997832.659931:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713054976:12345-0@lo:400:kworker.0 Request processed in 6015us (8390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997832.659941:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:0.0:1789997832.660037:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713054464:12345-0@lo:400:kworker.0 Request processed in 6215us (8542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997832.660047:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1789997832.662241:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713054976:0@lo:400:kworker.0 00000100:00100000:1.0:1789997832.662281:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713054464:0@lo:400:kworker.0 00010000:00010000:2.0:1789997832.970925:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997833.175830:0:95339:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4fe831a0 20000000:00000080:0.0:1789997833.175851:0:95339:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa7c00 uarg=0000000000000000 00010000:00010000:0.0:1789997833.176333:0:95339:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997833.176348:0:95339:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997833.176362:0:95339:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997833.176382:0:95339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997833.176398:0:95339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dd8e expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997833.176405:0:95339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997833.177388:0:95339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dd8e expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997833.177407:0:95339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dd8e expref: 18 pid: 7594 timeout: 2121 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997833.177421:0:95339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95339:1876946713055104:0@lo:104: 00000100:00100000:0.0:1789997833.177501:0:95339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997833.177585:0:95339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32bc000 going to sleep for 11 seconds 00000100:00100000:3.0:1789997833.178139:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713055104 00000100:00100000:3.0:1789997833.178148:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713055104 00000100:00100000:3.0:1789997833.178240:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789997833.178251:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:95339:x1876946713055104:12345-0@lo:104: 00010000:00010000:3.0:1789997833.178266:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997833.178343:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997833.178348:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:95339:x1876946713055104:12345-0@lo:104: Request processed in 101us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997833.178355:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789997833.178416:0:95339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95339:1876946713055104:0@lo:104: 00010000:00010000:0.0:1789997833.178448:0:95339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179034:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997833.179044:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179051:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997833.179055:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179064:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997833.179071:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997833.179077:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997833.179116:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179123:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997833.179146:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179153:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592dd8e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dd95 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179171:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997833.179173:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997833.179175:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997833.179382:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713055232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997833.179430:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997833.179539:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713055232 00000100:00100000:2.0:1789997833.179546:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713055232 00010000:00010000:2.0:1789997833.179571:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dd8e expref: 19 pid: 7594 timeout: 2121 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997833.179602:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789997833.179623:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713055232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997833.179634:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997833.179639:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dd8e expref: 19 pid: 7594 timeout: 2121 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179650:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dd8e expref: 19 pid: 7594 timeout: 2121 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179688:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3c00/0x65b43101d592dd95 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dd8e expref: 19 pid: 7594 timeout: 2121 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179701:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179709:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179724:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179731:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179738:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179745:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179750:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997833.179755:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179761:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179777:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997833.179791:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997833.179826:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713055232:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997833.179832:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00010000:00010000:0.0:1789997833.179901:0:95339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997833.179911:0:95339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997833.179917:0:95339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592ddb1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997833.182032:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713055232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997833.996811:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997834.521764:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997834.521811:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997834.521845:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997834.521886:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997834.521891:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704573056 00000100:00100000:1.0:1789997834.521902:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704573056 00000100:00100000:2.0:1789997834.521943:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704573184 00000100:00100000:1.0:1789997834.521957:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1197 00000100:00100000:2.0:1789997834.521958:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704573184 00000100:00100000:1.0:1789997834.521966:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704573056:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997834.521996:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1484 00000100:00100000:2.0:1789997834.522003:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704573184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997834.522036:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704573184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997834.522036:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704573056:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997834.522045:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1484 00000100:00100000:1.0:1789997834.522045:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1197 00000100:00080000:2.0:1789997834.522077:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997834.523198:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704573312 00000100:00100000:0.0:1789997834.523206:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704573312 00000100:00100000:0.0:1789997834.523287:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704573440 00000100:00100000:0.0:1789997834.523290:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704573440 00000100:00100000:0.0:1789997834.523321:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1007 00000100:00100000:0.0:1789997834.523330:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704573312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997834.523387:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704573312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 58us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997834.523393:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1007 00000100:00100000:0.0:1789997834.523435:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1008 00000100:00100000:0.0:1789997834.523442:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704573440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997834.523468:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704573440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997834.523475:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1008 00000100:00080000:2.0:1789997834.523633:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997834.523637:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997834.699566:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713055360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997834.699732:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997834.701290:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713055360 00000100:00100000:2.0:1789997834.701304:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713055360 00000100:00100000:2.0:1789997834.701393:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:2.0:1789997834.701421:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713055360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997834.701468:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997834.701499:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713055488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997834.701544:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997834.701556:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713055360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997834.701565:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:2.0:1789997834.701584:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713055488 00000100:00100000:2.0:1789997834.701589:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713055488 00000100:00100000:2.0:1789997834.701628:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:2.0:1789997834.701635:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713055488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997834.701673:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997834.701690:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713055360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997834.701714:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713055488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997834.701722:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1789997834.701746:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713055488:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997834.701809:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997834.701815:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1789997835.018758:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997835.018766:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997835.018772:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997835.018822:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997835.018834:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.019123:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997835.019227:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997835.019256:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713055616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997835.019328:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997835.019415:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713055616 00000100:00100000:3.0:1789997835.019424:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713055616 00000100:00100000:3.0:1789997835.019517:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1789997835.019527:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713055616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997835.019540:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997835.019555:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ddb8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.019581:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.019593:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.019603:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:0.0:1789997835.019706:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c2ba4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789997835.020543:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713055616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1014us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997835.020552:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1789997835.020687:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f56d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713055616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997835.020704:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997835.020715:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997835.020744:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997835.020750:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997835.020758:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997835.432619:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997835.432748:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704573568 00000100:00100000:1.0:1789997835.432760:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704573568 00000100:00100000:1.0:1789997835.432895:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1078 00000100:00100000:1.0:1789997835.432907:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56036:x1876946704573568:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997835.432929:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997835.432951:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592ddc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433021:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433035:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433049:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433060:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433066:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433073:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433363:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dddb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433372:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433379:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997835.433415:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:1.0:1789997835.433418:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997835.433437:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433453:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433459:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433465:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433471:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997835.433475:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433483:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433495:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997835.433498:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997835.433503:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433509:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592ddcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433520:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433526:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433531:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433536:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997835.433539:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433544:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433551:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38e062d000) 00010000:00010000:1.0:1789997835.433553:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997835.433556:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433561:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592ddd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433589:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592ddc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf085 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433604:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dddb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf085 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.433612:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:1.0:1789997835.433614:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997835.433616:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997835.433866:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56036:x1876946704573568:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 960us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997835.433873:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1078 00000100:00100000:0.0:1789997835.443318:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997835.443440:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704573824 00000100:00100000:3.0:1789997835.443451:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704573824 00000100:00100000:3.0:1789997835.443505:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1079 00000100:00100000:3.0:1789997835.443516:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56036:x1876946704573824:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997835.443539:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997835.443558:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dde2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf08c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.443835:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.443852:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.443862:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.443877:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.443884:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.443891:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997835.444556:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789997835.444853:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ddf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444865:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ddf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444875:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ddf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444914:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444921:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444928:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444934:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997835.444938:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444946:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444958:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:3.0:1789997835.444962:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997835.444966:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.444972:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592dde9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997835.444984:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064100d0b reply state 00000000a801c5fb transno 4294967709 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997835.444992:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997835.445022:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592dde2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf08c expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.445042:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ddf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf08c expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.445049:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997835.445052:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997835.445054:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997835.445116:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:56036:x1876946704573824:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1601us (1808us total) trans 4294967709 rc 0/0 00000100:00100000:3.0:1789997835.445124:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1079 00010000:00010000:3.0:1789997835.447118:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.447131:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.447139:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.447145:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997835.447149:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.447157:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.447172:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38ee49e100) 00010000:00010000:3.0:1789997835.447176:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997835.447180:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.447187:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ddf0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997835.449451:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997835.450748:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704574080 00000100:00100000:2.0:1789997835.450760:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704574080 00000100:00100000:2.0:1789997835.450819:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1080 00000100:00100000:2.0:1789997835.450831:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56036:x1876946704574080:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:2.0:1789997835.450886:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997835.450915:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592ddf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf08c expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.450933:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:2.0:1789997835.450955:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997835.451175:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.451190:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.451201:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997835.451419:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3f68f08 reply state 00000000d23c544d transno 4294967710 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997835.451435:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997835.451542:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:56036:x1876946704574080:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 713us (2097us total) trans 4294967710 rc 0/0 00000100:00100000:2.0:1789997835.451549:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1080 00010000:00010000:2.0:1789997835.455462:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.455479:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.455487:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.455494:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997835.455499:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.455507:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.455522:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997835.455526:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997835.455531:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.455537:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997835.456089:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997835.456135:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704574208 00000100:00100000:3.0:1789997835.456214:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704574208 00000100:00100000:3.0:1789997835.456272:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1081 00000100:00100000:3.0:1789997835.456283:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56036:x1876946704574208:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997835.456308:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997835.456326:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592de0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf093 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.456381:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592de0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf093 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.456408:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592de0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf093 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.456428:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997835.456431:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997835.456433:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:3.0:1789997835.456491:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:56036:x1876946704574208:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 210us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997835.456498:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1081 00000100:00100000:0.0:1789997835.459711:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997835.459825:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704574336 00000100:00100000:3.0:1789997835.459834:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704574336 00000100:00100000:3.0:1789997835.459886:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 577 00000100:00100000:3.0:1789997835.459896:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704574336:12345-192.168.204.4@tcp:2:touch.60003 00000100:00100000:3.0:1789997835.460237:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704574336:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 341us (534us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789997835.460245:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 577 00000100:00100000:2.0:1789997835.462235:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997835.462293:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704574592 00000100:00100000:0.0:1789997835.462301:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704574592 00000100:00100000:0.0:1789997835.462351:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 110 00000100:00100000:0.0:1789997835.462361:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:56036:x1876946704574592:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:0.0:1789997835.462854:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:56036:x1876946704574592:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 491us (622us total) trans 4294967711 rc 0/0 00000100:00100000:0.0:1789997835.462863:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 110 00000100:00100000:0.0:1789997835.500130:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997835.500253:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704574720 00000100:00100000:2.0:1789997835.500264:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704574720 00000100:00100000:2.0:1789997835.500321:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1082 00000100:00100000:2.0:1789997835.500331:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:56040:x1876946704574720:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:2.0:1789997835.500356:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997835.500377:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf09a expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500451:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500465:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500476:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500490:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500496:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500503:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500603:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592de28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500611:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592de28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500619:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592de28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997835.500694:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x59:0x0]: returning size 0 00000004:00200000:2.0:1789997835.500699:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997835.500721:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592de28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500733:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592de28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500740:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500747:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500754:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500759:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997835.500764:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500772:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500783:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:2.0:1789997835.500786:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997835.500791:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500796:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500812:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500818:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500822:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500826:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997835.500829:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500834:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500840:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997835.500842:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997835.500845:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500850:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500881:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf09a expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500895:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592de28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf09a expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.500908:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:2.0:1789997835.500910:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997835.500913:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789997835.500980:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:56040:x1876946704574720:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 650us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997835.500987:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1082 00000100:00100000:3.0:1789997835.505753:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997835.506683:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704574848 00000100:00100000:1.0:1789997835.506695:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704574848 00000100:00100000:1.0:1789997835.506763:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 578 00000100:00100000:1.0:1789997835.506773:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704574848:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:1.0:1789997835.506790:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997835.506811:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0a1 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997835.506838:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6ab1330b, atime: 0x6ab1330b, ctime: 0x6ab1330b, blocks: 0x1 00010000:00010000:1.0:1789997835.506858:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=2024s v=(0 0) 00010000:00010000:1.0:1789997835.506863:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997835.506872:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.506892:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.506905:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997835.506968:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704574848:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 196us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997835.506976:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 578 00000100:00100000:3.0:1789997835.512403:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997835.512493:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704575104 00000100:00100000:2.0:1789997835.512504:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704575104 00000100:00100000:2.0:1789997835.512571:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1083 00000100:00100000:2.0:1789997835.512582:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:56040:x1876946704575104:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:2.0:1789997835.512636:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997835.512696:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592de28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf09a expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512721:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592de0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x59:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf093 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512732:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:2.0:1789997835.512744:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997835.512768:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512782:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512791:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512804:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512811:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512817:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512911:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512918:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.512925:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997835.513564:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].34, 64 off10368 00000004:00080000:2.0:1789997835.513575:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2024205920693ns, next at 2025205918260ns, rc = 0 00010000:00010000:2.0:1789997835.513632:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513643:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513707:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513717:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513728:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513734:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513747:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997835.513769:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513775:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513781:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513786:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997835.513790:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513797:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513807:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997835.513810:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997835.513814:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513820:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592de44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.513836:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997835.513837:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513849:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.513849:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513861:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.513865:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997835.513873:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997835.513873:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513880:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513896:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.513901:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997835.513907:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:2.0:1789997835.513911:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997835.513916:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997835.513917:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.513924:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997835.513928:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592de36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.513930:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997835.513946:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592de4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997835.513948:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2271447 reply state 00000000e0ed70ae transno 4294967712 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997835.513959:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997835.513972:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997835.513976:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997835.513978:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997835.514056:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:56040:x1876946704575104:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 1473us (1674us total) trans 4294967712 rc 0/0 00000100:00100000:2.0:1789997835.514065:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1083 00010000:00010000:3.0:1789997835.515475:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.515489:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.515496:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.515501:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997835.515506:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.515512:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.515526:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38d0bdfa00) 00010000:00010000:3.0:1789997835.515529:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997835.515533:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997835.515540:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592de3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997835.753444:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967364 is committed 00010000:00010000:3.0:1789997836.045861:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997836.759409:0:95584:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe8c1dcfe0 20000000:00000080:2.0:1789997836.759428:0:95584:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb178400 uarg=0000000000000000 00010000:00010000:2.0:1789997836.759835:0:95584:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789997836.759870:0:95584:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38e062d200) 00010000:00010000:2.0:1789997836.759874:0:95584:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997836.759885:0:95584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592dddb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf085 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997836.759910:0:95584:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1789997836.759925:0:95584:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997836.759940:0:95584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997836.759953:0:95584:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997836.759961:0:95584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997836.759999:0:95584:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997836.760015:0:95584:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 18 pid: 5804 timeout: 2125 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997836.760030:0:95584:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95584:1876946713055744:0@lo:104: 00000100:00100000:2.0:1789997836.760093:0:95584:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997836.760221:0:95584:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae10000 going to sleep for 11 seconds 00000100:00100000:3.0:1789997836.760357:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713055744 00000100:00100000:3.0:1789997836.760364:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713055744 00000100:00100000:3.0:1789997836.760459:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789997836.760469:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:95584:x1876946713055744:12345-0@lo:104: 00010000:00010000:3.0:1789997836.760482:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997836.760561:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997836.760568:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:95584:x1876946713055744:12345-0@lo:104: Request processed in 102us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997836.760575:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789997836.760730:0:95584:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95584:1876946713055744:0@lo:104: 00010000:00010000:0.0:1789997836.760750:0:95584:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997836.760839:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997836.760846:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997836.760854:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997836.760858:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997836.760867:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997836.760874:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997836.760880:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997836.760915:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997836.760923:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997836.760951:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997836.760958:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0200/0x65b43101d592ddb8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ddbf expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997836.760966:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997836.760979:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713055872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997836.760980:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997836.760982:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997836.760984:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997836.761012:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997836.761145:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713055872 00000100:00100000:0.0:1789997836.761150:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713055872 00010000:00010000:0.0:1789997836.761171:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 19 pid: 5804 timeout: 2125 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997836.761231:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1789997836.761238:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713055872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997836.761248:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997836.761254:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 19 pid: 5804 timeout: 2125 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761277:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 19 pid: 5804 timeout: 2125 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761289:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592ddbf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ddb8 expref: 19 pid: 5804 timeout: 2125 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761302:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761309:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761322:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761329:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761336:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761342:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761348:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997836.761352:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761360:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761400:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997836.761410:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997836.761454:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713055872:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997836.761461:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789997836.761524:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713055872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997836.761700:0:95584:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997836.761708:0:95584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997836.761715:0:95584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2000/0x65b43101d592de52 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.068306:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997837.771486:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713056256:0@lo:400:kworker.0 00000100:00100000:2.0:1789997837.771570:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997837.771641:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997837.771650:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713056384:0@lo:400:kworker.0 00000100:00100000:2.0:1789997837.771707:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997837.771756:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713056384 00000100:00100000:2.0:1789997837.771764:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713056384 00000100:00100000:1.0:1789997837.771803:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713056256 00000100:00100000:1.0:1789997837.771809:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713056256 00000100:00100000:2.0:1789997837.771834:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1789997837.771844:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713056384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997837.771851:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:1.0:1789997837.771861:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713056256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997837.771902:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713056384:12345-0@lo:400:kworker.0 Request processed in 58us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997837.771910:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713056256:12345-0@lo:400:kworker.0 Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997837.771911:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1789997837.771922:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00080000:2.0:1789997837.771947:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997837.771953:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997837.772000:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713056384:0@lo:400:kworker.0 00000100:00100000:2.0:1789997837.772013:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713056256:0@lo:400:kworker.0 00000100:00100000:3.0:1789997837.772248:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713056000:0@lo:400:kworker.0 00000100:00100000:3.0:1789997837.772287:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997837.772324:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713056512:0@lo:400:kworker.0 00000100:00100000:3.0:1789997837.772361:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997837.772753:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713056128:0@lo:400:kworker.0 00000100:00100000:0.0:1789997837.772881:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997837.772918:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713056640:0@lo:400:kworker.0 00000100:00100000:0.0:1789997837.772942:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997837.773092:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713056000 00000100:00100000:1.0:1789997837.773097:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713056000 00000100:00100000:1.0:1789997837.773132:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1789997837.773141:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713056000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997837.773179:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713056000:12345-0@lo:400:kworker.0 Request processed in 40us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997837.773186:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:3.0:1789997837.773202:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713056128 00000100:00100000:3.0:1789997837.773208:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713056128 00000100:00100000:1.0:1789997837.773216:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713056512 00000100:00100000:1.0:1789997837.773221:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713056512 00000100:00100000:3.0:1789997837.773242:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713056640 00000100:00100000:3.0:1789997837.773247:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713056640 00000100:00100000:1.0:1789997837.773260:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:1.0:1789997837.773268:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713056512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997837.773286:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:3.0:1789997837.773297:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713056128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997837.773302:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713056512:12345-0@lo:400:kworker.0 Request processed in 33us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997837.773309:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:3.0:1789997837.773343:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713056128:12345-0@lo:400:kworker.0 Request processed in 49us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997837.773364:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:3.0:1789997837.773388:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1789997837.773395:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713056640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997837.773428:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713056640:12345-0@lo:400:kworker.0 Request processed in 34us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997837.773434:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1789997837.773475:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713056000:0@lo:400:kworker.0 00000100:00100000:3.0:1789997837.773492:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713056512:0@lo:400:kworker.0 00000100:00100000:0.0:1789997837.773504:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713056128:0@lo:400:kworker.0 00000100:00100000:0.0:1789997837.773519:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713056640:0@lo:400:kworker.0 00000100:00080000:2.0:1789997837.773795:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997837.773800:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789997837.807306:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967711 is committed 00000001:00080000:2.0:1789997837.807327:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967712 is committed 00000004:00080000:2.0:1789997837.807332:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00000100:00100000:0.0:1789997837.807524:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997837.807543:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713056768:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997837.807620:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997837.807709:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713056768 00000100:00100000:0.0:1789997837.807716:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713056768 00000100:00100000:0.0:1789997837.807760:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1789997837.807769:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713056768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789997837.807796:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:0.0:1789997837.807821:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997837.807843:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997837.807853:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789997837.807858:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997837.807863:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997837.807892:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997837.807908:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 5 pid: 8169 timeout: 2126 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997837.807919:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946713056896:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997837.807976:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d1b8c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997837.810202:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997837.810498:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946713056896:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997837.810527:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997837.810884:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704575232 00000100:00100000:2.0:1789997837.810892:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704575232 00010000:00010000:2.0:1789997837.810948:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 6 pid: 8169 timeout: 2126 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997837.810998:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 422 00000100:00100000:2.0:1789997837.811010:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704575232:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997837.811025:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997837.811031:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 6 pid: 8169 timeout: 2126 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811044:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 6 pid: 8169 timeout: 2126 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811065:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011946b2a/0x65b43101d592de2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a1 expref: 6 pid: 8169 timeout: 2126 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811082:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997837.811086:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997837.811092:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811102:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811130:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997837.811176:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997837.811179:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704575232:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 171us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997837.811203:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 422 00010000:00010000:0.0:1789997837.811209:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997837.811223:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997837.811232:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997837.811356:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997837.811370:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997837.811377:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811385:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997837.811390:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811400:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811413:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811421:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592de59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.811445:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997837.811447:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997837.811449:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789997837.812092:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997837.813384:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713056768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5611us (5759us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789997837.813396:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000004:00080000:2.0:1789997837.813430:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38f9fddf80/2, rc 0, transno 4294967365 00000100:00100000:2.0:1789997837.813439:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713056768:0@lo:6:osp-syn-1-0.0 10000000:01000000:3.0:1789997837.835403:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997837.835412:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997837.835418:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997837.835467:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997837.835482:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997837.835497:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997837.835528:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713057024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997837.836096:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997837.836150:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3581cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997837.836679:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713057024 00000100:00100000:2.0:1789997837.836687:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713057024 00000100:00100000:2.0:1789997837.836785:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1789997837.836800:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713057024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997837.836816:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997837.836832:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592de60 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.836856:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592de60 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.836867:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592de60 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.836876:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997837.836923:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713057024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997837.836930:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1789997837.837065:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713057024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997837.837083:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.837092:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997837.837112:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789997837.837117:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997837.837125:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.091218:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997838.851599:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997838.851762:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704575360 00000100:00100000:2.0:1789997838.851773:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704575360 00000100:00100000:2.0:1789997838.851857:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1084 00000100:00100000:2.0:1789997838.851871:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56128:x1876946704575360:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997838.851897:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997838.851925:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592de6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0a8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.852003:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592de75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.852020:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592de75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.852035:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592de75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997838.852077:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:2.0:1789997838.852082:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997838.852103:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592de75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.852133:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592de6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a8 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.852159:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592de75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a8 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.852184:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997838.852187:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997838.852191:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2a00, rc 0) 00000100:00100000:2.0:1789997838.852256:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56128:x1876946704575360:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 389us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997838.852263:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1084 00000100:00080000:3.0:1789997838.854822:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997838.855747:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997838.855846:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704575616 00000100:00100000:3.0:1789997838.855857:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704575616 00000100:00100000:3.0:1789997838.856030:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1085 00000100:00100000:3.0:1789997838.856043:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56128:x1876946704575616:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997838.856097:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997838.856126:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592de75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0a8 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997838.856142:0:5810:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592dddb) 00010000:00010000:3.0:1789997838.856147:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:3.0:1789997838.856161:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997838.856186:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997838.856201:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997838.856213:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997838.896020:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967713 is committed 00000004:00010000:3.0:1789997838.896090:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000677203e7 reply state 00000000f2205df0 transno 4294967713 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997838.896104:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997838.896119:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00080000:3.0:1789997838.896299:0:5810:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789997838.896320:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56128:x1876946704575616:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 40277us (40576us total) trans 4294967713 rc 0/0 00000100:00100000:3.0:1789997838.896339:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1085 00010000:00010000:2.0:1789997838.896399:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.896411:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.896419:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.896426:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997838.896431:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.896438:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.896453:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e100) 00010000:00010000:2.0:1789997838.896456:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997838.896461:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997838.896467:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.114860:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997839.460125:0:95780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd7112010 20000000:00000080:1.0:1789997839.460142:0:95780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fa5af000 uarg=0000000000000000 00010000:00010000:1.0:1789997839.461358:0:95780:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997839.461376:0:95780:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997839.461390:0:95780:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997839.461408:0:95780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997839.461425:0:95780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592de60 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997839.461434:0:95780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997839.461534:0:95780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592de60 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997839.461553:0:95780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592de60 expref: 18 pid: 5805 timeout: 2128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997839.461566:0:95780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95780:1876946713057152:0@lo:104: 00000100:00100000:1.0:1789997839.461627:0:95780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997839.461738:0:95780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3eb93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997839.461840:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713057152 00000100:00100000:0.0:1789997839.461849:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713057152 00000100:00100000:0.0:1789997839.461937:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789997839.461947:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:95780:x1876946713057152:12345-0@lo:104: 00010000:00010000:0.0:1789997839.461960:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997839.462033:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997839.462039:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:95780:x1876946713057152:12345-0@lo:104: Request processed in 95us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997839.462046:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00010000:2.0:1789997839.462093:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997839.462101:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462109:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997839.462113:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462121:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997839.462128:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997839.462134:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1789997839.462161:0:95780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95780:1876946713057152:0@lo:104: 00010000:00010000:1.0:1789997839.462179:0:95780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462184:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462193:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997839.462225:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462233:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de60 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592de67 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997839.462245:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713057280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997839.462250:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997839.462254:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997839.462256:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997839.462278:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997839.462560:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713057280 00000100:00100000:2.0:1789997839.462565:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713057280 00010000:00010000:2.0:1789997839.462584:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592de60 expref: 19 pid: 5805 timeout: 2128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997839.462618:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789997839.462625:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713057280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997839.462636:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997839.462641:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592de60 expref: 19 pid: 5805 timeout: 2128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462668:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592de60 expref: 19 pid: 5805 timeout: 2128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462683:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592de67 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592de60 expref: 19 pid: 5805 timeout: 2128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462696:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462704:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462717:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462724:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462731:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462742:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462747:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997839.462751:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462758:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462778:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997839.462787:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997839.462830:0:95780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997839.462834:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713057280:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (553us total) trans 0 rc 0/0 00010000:00010000:1.0:1789997839.462847:0:95780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997839.462849:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00010000:00010000:1.0:1789997839.462859:0:95780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592de83 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997839.463719:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713057280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997839.638703:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997839.638736:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997839.638764:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997839.638792:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997839.638819:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704575744 00000100:00100000:2.0:1789997839.638829:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704575744 00000100:00100000:2.0:1789997839.638874:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1201 00000100:00100000:2.0:1789997839.638884:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704575744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997839.638944:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704575744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 61us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997839.638950:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1201 00000100:00100000:2.0:1789997839.638983:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704576128 00000100:00100000:2.0:1789997839.638986:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704576128 00000100:00100000:2.0:1789997839.639015:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704576000 00000100:00100000:2.0:1789997839.639017:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704576000 00000100:00100000:2.0:1789997839.639036:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1011 00000100:00100000:2.0:1789997839.639043:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704576128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997839.639069:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704576128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997839.639076:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1011 00000100:00100000:2.0:1789997839.639088:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1012 00000100:00100000:2.0:1789997839.639095:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704576000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997839.639119:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704576000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997839.639125:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1012 00000100:00080000:2.0:1789997839.639146:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997839.639149:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997839.639703:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704575872 00000100:00100000:3.0:1789997839.639710:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704575872 00000100:00100000:3.0:1789997839.639750:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1488 00000100:00100000:3.0:1789997839.639758:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704575872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997839.639811:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704575872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 55us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997839.639817:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1488 00000100:00100000:2.0:1789997839.818793:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713057408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997839.818876:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997839.818924:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713057408 00000100:00100000:2.0:1789997839.818927:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997839.818933:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713057408 00000100:00100000:2.0:1789997839.818933:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713057536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997839.818956:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997839.819007:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713057536 00000100:00100000:3.0:1789997839.819011:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713057536 00000100:00100000:3.0:1789997839.819032:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1789997839.819041:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713057408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997839.819075:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997839.819124:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713057408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997839.819131:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:2.0:1789997839.819143:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:2.0:1789997839.819151:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713057536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997839.819169:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789997839.819188:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997839.819193:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997839.819198:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713057536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997839.819208:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:2.0:1789997839.819249:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713057536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997839.819271:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713057408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789997840.141108:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997840.923803:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967365 is committed 00010000:00010000:2.0:1789997841.163833:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997841.356268:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997841.356275:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997841.356290:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997841.356641:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.356727:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.356740:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997841.356766:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713057664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997841.356838:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997841.356969:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c133a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789997841.357526:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713057664 00000100:00100000:0.0:1789997841.357535:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713057664 00000100:00100000:0.0:1789997841.357596:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1789997841.357606:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713057664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997841.357621:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997841.357636:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592de8a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997841.357686:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592de8a expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997841.357699:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592de8a expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997841.357709:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997841.357766:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713057664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997841.357774:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1789997841.357800:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713057664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997841.357827:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.357838:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997841.357856:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997841.357861:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.357868:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997841.955279:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997841.955414:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704576256 00000100:00100000:3.0:1789997841.955426:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704576256 00000100:00100000:3.0:1789997841.955502:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1086 00000100:00100000:3.0:1789997841.955514:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56204:x1876946704576256:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997841.955532:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997841.955553:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592de98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0af expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.955615:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.955629:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.955641:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.955671:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.955679:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.955686:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956169:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592dead lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956190:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592dead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956198:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592dead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997841.956220:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789997841.956223:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997841.956242:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592dead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956254:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956262:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956279:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956290:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997841.956294:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956302:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956313:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997841.956316:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997841.956320:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956327:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592de9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956338:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956344:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956350:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956354:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997841.956356:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956361:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956372:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38ee49ef00) 00010000:00010000:3.0:1789997841.956374:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997841.956376:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956381:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592dea6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956409:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592de98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0af expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956424:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592dead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0af expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997841.956431:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997841.956433:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997841.956435:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:3.0:1789997841.956495:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56204:x1876946704576256:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 984us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997841.956503:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1086 00000100:00080000:0.0:1789997841.956637:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789997842.190966:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997842.891804:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713057920:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.891872:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997842.891918:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713058432:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.891939:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997842.891962:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789997842.891967:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713057792:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.891997:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997842.892020:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713058304:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892044:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997842.892083:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713058048:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892105:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997842.892121:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997842.892126:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713058176:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892144:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997842.892177:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713057920 00000100:00100000:3.0:1789997842.892184:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713057920 00000100:00100000:3.0:1789997842.892223:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713058432 00000100:00100000:3.0:1789997842.892225:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713058432 00000100:00100000:3.0:1789997842.892262:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713058048 00000100:00100000:3.0:1789997842.892265:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713058048 00000100:00100000:3.0:1789997842.892287:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:3.0:1789997842.892295:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713057920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892343:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713057920:12345-0@lo:400:kworker.0 Request processed in 48us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997842.892350:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:3.0:1789997842.892365:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:3.0:1789997842.892371:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713058432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892392:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713058432:12345-0@lo:400:kworker.0 Request processed in 22us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997842.892396:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:3.0:1789997842.892404:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:3.0:1789997842.892409:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713058048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892448:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713058048:12345-0@lo:400:kworker.0 Request processed in 38us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997842.892453:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:3.0:1789997842.892471:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713057792 00000100:00100000:3.0:1789997842.892474:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713057792 00000100:00100000:3.0:1789997842.892497:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1789997842.892502:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713057792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892528:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713057792:12345-0@lo:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997842.892534:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1789997842.892557:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713058304 00000100:00100000:3.0:1789997842.892560:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713058304 00000100:00100000:3.0:1789997842.892581:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713058176 00000100:00100000:3.0:1789997842.892583:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713058176 00000100:00100000:3.0:1789997842.892599:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1789997842.892604:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713058304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892628:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713058304:12345-0@lo:400:kworker.0 Request processed in 24us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997842.892634:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1789997842.892643:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1789997842.892647:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713058176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892696:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713058176:12345-0@lo:400:kworker.0 Request processed in 48us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997842.892701:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00080000:3.0:1789997842.892722:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997842.892726:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997842.892729:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997842.892765:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713058176:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892774:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713058048:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892795:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713057792:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892802:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:3.0:1789997842.892806:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38f9fddf80, transno 4294967365 00000100:00100000:3.0:1789997842.892815:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713058304:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892823:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713057920:0@lo:400:kworker.0 00000100:00100000:3.0:1789997842.892831:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713058432:0@lo:400:kworker.0 00010000:00010000:0.0:1789997843.210915:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997843.419978:0:96027:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6a5d0850 20000000:00000080:3.0:1789997843.419994:0:96027:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd8f0c00 uarg=0000000000000000 00010000:00010000:3.0:1789997843.421255:0:96027:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789997843.421293:0:96027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:3.0:1789997843.421297:0:96027:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997843.421309:0:96027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592dead lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0af expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997843.421332:0:96027:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1789997843.421348:0:96027:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997843.421363:0:96027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997843.421377:0:96027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592de8a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997843.421385:0:96027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997843.421424:0:96027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592de8a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997843.421439:0:96027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592de8a expref: 18 pid: 5804 timeout: 2132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997843.421453:0:96027:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96027:1876946713058560:0@lo:104: 00000100:00100000:3.0:1789997843.421514:0:96027:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997843.421650:0:96027:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38faf3dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789997843.423131:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713058560 00000100:00100000:2.0:1789997843.423143:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713058560 00000100:00100000:3.0:1789997843.423356:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789997843.423368:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:96027:x1876946713058560:12345-0@lo:104: 00010000:00010000:3.0:1789997843.423398:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997843.423518:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997843.423524:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:96027:x1876946713058560:12345-0@lo:104: Request processed in 160us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997843.423531:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789997843.423618:0:96027:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96027:1876946713058560:0@lo:104: 00010000:00010000:1.0:1789997843.423640:0:96027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.423892:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997843.423899:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.423907:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997843.423911:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.423920:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997843.423926:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997843.423932:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997843.424003:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424011:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997843.424039:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424046:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592de8a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592de91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424064:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997843.424066:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997843.424067:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997843.424073:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997843.424085:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713058688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997843.424125:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997843.424166:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713058688 00000100:00100000:2.0:1789997843.424181:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713058688 00010000:00010000:2.0:1789997843.424204:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592de8a expref: 19 pid: 5804 timeout: 2132 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997843.424227:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789997843.424234:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713058688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997843.424256:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997843.424261:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592de8a expref: 19 pid: 5804 timeout: 2132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424270:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592de8a expref: 19 pid: 5804 timeout: 2132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424282:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592de91 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592de8a expref: 19 pid: 5804 timeout: 2132 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424295:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424303:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424320:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424328:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424336:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424342:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424347:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997843.424351:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424358:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.424370:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997843.424521:0:96027:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997843.424531:0:96027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.426337:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b600/0x65b43101d592deb4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997843.426358:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997843.426445:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713058688:12345-0@lo:103:ldlm_bl.0 Request processed in 2208us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997843.426455:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789997843.426513:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713058688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997844.239625:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997844.490731:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997844.490739:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997844.490744:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997844.490796:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997844.490808:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997844.490819:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997844.490858:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713058816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997844.490926:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997844.490991:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c6c60840 going to sleep for 11 seconds 00000100:00100000:2.0:1789997844.491802:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713058816 00000100:00100000:2.0:1789997844.491813:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713058816 00000100:00100000:2.0:1789997844.491876:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1789997844.491887:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713058816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997844.491901:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997844.491918:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592debb expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997844.491941:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592debb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997844.491954:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592debb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997844.491962:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2600, rc 0) 00000100:00100000:2.0:1789997844.492024:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713058816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997844.492031:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1789997844.492125:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713058816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997844.492142:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997844.492151:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997844.492172:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997844.492177:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997844.492184:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997844.763021:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997844.763066:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997844.763104:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997844.763130:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997844.763259:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704576640 00000100:00100000:1.0:1789997844.763270:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704576640 00000100:00100000:1.0:1789997844.763337:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704576768 00000100:00100000:1.0:1789997844.763341:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704576768 00000100:00100000:1.0:1789997844.763366:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1015 00000100:00100000:1.0:1789997844.763377:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704576640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997844.763459:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704576640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997844.763467:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1015 00000100:00100000:1.0:1789997844.763485:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1016 00000100:00100000:1.0:1789997844.763493:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704576768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997844.763517:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704576768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997844.763523:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1016 00000100:00080000:2.0:1789997844.763879:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997844.763884:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997844.764002:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704576384 00000100:00100000:3.0:1789997844.764008:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704576384 00000100:00100000:3.0:1789997844.764056:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1205 00000100:00100000:3.0:1789997844.764065:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704576384:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997844.764098:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704576384:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997844.764105:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1205 00000100:00100000:3.0:1789997844.764136:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704576512 00000100:00100000:3.0:1789997844.764139:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704576512 00000100:00100000:3.0:1789997844.764171:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1492 00000100:00100000:3.0:1789997844.764178:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704576512:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997844.764207:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704576512:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997844.764227:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1492 00000100:00080000:3.0:1789997844.764253:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997844.939987:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713058944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997844.940050:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997844.940120:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713058944 00000100:00100000:2.0:1789997844.940128:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713058944 00000100:00100000:2.0:1789997844.940181:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1789997844.940189:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713058944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997844.940232:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997844.940276:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713058944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997844.940295:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00080000:2.0:1789997844.940315:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997844.940347:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713058944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997844.940573:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997844.940582:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713059072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997844.940612:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997844.940636:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713059072 00000100:00100000:1.0:1789997844.940640:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713059072 00000100:00100000:1.0:1789997844.940691:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:1.0:1789997844.940697:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb2a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713059072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997844.940717:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997844.940748:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb2a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713059072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997844.940754:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00080000:1.0:1789997844.940937:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997844.940956:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713059072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997845.261145:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997846.001266:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997846.001349:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704576896 00000100:00100000:3.0:1789997846.001360:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704576896 00000100:00100000:3.0:1789997846.001440:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1087 00000100:00100000:3.0:1789997846.001451:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56291:x1876946704576896:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997846.001472:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997846.001495:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592dec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0b6 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.001559:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ded0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.001574:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.001588:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997846.001623:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789997846.001627:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997846.001646:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.001704:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592dec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0b6 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.001727:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ded0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0b6 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.001735:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997846.001738:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997846.001741:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997846.001799:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56291:x1876946704576896:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 351us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997846.001806:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1087 00000100:00080000:1.0:1789997846.002116:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997846.008490:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997846.008860:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704577152 00000100:00100000:3.0:1789997846.008872:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704577152 00000100:00100000:3.0:1789997846.008930:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1088 00000100:00100000:3.0:1789997846.008940:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56291:x1876946704577152:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997846.008989:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997846.009015:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592ded0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0b6 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.009033:0:5812:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592dead) 00010000:00010000:3.0:1789997846.009038:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997846.009048:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997846.009072:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.009084:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.009095:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997846.009455:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c4e56d2 reply state 0000000076c72c03 transno 4294967714 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997846.009464:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789997846.009472:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000100:00100000:3.0:1789997846.009555:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56291:x1876946704577152:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 615us (1072us total) trans 4294967714 rc 0/0 00000100:00100000:3.0:1789997846.009562:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1088 00010000:00010000:2.0:1789997846.012782:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.012806:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.013936:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.013943:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997846.013949:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.013960:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.013982:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:2.0:1789997846.013986:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997846.014720:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.014737:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592ded7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.283774:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997846.710162:0:96224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc784aee30 20000000:00000080:0.0:1789997846.710192:0:96224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb1bc000 uarg=0000000000000000 00010000:00010000:0.0:1789997846.712909:0:96224:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997846.712928:0:96224:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997846.712944:0:96224:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997846.712964:0:96224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997846.712981:0:96224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592debb expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997846.712990:0:96224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997846.713029:0:96224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592debb expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997846.713043:0:96224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592debb expref: 18 pid: 5805 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997846.713056:0:96224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96224:1876946713059200:0@lo:104: 00000100:00100000:0.0:1789997846.713226:0:96224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997846.713315:0:96224:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d057b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789997846.713359:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713059200 00000100:00100000:3.0:1789997846.713367:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713059200 00000100:00100000:3.0:1789997846.713688:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789997846.713700:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:96224:x1876946713059200:12345-0@lo:104: 00010000:00010000:3.0:1789997846.713714:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997846.713777:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997846.713783:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:96224:x1876946713059200:12345-0@lo:104: Request processed in 86us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997846.713790:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1789997846.713869:0:96224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96224:1876946713059200:0@lo:104: 00010000:00010000:2.0:1789997846.713891:0:96224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.713922:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997846.713927:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.713934:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997846.713938:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.713946:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997846.713954:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997846.713960:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997846.713992:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.713999:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997846.714018:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.714025:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592debb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dec2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997846.714044:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997846.714046:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997846.714047:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997846.714054:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997846.714079:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713059328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997846.714112:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997846.714376:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713059328 00000100:00100000:1.0:1789997846.714382:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713059328 00010000:00010000:1.0:1789997846.714424:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592debb expref: 19 pid: 5805 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997846.714457:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1789997846.714464:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713059328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997846.714475:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997846.714481:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592debb expref: 19 pid: 5805 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714491:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592debb expref: 19 pid: 5805 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714504:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2600/0x65b43101d592dec2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592debb expref: 19 pid: 5805 timeout: 2135 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714517:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714526:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714540:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714547:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714555:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714561:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714567:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997846.714570:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714578:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714599:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997846.714609:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997846.714646:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713059328:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997846.714671:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1789997846.714700:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713059328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997846.714762:0:96224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997846.714770:0:96224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997846.714778:0:96224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592dede lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997847.307576:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997847.826925:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997847.826941:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997847.826947:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997847.826997:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997847.827009:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997847.827029:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997847.827055:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713059456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997847.827123:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997847.827206:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d399d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997847.827244:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713059456 00000100:00100000:2.0:1789997847.827253:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713059456 00000100:00100000:2.0:1789997847.827316:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:2.0:1789997847.827326:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713059456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997847.827339:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997847.827352:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dee5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997847.827386:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dee5 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997847.827404:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dee5 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997847.827413:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3200, rc 0) 00000100:00100000:2.0:1789997847.827465:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713059456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997847.827471:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1789997847.827755:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713059456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997847.827769:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997847.827779:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997847.827798:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997847.827802:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997847.827810:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997848.010905:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713059584:0@lo:400:kworker.0 00000100:00100000:3.0:1789997848.010929:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713059968:0@lo:400:kworker.0 00000100:00100000:2.0:1789997848.011008:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713059712:0@lo:400:kworker.0 00000100:00100000:0.0:1789997848.011068:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713059840:0@lo:400:kworker.0 00000100:00100000:3.0:1789997848.011117:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997848.016867:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997848.017073:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997848.017087:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713060096:0@lo:400:kworker.0 00000100:00100000:2.0:1789997848.017131:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997848.021442:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713059712 00000100:00100000:3.0:1789997848.021462:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713059712 00000100:00100000:3.0:1789997848.021494:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713060096 00000100:00100000:3.0:1789997848.021497:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713060096 00000100:00100000:3.0:1789997848.023159:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:3.0:1789997848.023175:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713060096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997848.023330:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997848.023407:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713059968 00000100:00100000:1.0:1789997848.023415:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713059968 00000100:00100000:1.0:1789997848.023449:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:1.0:1789997848.023457:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713059968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997848.023513:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713059968:12345-0@lo:400:kworker.0 Request processed in 56us (12395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997848.023520:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00080000:1.0:1789997848.024727:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997848.024734:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997848.024747:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713059584 00000100:00100000:1.0:1789997848.024754:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713059584 00000100:00100000:1.0:1789997848.024793:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1789997848.024800:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713059584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997848.024861:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713059584:12345-0@lo:400:kworker.0 Request processed in 62us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997848.024867:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1789997848.024925:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713059968:0@lo:400:kworker.0 00000100:00100000:1.0:1789997848.024963:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713059584:0@lo:400:kworker.0 00000100:00100000:0.0:1789997848.032458:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997848.032615:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713059840 00000100:00100000:1.0:1789997848.032627:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713059840 00000100:00100000:1.0:1789997848.032716:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1789997848.032730:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713059840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997848.035859:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1789997848.035873:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713059712:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997848.037007:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997848.037015:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997848.037778:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713059712:12345-0@lo:400:kworker.0 Request processed in 1901us (20913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997848.037791:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:1.0:1789997848.040062:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713059840:12345-0@lo:400:kworker.0 Request processed in 7327us (7601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997848.040077:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1789997848.040094:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713059712:0@lo:400:kworker.0 00000100:00100000:2.0:1789997848.040229:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713059840:0@lo:400:kworker.0 00000100:00100000:3.0:1789997848.040362:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713060096:12345-0@lo:400:kworker.0 Request processed in 17192us (23228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997848.040372:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1789997848.040480:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713060096:0@lo:400:kworker.0 00010000:00010000:3.0:1789997848.331517:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997849.105792:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967714 is committed 00010000:00010000:2.0:1789997849.355934:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997849.667259:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997849.667435:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704577280 00000100:00100000:1.0:1789997849.667445:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704577280 00000100:00100000:1.0:1789997849.667552:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1089 00000100:00100000:1.0:1789997849.667563:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577280:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00080000:0.0:1789997849.668050:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997849.668198:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577280:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 634us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997849.668206:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1089 00000100:00100000:3.0:1789997849.670580:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997849.670787:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704577408 00000100:00100000:1.0:1789997849.670797:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704577408 00000100:00100000:1.0:1789997849.670863:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 580 00000100:00100000:1.0:1789997849.670874:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577408:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:0.0:1789997849.671135:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997849.671523:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577408:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 650us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997849.671532:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 580 00000100:00100000:2.0:1789997849.673744:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997849.673845:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704577536 00000100:00100000:0.0:1789997849.673854:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704577536 00000100:00100000:0.0:1789997849.673925:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 581 00000100:00100000:0.0:1789997849.673938:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577536:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997849.674334:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577536:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 397us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997849.674353:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 581 00000100:00080000:1.0:1789997849.674935:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997849.677278:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997849.677384:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704577664 00000100:00100000:1.0:1789997849.677394:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704577664 00000100:00100000:1.0:1789997849.677455:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1090 00000100:00100000:1.0:1789997849.677466:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577664:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997849.678204:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577664:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 737us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997849.678213:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1090 00000100:00100000:2.0:1789997849.681529:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997849.681639:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704577792 00000100:00100000:3.0:1789997849.681649:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704577792 00000100:00100000:3.0:1789997849.681838:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1091 00000100:00100000:3.0:1789997849.681850:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577792:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997849.681952:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577792:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 105us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997849.681959:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1091 00000100:00100000:0.0:1789997849.684062:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997849.684160:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704577920 00000100:00100000:2.0:1789997849.684170:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704577920 00000100:00100000:2.0:1789997849.684270:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 582 00000100:00100000:2.0:1789997849.684281:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577920:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997849.684935:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704577920:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 653us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997849.684943:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 582 00000100:00100000:1.0:1789997849.687392:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997849.687536:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704578048 00000100:00100000:0.0:1789997849.687546:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704578048 00000100:00100000:0.0:1789997849.687608:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 583 00000100:00100000:0.0:1789997849.687619:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704578048:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997849.688179:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704578048:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 560us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997849.688187:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 583 00000100:00100000:3.0:1789997849.690275:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997849.690453:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704578176 00000100:00100000:2.0:1789997849.690463:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704578176 00000100:00100000:2.0:1789997849.690518:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1092 00000100:00100000:2.0:1789997849.690528:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704578176:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997849.691001:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56376:x1876946704578176:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 472us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997849.691013:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1092 00000100:00100000:1.0:1789997849.744566:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997849.744700:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704578304 00000100:00100000:3.0:1789997849.744712:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704578304 00000100:00100000:3.0:1789997849.744786:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1093 00000100:00100000:3.0:1789997849.744797:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56380:x1876946704578304:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:3.0:1789997849.744818:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997849.744841:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592def3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0bd expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.744905:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.744921:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.744934:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.744947:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.744954:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.744961:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745321:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592df08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745331:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592df08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745339:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592df08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997849.745363:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:3.0:1789997849.745367:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997849.745389:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592df08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745401:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745408:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745415:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745421:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997849.745425:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745433:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745445:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997849.745449:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997849.745454:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745460:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592defa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745472:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745478:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745483:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745488:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997849.745491:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745496:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745502:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38ee49e300) 00010000:00010000:3.0:1789997849.745505:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997849.745507:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745513:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592df01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745541:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592def3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0bd expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745562:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592df08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0bd expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.745570:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:3.0:1789997849.745573:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997849.745575:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997849.745636:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56380:x1876946704578304:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 840us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997849.745644:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1093 00000100:00100000:1.0:1789997849.751020:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997849.751124:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704578560 00000100:00100000:0.0:1789997849.751134:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704578560 00000100:00100000:0.0:1789997849.751195:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1094 00000100:00100000:0.0:1789997849.751206:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56380:x1876946704578560:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997849.751227:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997849.751246:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592df0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0c4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.751528:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.751544:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.751556:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.751569:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.751576:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.751582:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997849.752345:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789997849.752640:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752681:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752691:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752729:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752737:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752743:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752749:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997849.752754:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752762:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752774:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:0.0:1789997849.752777:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997849.752782:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752788:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997849.752808:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008094b236 reply state 000000006da408f0 transno 4294967715 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997849.752816:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997849.752850:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592df0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0c4 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752867:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0c4 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997849.752884:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997849.752887:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997849.752889:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997849.752951:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:56380:x1876946704578560:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 1746us (1939us total) trans 4294967715 rc 0/0 00000100:00100000:0.0:1789997849.752960:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1094 00010000:00010000:3.0:1789997849.759128:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.759147:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.759155:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.759161:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997849.759165:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.759172:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.759188:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38c28e9700) 00010000:00010000:3.0:1789997849.759191:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997849.759196:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997849.759203:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592df1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997849.759709:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997849.760085:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704578688 00000100:00100000:1.0:1789997849.760096:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704578688 00000100:00100000:1.0:1789997849.760160:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 584 00000100:00100000:1.0:1789997849.760172:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56380:x1876946704578688:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789997849.760189:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997849.760208:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0cb expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997849.760239:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789997849.760258:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=2038s v=(0 0) 00010000:00010000:1.0:1789997849.760263:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997849.760271:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997849.760288:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997849.760300:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997849.760374:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56380:x1876946704578688:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 204us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997849.760381:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 584 00000100:00100000:0.0:1789997849.777227:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997849.777324:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704578816 00000100:00100000:2.0:1789997849.777335:0:6662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704578816 00002000:00100000:2.0:1789997849.777399:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->1048575) req@ffff8a38fa89b480 x1876946704578816/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:70/0 lens 488/0 e 0 to 0 dl 1789997860 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789997849.777411:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fa89b480 with x1876946704578816 ext(0->1048575) 00002000:00010000:2.0:1789997849.777418:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fa89b480 00000100:00100000:2.0:1789997849.777451:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 27 00000100:00100000:2.0:1789997849.777460:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704578816:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:2.0:1789997849.810329:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704578816:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 32858us (33100us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789997849.810352:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 27 00002000:00100000:2.0:1789997849.810366:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->1048575) req@ffff8a38fa89b480 x1876946704578816/t4294967364(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:70/0 lens 488/448 e 0 to 0 dl 1789997860 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1789997849.810376:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fa89b480 with x1876946704578816 ext(0->1048575) 00002000:00010000:2.0:1789997849.810382:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fa89b480 00000100:00100000:2.0:1789997849.814703:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997849.814854:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704578944 00000100:00100000:1.0:1789997849.814865:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704578944 00000100:00100000:1.0:1789997849.814924:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1095 00000100:00100000:1.0:1789997849.814933:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56380:x1876946704578944:12345-192.168.204.4@tcp:44:dd.60003 00000100:00100000:0.0:1789997849.879028:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997849.879249:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704579072 00000100:00100000:3.0:1789997849.879261:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704579072 00000100:00100000:3.0:1789997849.879324:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1207 00000100:00100000:3.0:1789997849.879345:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704579072:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997849.879423:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704579072:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 89us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997849.879432:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1207 00000001:00080000:0.0:1789997849.882065:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967715 is committed 00000100:00100000:1.0:1789997849.882290:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56380:x1876946704578944:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 67352us (67592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997849.882301:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1095 00000100:00100000:3.0:1789997849.884867:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997849.884954:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704579200 00000100:00100000:1.0:1789997849.884964:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704579200 00000100:00100000:1.0:1789997849.885022:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 585 00000100:00100000:1.0:1789997849.885032:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704579200:12345-192.168.204.4@tcp:16:dd.60003 00000001:00080000:3.0:1789997849.918546:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00000100:00100000:1.0:1789997849.918862:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704579200:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 33825us (33996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997849.918874:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 585 00000100:00100000:0.0:1789997849.921589:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997849.921811:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704579456 00000100:00100000:3.0:1789997849.921822:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704579456 00000100:00100000:3.0:1789997849.921912:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 111 00000100:00100000:3.0:1789997849.921924:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de233c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56380:x1876946704579456:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:3.0:1789997849.922543:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de233c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56380:x1876946704579456:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 620us (961us total) trans 4294967716 rc 0/0 00000100:00100000:3.0:1789997849.922552:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 111 00000100:00100000:1.0:1789997850.060234:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997850.060262:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713060224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997850.060358:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997850.060537:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713060224 00000100:00100000:2.0:1789997850.060545:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713060224 00000100:00100000:2.0:1789997850.060611:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1789997850.060621:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713060224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997850.060642:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789997850.060704:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713060224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997850.060711:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1789997850.060770:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713060224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997850.060971:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713060352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997850.061003:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997850.061084:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713060352 00000100:00100000:3.0:1789997850.061089:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713060352 00000100:00100000:3.0:1789997850.061139:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1789997850.061147:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713060352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997850.061171:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997850.061212:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713060352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997850.061219:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:2.0:1789997850.061298:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713060352:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997850.061528:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997850.061532:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997850.380268:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997851.081575:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967716 is committed 00010000:00010000:3.0:1789997851.406205:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997852.272335:0:96472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2040964678275ns, next at 1999982923335ns, rc = 0 00000004:00080000:0.0:1789997852.272487:0:96472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2040964832482ns, next at 2025205918260ns, rc = 0 00000004:00080000:2.0:1789997852.275802:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00000004:00080000:2.0:1789997852.275832:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00010000:00010000:1.0:1789997852.430536:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997853.131778:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713060480:0@lo:400:kworker.0 00000100:00100000:2.0:1789997853.131864:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997853.132686:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997853.132698:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713060864:0@lo:400:kworker.0 00000100:00100000:2.0:1789997853.132741:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997853.132786:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713060480 00000100:00100000:2.0:1789997853.132857:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713060480 00000100:00100000:2.0:1789997853.132906:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1789997853.132914:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713060480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997853.132966:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713060480:12345-0@lo:400:kworker.0 Request processed in 53us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997853.133036:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1789997853.133102:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713060480:0@lo:400:kworker.0 00000100:00100000:3.0:1789997853.133197:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713060864 00000100:00100000:3.0:1789997853.133202:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713060864 00000100:00100000:3.0:1789997853.133252:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1789997853.133261:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713060864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.133371:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997853.133378:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713060864:12345-0@lo:400:kworker.0 Request processed in 118us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997853.133385:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713060992:0@lo:400:kworker.0 00000100:00100000:3.0:1789997853.133388:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:1.0:1789997853.133425:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997853.133459:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713060608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.133485:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997853.133503:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713061120:0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.133522:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997853.133542:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997853.133551:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713060736:0@lo:400:kworker.0 00000100:00100000:3.0:1789997853.133559:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713060992 00000100:00100000:3.0:1789997853.133565:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713060992 00000100:00100000:1.0:1789997853.133573:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997853.133599:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:3.0:1789997853.133607:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713060992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997853.133643:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713060992:12345-0@lo:400:kworker.0 Request processed in 38us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997853.133649:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00080000:2.0:1789997853.133719:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997853.133723:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997853.134070:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713060608 00000100:00100000:1.0:1789997853.134076:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713060608 00000100:00100000:1.0:1789997853.134118:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713061120 00000100:00100000:1.0:1789997853.134121:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713061120 00000100:00100000:1.0:1789997853.134167:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713060736 00000100:00100000:1.0:1789997853.134170:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713060736 00000100:00100000:1.0:1789997853.134202:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:1.0:1789997853.134209:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713060608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.134252:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713060608:12345-0@lo:400:kworker.0 Request processed in 43us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997853.134258:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:1.0:1789997853.134269:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:1.0:1789997853.134275:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.134300:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713061120:12345-0@lo:400:kworker.0 Request processed in 25us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997853.134306:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:1.0:1789997853.134315:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1789997853.134321:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713060736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.134346:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713060736:12345-0@lo:400:kworker.0 Request processed in 25us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997853.134352:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1789997853.134397:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713060992:0@lo:400:kworker.0 00000100:00080000:2.0:1789997853.134409:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997853.134555:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713060736:0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.134567:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713060608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.134576:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713061120:0@lo:400:kworker.0 00000100:00100000:1.0:1789997853.134609:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713060864:0@lo:400:kworker.0 00010000:00010000:1.0:1789997853.453075:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997853.462396:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997853.462497:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704579584 00000100:00100000:2.0:1789997853.462509:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704579584 00000100:00100000:2.0:1789997853.462588:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1096 00000100:00100000:2.0:1789997853.462600:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56572:x1876946704579584:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997853.462731:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56572:x1876946704579584:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 132us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997853.462737:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1096 00000100:00080000:1.0:1789997853.463454:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997853.471000:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997853.471079:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704579712 00000100:00100000:3.0:1789997853.471091:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704579712 00000100:00100000:3.0:1789997853.471169:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 586 00000100:00100000:3.0:1789997853.471178:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56572:x1876946704579712:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997853.471510:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56572:x1876946704579712:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 332us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997853.471518:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 586 00000100:00080000:2.0:1789997853.471736:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997853.478933:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997853.479028:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704579840 00000100:00100000:2.0:1789997853.479038:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704579840 00000100:00080000:1.0:1789997853.479138:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997853.479170:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 587 00000100:00100000:2.0:1789997853.479181:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7413450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56572:x1876946704579840:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997853.479630:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7413450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56572:x1876946704579840:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 449us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997853.479639:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 587 00000100:00100000:3.0:1789997853.488729:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997853.488836:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704579968 00000100:00100000:1.0:1789997853.488846:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704579968 00000100:00100000:1.0:1789997853.488901:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1097 00000100:00100000:1.0:1789997853.488911:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56572:x1876946704579968:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997853.489348:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56572:x1876946704579968:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 437us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997853.489355:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1097 00000100:00100000:1.0:1789997853.510381:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997853.511373:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704580096 00000100:00100000:3.0:1789997853.511385:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704580096 00000100:00100000:3.0:1789997853.511452:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1098 00000100:00100000:3.0:1789997853.511463:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56572:x1876946704580096:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997853.511559:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56572:x1876946704580096:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 98us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997853.511567:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1098 00000100:00100000:1.0:1789997853.515139:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997853.515278:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704580224 00000100:00100000:3.0:1789997853.515287:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704580224 00000100:00100000:3.0:1789997853.515341:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 588 00000100:00100000:3.0:1789997853.515351:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56572:x1876946704580224:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997853.515704:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56572:x1876946704580224:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 353us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997853.515711:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 588 00000100:00100000:3.0:1789997853.517977:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997853.518066:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704580352 00000100:00100000:1.0:1789997853.518076:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704580352 00000100:00100000:1.0:1789997853.518129:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 589 00000100:00100000:1.0:1789997853.518141:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56572:x1876946704580352:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997853.518479:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56572:x1876946704580352:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 339us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997853.518487:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 589 00000100:00100000:3.0:1789997853.521737:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997853.522392:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704580480 00000100:00100000:0.0:1789997853.522402:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704580480 00000100:00100000:0.0:1789997853.522462:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1099 00000100:00100000:0.0:1789997853.522472:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56572:x1876946704580480:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997853.522875:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56572:x1876946704580480:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 403us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997853.522884:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1099 00000100:00100000:1.0:1789997853.592586:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997853.594141:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704580736 00000100:00100000:2.0:1789997853.594154:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704580736 00000100:00100000:2.0:1789997853.594277:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1100 00000100:00100000:2.0:1789997853.594289:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56576:x1876946704580736:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:2.0:1789997853.594342:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997853.594370:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0c4 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.594391:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:2.0:1789997853.594454:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997853.594481:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.594496:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.594511:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.594526:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.594534:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.594541:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.596500:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.596518:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.596528:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789997853.597753:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 64 off10368 00000004:00080000:0.0:1789997853.597767:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2042290112785ns, next at 2043290109529ns, rc = 0 00010000:00010000:0.0:1789997853.597868:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.597881:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.597893:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.597901:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.597907:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.597914:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.597954:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997853.597979:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.597985:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.597992:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598009:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997853.598014:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598022:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598033:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:0.0:1789997853.598047:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997853.598052:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598059:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592df47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598088:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997853.598091:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997853.598094:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997853.598098:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598099:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997853.598105:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997853.598105:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997853.598108:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598108:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997853.598115:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598119:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997853.598123:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff8a38c28e9800) 00010000:00010000:3.0:1789997853.598126:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789997853.598126:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:0.0:1789997853.598128:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997853.598129:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598131:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997853.598136:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997853.598137:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592df39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997853.598147:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d745d8c reply state 00000000bc5dbb21 transno 4294967717 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997853.598152:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997853.598154:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997853.598155:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997853.598155:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997853.598249:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56576:x1876946704580736:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 3958us (5669us total) trans 4294967717 rc 0/0 00000100:00100000:0.0:1789997853.598258:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1100 00010000:00010000:2.0:1789997853.602937:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.602955:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.602963:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.602970:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997853.602975:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.602983:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.603000:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0xecba81fd (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997853.603003:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997853.603009:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997853.603015:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592df40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997854.478053:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997854.999667:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997854.999707:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997854.999719:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704580864 00000100:00100000:2.0:1789997854.999729:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704580864 00000100:00100000:3.0:1789997854.999731:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997854.999750:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997854.999770:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704581120 00000100:00100000:3.0:1789997854.999773:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704581120 00000100:00100000:2.0:1789997854.999779:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1209 00000100:00100000:2.0:1789997854.999788:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704580864:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997854.999798:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704581248 00000100:00100000:3.0:1789997854.999800:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704581248 00000100:00100000:3.0:1789997854.999815:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1021 00000100:00100000:3.0:1789997854.999820:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704581120:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997854.999854:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704580864:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 67us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997854.999861:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1209 00000100:00100000:1.0:1789997855.000715:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1022 00000100:00100000:1.0:1789997855.000888:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704581248:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997855.000981:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704581120:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1158us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997855.000989:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1021 00000100:00100000:0.0:1789997855.001825:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704580992 00000100:00100000:0.0:1789997855.001834:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704580992 00000100:00100000:0.0:1789997855.001878:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1499 00000100:00100000:0.0:1789997855.001886:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704580992:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997855.001936:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704580992:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 51us (2203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997855.001942:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1499 00000100:00080000:0.0:1789997855.001973:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997855.001978:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997855.006148:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704581248:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 5407us (6379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997855.006164:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1022 00000100:00100000:1.0:1789997855.179026:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713061248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997855.179095:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997855.179263:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713061248 00000100:00100000:2.0:1789997855.179272:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713061248 00000004:00080000:0.0:1789997855.179272:0:7602:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2043871616875ns, next at 2044871614471ns, rc = 0 00000100:00100000:3.0:1789997855.179326:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997855.179339:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713061376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997855.179346:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1789997855.179358:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713061248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997855.179373:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789997855.179394:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997855.179411:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713061376 00000100:00100000:3.0:1789997855.179417:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713061376 00000100:00100000:3.0:1789997855.179445:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1789997855.179458:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713061376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997855.179459:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713061248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997855.179471:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00002000:00000024:3.0:1789997855.179481:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00080000:2.0:1789997855.179497:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997855.179503:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997855.179538:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713061248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997855.180265:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713061376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 800us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997855.180407:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1789997855.180456:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713061376:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789997855.359097:0:96617:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2044051440201ns, next at 2044871614471ns, rc = 0 00000004:00080000:1.0:1789997855.408883:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 97 committed 00000001:00080000:1.0:1789997855.408915:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967717 is committed 00000004:00080000:1.0:1789997855.408920:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 96 committed 00000004:00080000:1.0:1789997855.408926:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00000100:00100000:3.0:1789997855.409151:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713061504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789997855.409221:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997855.409546:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713061504 00000100:00100000:0.0:1789997855.409554:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713061504 00000100:00100000:0.0:1789997855.409600:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1789997855.409609:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713061504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997855.409636:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:34 count 1 00010000:00010000:0.0:1789997855.409683:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997855.409706:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997855.409714:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1789997855.409719:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789997855.409724:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997855.409751:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 5 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997855.409765:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 5 pid: 6659 timeout: 2144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997855.409776:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa898000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946713061632:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997855.411713:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b5ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789997855.415173:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997855.415526:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704581376 00000100:00100000:2.0:1789997855.415537:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704581376 00010000:00010000:2.0:1789997855.415609:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 6 pid: 6659 timeout: 2144 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997855.415753:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa898000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946713061632:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997855.415778:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789997855.415842:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997855.416024:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 426 00000100:00100000:2.0:1789997855.416036:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704581376:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997855.416050:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997855.416055:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 6 pid: 6659 timeout: 2144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997855.416067:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 6 pid: 6659 timeout: 2144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997855.416091:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067114deb/0x65b43101d592df32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0cb expref: 6 pid: 6659 timeout: 2144 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997855.416107:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997855.416112:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997855.416117:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997855.416126:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997855.416145:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997855.416202:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704581376:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 168us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997855.416209:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 426 00010000:00010000:0.0:1789997855.416387:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997855.416397:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997855.416406:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997855.416414:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997855.416433:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997855.417077:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713061504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7467us (7854us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789997855.417086:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000004:00080000:3.0:1789997855.417301:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3b9180/2, rc 0, transno 4294967365 00000100:00100000:3.0:1789997855.417322:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713061504:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1789997855.418254:0:96617:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2044110598297ns, next at 2025205918260ns, rc = 0 00010000:00010000:1.0:1789997855.419168:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997855.419179:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997855.419192:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997855.419197:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997855.419206:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997855.419239:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997855.419247:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093c46b9c/0x65b43101d592df55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997855.419274:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997855.419276:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997855.419278:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997855.420830:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00010000:00010000:3.0:1789997855.499409:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997856.524216:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997857.551244:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997858.253236:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713061760:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.253314:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997858.253361:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713062272:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.253389:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997858.253415:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789997858.253420:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713061888:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.253443:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997858.253461:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713062400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.253482:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997858.253510:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713062016:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.253531:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997858.253549:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997858.253822:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713062144:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.253847:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997858.253877:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713061760 00000100:00100000:2.0:1789997858.253884:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713061760 00000100:00100000:2.0:1789997858.253925:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1789997858.253932:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713061760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.253985:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713061760:12345-0@lo:400:kworker.0 Request processed in 53us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997858.253992:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1789997858.254020:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713062272 00000100:00100000:2.0:1789997858.254023:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713062272 00000100:00100000:2.0:1789997858.254049:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713062144 00000100:00100000:2.0:1789997858.254051:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713062144 00000100:00100000:2.0:1789997858.254127:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1789997858.254132:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713062272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254161:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713062272:12345-0@lo:400:kworker.0 Request processed in 29us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997858.254166:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1789997858.254176:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1789997858.254182:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713062144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254211:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713062144:12345-0@lo:400:kworker.0 Request processed in 29us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997858.254216:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1789997858.254232:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713061888 00000100:00100000:2.0:1789997858.254235:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713061888 00000100:00100000:2.0:1789997858.254259:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713062400 00000100:00100000:2.0:1789997858.254261:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713062400 00000100:00100000:2.0:1789997858.254278:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713062016 00000100:00100000:2.0:1789997858.254281:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713062016 00000100:00100000:2.0:1789997858.254298:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:2.0:1789997858.254304:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713061888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254334:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713061888:12345-0@lo:400:kworker.0 Request processed in 31us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997858.254340:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:2.0:1789997858.254351:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1789997858.254357:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713062400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254383:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713062400:12345-0@lo:400:kworker.0 Request processed in 27us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997858.254388:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1789997858.254398:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1789997858.254403:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713062016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254426:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713062016:12345-0@lo:400:kworker.0 Request processed in 23us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997858.254430:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00080000:2.0:1789997858.254452:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997858.254456:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997858.254458:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997858.254496:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713062144:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254506:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713062016:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254536:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713061888:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254544:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713062400:0@lo:400:kworker.0 00000100:00100000:2.0:1789997858.254552:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713061760:0@lo:400:kworker.0 00000100:00100000:3.0:1789997858.255092:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713062272:0@lo:400:kworker.0 00010000:00010000:3.0:1789997858.574122:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997858.851761:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00010000:00010000:1.0:1789997859.595795:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997860.119278:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997860.119367:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704581504 00000100:00100000:3.0:1789997860.119380:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704581504 00000100:00100000:3.0:1789997860.119449:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1211 00000100:00100000:3.0:1789997860.119459:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704581504:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997860.119542:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704581504:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997860.119550:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1211 00000100:00100000:3.0:1789997860.126439:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997860.126551:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997860.126834:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704581888 00000100:00100000:2.0:1789997860.126846:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704581888 00000100:00100000:2.0:1789997860.126927:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704581760 00000100:00100000:2.0:1789997860.126931:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704581760 00000100:00100000:2.0:1789997860.126958:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1025 00000100:00100000:2.0:1789997860.126969:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704581888:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997860.127040:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704581888:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997860.127047:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1025 00000100:00100000:2.0:1789997860.127064:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1026 00000100:00100000:2.0:1789997860.127070:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704581760:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997860.127110:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704581760:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997860.127117:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1026 00000100:00080000:3.0:1789997860.127746:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997860.127751:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997860.130925:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997860.132010:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704581632 00000100:00100000:1.0:1789997860.132022:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704581632 00000100:00100000:1.0:1789997860.132125:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1503 00000100:00100000:1.0:1789997860.132137:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704581632:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1789997860.132177:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997860.132220:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704581632:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997860.132229:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1503 00000100:00100000:2.0:1789997860.300190:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713062656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997860.300275:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997860.300347:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997860.300356:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713062528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997860.300381:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997860.300413:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713062656 00000100:00100000:2.0:1789997860.300420:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713062656 00000100:00100000:2.0:1789997860.300474:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713062528 00000100:00100000:2.0:1789997860.300477:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713062528 00000100:00100000:2.0:1789997860.300495:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1789997860.300503:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713062656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997860.300535:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997860.300580:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713062656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997860.300588:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1789997860.300603:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1789997860.300610:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713062528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997860.300626:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997860.300666:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713062528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997860.300673:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00080000:2.0:1789997860.300689:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997860.300692:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997860.300717:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:2.0:1789997860.300722:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3b9180, transno 4294967365 00000100:00100000:2.0:1789997860.300740:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713062528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997860.300755:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713062656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997860.620434:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997861.643001:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997862.669720:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997863.370967:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713063040:0@lo:400:kworker.0 00000100:00100000:2.0:1789997863.371039:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997863.371043:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713062784:0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371085:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997863.371119:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997863.371122:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713063296:0@lo:400:kworker.0 00000100:00100000:2.0:1789997863.371130:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713063168:0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371158:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997863.371185:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713063040 00000100:00100000:2.0:1789997863.371193:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713063040 00000100:00100000:0.0:1789997863.371209:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789997863.371217:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713062912:0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371246:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997863.371251:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1789997863.371261:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713063040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371271:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713063424:0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371294:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997863.371323:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713063040:12345-0@lo:400:kworker.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997863.371331:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713062784 00000100:00100000:2.0:1789997863.371332:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1789997863.371338:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713062784 00000100:00100000:2.0:1789997863.371351:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713062912 00000100:00100000:2.0:1789997863.371356:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713062912 00000100:00100000:0.0:1789997863.371378:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1789997863.371380:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713063424 00000100:00100000:2.0:1789997863.371384:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713063424 00000100:00100000:0.0:1789997863.371388:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713062784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997863.371410:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1789997863.371418:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713062912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371449:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713062784:12345-0@lo:400:kworker.0 Request processed in 62us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997863.371457:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713062912:12345-0@lo:400:kworker.0 Request processed in 38us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997863.371462:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1789997863.371470:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1789997863.371486:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1789997863.371493:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713063424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371500:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713063296 00000100:00100000:0.0:1789997863.371505:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713063296 00000100:00100000:2.0:1789997863.371527:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713063424:12345-0@lo:400:kworker.0 Request processed in 35us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997863.371535:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1789997863.371540:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1789997863.371550:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713063296:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789997863.371555:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997863.371562:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997863.371587:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713063296:12345-0@lo:400:kworker.0 Request processed in 40us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997863.371594:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1789997863.371628:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997863.371689:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713062912:0@lo:400:kworker.0 00000100:00100000:2.0:1789997863.371692:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713063040:0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371708:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713063424:0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371718:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713062784:0@lo:400:kworker.0 00000100:00100000:0.0:1789997863.371728:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713063296:0@lo:400:kworker.0 00000100:00100000:1.0:1789997863.371975:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713063168 00000100:00100000:1.0:1789997863.371980:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713063168 00000100:00100000:1.0:1789997863.372028:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1789997863.372036:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713063168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997863.372091:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713063168:12345-0@lo:400:kworker.0 Request processed in 57us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997863.372099:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1789997863.372129:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713063168:0@lo:400:kworker.0 00000100:00080000:2.0:1789997863.372318:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997863.690987:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997864.714944:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997865.238897:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997865.238948:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997865.238986:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997865.239018:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997865.239133:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704582272 00000100:00100000:1.0:1789997865.239143:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704582272 00000100:00100000:1.0:1789997865.239205:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704582400 00000100:00100000:1.0:1789997865.239209:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704582400 00000100:00100000:0.0:1789997865.239214:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704582016 00000100:00100000:0.0:1789997865.239221:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704582016 00000100:00100000:1.0:1789997865.239246:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1029 00000100:00100000:1.0:1789997865.239259:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704582272:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997865.239269:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1213 00000100:00100000:0.0:1789997865.239282:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704582016:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1789997865.239337:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997865.239343:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997865.239343:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704582272:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997865.239353:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1029 00000100:00100000:1.0:1789997865.239372:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1030 00000100:00100000:1.0:1789997865.239382:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704582400:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997865.239396:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704582144 00000100:00100000:2.0:1789997865.239402:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704582144 00000100:00100000:2.0:1789997865.239642:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1507 00000100:00100000:2.0:1789997865.239691:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704582144:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997865.240280:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704582016:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 998us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997865.240288:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1213 00000100:00080000:0.0:1789997865.240331:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997865.240354:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704582400:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 972us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997865.240364:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1030 00000100:00100000:2.0:1789997865.242633:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704582144:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 2972us (3635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997865.242646:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1507 00000100:00100000:2.0:1789997865.419070:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997865.419095:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713063552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997865.419169:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997865.419372:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713063680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997865.419402:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997865.419487:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713063552 00000100:00100000:0.0:1789997865.419496:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713063552 00000100:00100000:0.0:1789997865.419570:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713063680 00000100:00100000:0.0:1789997865.419574:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713063680 00000100:00100000:0.0:1789997865.419594:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1789997865.419605:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713063552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997865.419650:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997865.419736:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713063552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997865.419744:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1789997865.419762:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1789997865.419769:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713063680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997865.419787:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997865.419830:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713063680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997865.419836:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00080000:2.0:1789997865.420065:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997865.420071:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997865.420107:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713063680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997865.420124:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713063552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997865.741406:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997866.763177:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997867.788079:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997868.490964:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713064192:0@lo:400:kworker.0 00000100:00100000:1.0:1789997868.490989:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713064064:0@lo:400:kworker.0 00000100:00100000:0.0:1789997868.491021:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713063808:0@lo:400:kworker.0 00000100:00100000:3.0:1789997868.491919:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713063936:0@lo:400:kworker.0 00000100:00100000:1.0:1789997868.494620:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997868.496121:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713064064 00000100:00100000:1.0:1789997868.496134:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713064064 00000100:00100000:1.0:1789997868.496200:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1789997868.496213:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713064064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997868.496297:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713064064:12345-0@lo:400:kworker.0 Request processed in 89us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997868.496305:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:1.0:1789997868.496349:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713064064:0@lo:400:kworker.0 00000100:00100000:2.0:1789997868.496447:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997868.496481:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713064192 00000100:00100000:2.0:1789997868.496485:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713064192 00000100:00080000:1.0:1789997868.496511:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997868.496517:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997868.496649:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1789997868.496676:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713064192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997868.496712:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713064192:12345-0@lo:400:kworker.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997868.496718:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1789997868.496765:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713064192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997868.498202:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997868.498203:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997868.498312:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713064448:0@lo:400:kworker.0 00000100:00100000:3.0:1789997868.498348:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997868.498408:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713063808 00000100:00100000:2.0:1789997868.498416:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713063808 00000100:00100000:1.0:1789997868.498440:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713063936 00000100:00100000:1.0:1789997868.498446:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713063936 00000100:00100000:0.0:1789997868.498470:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713064320:0@lo:400:kworker.0 00000100:00100000:1.0:1789997868.498488:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713064448 00000100:00100000:1.0:1789997868.498492:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713064448 00000100:00100000:0.0:1789997868.498506:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997868.498529:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:1.0:1789997868.498540:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713063936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997868.498560:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:0.0:1789997868.498572:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713064448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997868.498589:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713063936:12345-0@lo:400:kworker.0 Request processed in 51us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997868.498616:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1789997868.498616:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713064448:12345-0@lo:400:kworker.0 Request processed in 47us (266us total) trans 0 rc 0/0 00000100:00080000:1.0:1789997868.498650:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997868.498691:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713064320 00000100:00100000:1.0:1789997868.498695:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713064320 00000100:00100000:2.0:1789997868.498724:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1789997868.498733:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:2.0:1789997868.498736:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713063808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997868.498765:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713064320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997868.498795:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713063808:12345-0@lo:400:kworker.0 Request processed in 62us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997868.498804:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1789997868.498808:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713064320:12345-0@lo:400:kworker.0 Request processed in 43us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997868.498816:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00080000:1.0:1789997868.498837:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997868.498883:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713063808:0@lo:400:kworker.0 00000100:00100000:2.0:1789997868.498884:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713064448:0@lo:400:kworker.0 00000100:00100000:1.0:1789997868.498900:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713064320:0@lo:400:kworker.0 00000100:00100000:0.0:1789997868.499718:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1789997868.499813:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713063936:0@lo:400:kworker.0 00010000:00010000:1.0:1789997868.810867:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997869.834963:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997870.359605:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997870.359682:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997870.359747:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997870.359765:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704582912 00000100:00100000:3.0:1789997870.359778:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704582912 00000100:00100000:2.0:1789997870.359790:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997870.359909:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704582784 00000100:00100000:3.0:1789997870.359914:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704582784 00000100:00100000:0.0:1789997870.359932:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704582528 00000100:00100000:0.0:1789997870.359938:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704582528 00000100:00100000:0.0:1789997870.360033:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1215 00000100:00100000:0.0:1789997870.360046:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704582528:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997870.360142:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704582528:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 97us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997870.360150:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1215 00000100:00100000:0.0:1789997870.360324:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704582656 00000100:00100000:0.0:1789997870.360329:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704582656 00000100:00100000:0.0:1789997870.360363:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1511 00000100:00100000:0.0:1789997870.360370:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704582656:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997870.360407:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704582656:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997870.360414:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1511 00000100:00080000:0.0:1789997870.360459:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997870.360465:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997870.360467:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997870.360980:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1033 00000100:00100000:2.0:1789997870.360991:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704582912:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997870.361095:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704582912:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 106us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997870.361102:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1033 00000100:00100000:2.0:1789997870.361119:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1034 00000100:00100000:2.0:1789997870.361125:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704582784:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997870.361165:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704582784:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997870.361172:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1034 00000100:00100000:0.0:1789997870.536056:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997870.536213:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704583040 00000100:00100000:1.0:1789997870.536224:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704583040 00000100:00100000:1.0:1789997870.536291:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1101 00000100:00100000:1.0:1789997870.536302:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56794:x1876946704583040:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997870.536444:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56794:x1876946704583040:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 144us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997870.536452:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1101 00000100:00100000:2.0:1789997870.538978:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713064576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997870.539051:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997870.539685:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997870.539696:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713064704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997870.539742:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997870.541537:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997870.541562:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704583168 00000100:00100000:2.0:1789997870.541568:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704583168 00000100:00100000:2.0:1789997870.541624:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 591 00000100:00100000:2.0:1789997870.541635:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56794:x1876946704583168:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997870.542337:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56794:x1876946704583168:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 702us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997870.542346:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 591 00000100:00100000:3.0:1789997870.548718:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713064576 00000100:00100000:3.0:1789997870.548735:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713064576 00000100:00100000:3.0:1789997870.548832:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713064704 00000100:00100000:3.0:1789997870.548836:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713064704 00000100:00100000:3.0:1789997870.548860:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1789997870.548871:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713064576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997870.548921:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997870.549027:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713064576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (9975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997870.549035:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1789997870.549056:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1789997870.549064:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713064704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997870.549083:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997870.549115:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713064704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (9372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997870.549120:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00080000:0.0:1789997870.549520:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997870.549525:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997870.549572:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713064704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997870.549589:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713064576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997870.554244:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997870.554380:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704583296 00000100:00100000:1.0:1789997870.554391:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704583296 00000100:00100000:1.0:1789997870.554454:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 592 00000100:00100000:1.0:1789997870.554466:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56794:x1876946704583296:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997870.554881:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56794:x1876946704583296:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 417us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997870.554890:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 592 00000100:00100000:1.0:1789997870.557138:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997870.559059:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704583424 00000100:00100000:3.0:1789997870.559074:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704583424 00000100:00100000:3.0:1789997870.559146:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1102 00000100:00100000:3.0:1789997870.559157:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56794:x1876946704583424:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997870.559639:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56794:x1876946704583424:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 475us (2502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997870.559648:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1102 00000100:00100000:0.0:1789997870.563240:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997870.563417:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704583552 00000100:00100000:2.0:1789997870.563426:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704583552 00000100:00100000:2.0:1789997870.563478:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1103 00000100:00100000:2.0:1789997870.563488:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56794:x1876946704583552:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997870.563593:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56794:x1876946704583552:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 105us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997870.563601:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1103 00000100:00100000:1.0:1789997870.567922:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997870.573911:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704583680 00000100:00100000:3.0:1789997870.573928:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704583680 00000100:00100000:3.0:1789997870.574116:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 593 00000100:00100000:3.0:1789997870.574128:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56794:x1876946704583680:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997870.574753:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56794:x1876946704583680:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 625us (6839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997870.574761:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 593 00000100:00100000:1.0:1789997870.588215:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997870.588357:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704583808 00000100:00100000:0.0:1789997870.588759:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704583808 00000100:00100000:0.0:1789997870.588822:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 594 00000100:00100000:0.0:1789997870.588833:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56794:x1876946704583808:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997870.589253:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:56794:x1876946704583808:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 420us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997870.589262:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 594 00000100:00100000:1.0:1789997870.598890:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997870.599109:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704583936 00000100:00100000:0.0:1789997870.599120:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704583936 00000100:00100000:0.0:1789997870.599179:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1104 00000100:00100000:0.0:1789997870.599190:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56794:x1876946704583936:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997870.599772:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56794:x1876946704583936:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 582us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997870.599780:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1104 00000100:00100000:0.0:1789997870.650772:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997870.650813:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704584064 00000100:00100000:0.0:1789997870.650823:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704584064 00000100:00100000:0.0:1789997870.650873:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1105 00000100:00100000:0.0:1789997870.650882:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:56795:x1876946704584064:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997870.650903:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997870.650926:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0d2 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997870.651106:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997870.651122:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997870.651149:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997870.651186:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00000004:00200000:0.0:1789997870.651190:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997870.651209:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997870.651233:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592df5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0d2 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997870.651263:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0d2 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997870.651271:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:0.0:1789997870.651274:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997870.651278:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997870.651485:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56795:x1876946704584064:12345-192.168.204.4@tcp:101:rm.0 Request processed in 603us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997870.651494:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1105 00000100:00100000:0.0:1789997870.656277:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997870.656327:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704584320 00000100:00100000:2.0:1789997870.656338:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704584320 00000100:00100000:2.0:1789997870.656388:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1106 00000100:00100000:2.0:1789997870.656399:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56795:x1876946704584320:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997870.656419:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997870.656441:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0d9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997870.656529:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 16384 00010000:00010000:2.0:1789997870.656785:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df6a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0d9 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.656801:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997870.656804:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789997870.656809:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0d9 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.656825:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997870.656877:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56795:x1876946704584320:12345-192.168.204.4@tcp:101:rm.0 Request processed in 480us (608us total) trans 4294967718 rc 301/301 00000100:00100000:2.0:1789997870.656885:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1106 00000100:00100000:3.0:1789997870.663949:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997870.664143:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704584448 00000100:00100000:0.0:1789997870.664155:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704584448 00000100:00100000:0.0:1789997870.664215:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 112 00000100:00100000:0.0:1789997870.664225:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56795:x1876946704584448:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:1.0:1789997870.675453:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56795:x1876946704584448:12345-192.168.204.4@tcp:37:rm.0 Request processed in 11217us (11515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997870.675467:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 112 00000100:00100000:2.0:1789997870.680221:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997870.682745:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704584704 00000100:00100000:1.0:1789997870.682761:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704584704 00000100:00100000:1.0:1789997870.682880:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 113 00000100:00100000:1.0:1789997870.682894:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:56795:x1876946704584704:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:1.0:1789997870.683291:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:56795:x1876946704584704:12345-192.168.204.4@tcp:35:rm.0 Request processed in 400us (3079us total) trans 4294967719 rc 0/0 00000100:00100000:1.0:1789997870.683299:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 113 00000100:00100000:0.0:1789997870.689211:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997870.689280:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704584960 00000100:00100000:1.0:1789997870.689293:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704584960 00000100:00100000:1.0:1789997870.689347:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1107 00000100:00100000:1.0:1789997870.689366:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:56795:x1876946704584960:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997870.689429:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789997870.689733:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592df63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0d2 expref: 9 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997870.689759:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592df08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0bd expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997870.689786:0:6536:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 65b43101d592db6c) 00010000:00010000:1.0:1789997870.689791:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38ee49e200) 00010000:00010000:1.0:1789997870.689804:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997870.689829:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997870.689842:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997870.689853:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997870.689865:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997870.689872:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997870.689879:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691580:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691598:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691608:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691737:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691746:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691753:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691759:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997870.691764:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691772:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691783:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997870.691786:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997870.691790:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691796:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592df86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691819:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691825:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691831:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691836:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997870.691839:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691844:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691851:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:2.0:1789997870.691853:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997870.691855:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691861:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592df78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691871:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691876:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691882:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.691888:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997870.691891:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.693323:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.693341:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8a38e062d300) 00010000:00010000:2.0:1789997870.693345:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997870.693350:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997870.693357:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592df7f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997870.693683:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:56795:x1876946704584960:12345-192.168.204.4@tcp:36:rm.0 Request processed in 4295us (4452us total) trans 0 rc -13/-13 00000100:00100000:2.0:1789997870.693692:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1107 00010000:00010000:2.0:1789997870.858878:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997871.113425:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967719 is committed 00010000:00010000:2.0:1789997871.887584:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997871.904283:0:96836:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffcb747700 20000000:00000080:0.0:1789997871.904302:0:96836:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fad8e400 uarg=0000000000000000 00010000:00010000:0.0:1789997871.909798:0:96836:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789997871.909821:0:96836:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789997871.909871:0:96836:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997871.909891:0:96836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997871.909909:0:96836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dee5 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997871.909917:0:96836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997871.909957:0:96836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dee5 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997871.909972:0:96836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dee5 expref: 18 pid: 5805 timeout: 2160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997871.909987:0:96836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa899880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96836:1876946713064832:0@lo:104: 00000100:00100000:0.0:1789997871.910050:0:96836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997871.910111:0:96836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789997871.910613:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713064832 00000100:00100000:3.0:1789997871.910621:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713064832 00000100:00100000:3.0:1789997871.910723:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789997871.910734:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:96836:x1876946713064832:12345-0@lo:104: 00010000:00010000:3.0:1789997871.910747:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997871.910825:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997871.910831:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:96836:x1876946713064832:12345-0@lo:104: Request processed in 100us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997871.910838:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789997871.910871:0:96836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa899880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96836:1876946713064832:0@lo:104: 00010000:00010000:0.0:1789997871.910890:0:96836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.910943:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997871.910950:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.910957:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997871.910962:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.910971:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997871.910977:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997871.910982:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997871.911020:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.911027:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997871.911059:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.911066:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592dee5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592deec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997871.911074:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789997871.911081:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997871.911082:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997871.911084:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997871.911085:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713064960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997871.911117:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997871.911441:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713064960 00000100:00100000:1.0:1789997871.911446:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713064960 00010000:00010000:1.0:1789997871.912073:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dee5 expref: 19 pid: 5805 timeout: 2160 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997871.912141:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1789997871.912149:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713064960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997871.912161:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997871.912166:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dee5 expref: 19 pid: 5805 timeout: 2160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912178:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dee5 expref: 19 pid: 5805 timeout: 2160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912193:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3200/0x65b43101d592deec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dee5 expref: 19 pid: 5805 timeout: 2160 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912206:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912216:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912230:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912238:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912245:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912251:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912257:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997871.912261:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.912269:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997871.912421:0:96836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997871.912429:0:96836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.913706:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.913721:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592df8d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997871.913974:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997871.914112:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713064960:12345-0@lo:103:ldlm_bl.0 Request processed in 1961us (2992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997871.914121:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1789997871.914189:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713064960:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789997872.731528:0:96884:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe56cb2010 20000000:00000080:3.0:1789997872.731547:0:96884:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faae2800 uarg=0000000000000000 00010000:00010000:3.0:1789997872.731999:0:96884:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997872.732016:0:96884:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997872.732035:0:96884:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997872.732056:0:96884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732072:0:96884:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732083:0:96884:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732090:0:96884:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732098:0:96884:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732105:0:96884:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732111:0:96884:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997872.732115:0:96884:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732128:0:96884:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732142:0:96884:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732150:0:96884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997872.732156:0:96884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b200/0x65b43101d592df94 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997872.907166:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789997873.581484:0:96932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe8017f930 20000000:00000080:2.0:1789997873.581501:0:96932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fadcbc00 uarg=0000000000000000 00010000:00010000:2.0:1789997873.581781:0:96932:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789997873.581797:0:96932:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789997873.581814:0:96932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789997873.581833:0:96932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581848:0:96932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581861:0:96932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581869:0:96932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581877:0:96932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581884:0:96932:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581890:0:96932:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997873.581895:0:96932:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581902:0:96932:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581917:0:96932:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581925:0:96932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997873.581931:0:96932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592df9b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997873.611602:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713065216:0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.611716:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997873.611770:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713065728:0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.611804:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997873.611830:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789997873.611836:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713065344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.611858:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997873.611903:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713065216 00000100:00100000:3.0:1789997873.611911:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713065216 00000100:00100000:3.0:1789997873.611953:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713065728 00000100:00100000:3.0:1789997873.611956:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713065728 00000100:00100000:3.0:1789997873.611982:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713065344 00000100:00100000:3.0:1789997873.611985:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713065344 00000100:00100000:3.0:1789997873.612008:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1789997873.612017:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713065216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.612069:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713065216:12345-0@lo:400:kworker.0 Request processed in 52us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997873.612077:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1789997873.612093:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1789997873.612099:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713065728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.612124:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713065728:12345-0@lo:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997873.612130:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1789997873.612139:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1789997873.612145:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713065344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.612169:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713065344:12345-0@lo:400:kworker.0 Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997873.612175:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00080000:3.0:1789997873.612205:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997873.612241:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713065344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.612252:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713065216:0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.612259:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713065728:0@lo:400:kworker.0 00000100:00100000:0.0:1789997873.612549:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713065088:0@lo:400:kworker.0 00000100:00100000:0.0:1789997873.612587:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997873.612632:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713065600:0@lo:400:kworker.0 00000100:00100000:0.0:1789997873.612686:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997873.612708:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997873.612714:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713065472:0@lo:400:kworker.0 00000100:00100000:0.0:1789997873.612735:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997873.612759:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713065600 00000100:00100000:0.0:1789997873.612763:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713065600 00000100:00100000:0.0:1789997873.612806:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713065472 00000100:00100000:0.0:1789997873.612809:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713065472 00000100:00100000:0.0:1789997873.612830:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1789997873.612837:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713065600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.613047:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713065088 00000100:00100000:3.0:1789997873.613053:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713065088 00000100:00100000:1.0:1789997873.613077:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1789997873.613087:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1789997873.613093:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713065472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997873.613100:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713065088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997873.613145:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713065472:12345-0@lo:400:kworker.0 Request processed in 58us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997873.613152:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713065088:12345-0@lo:400:kworker.0 Request processed in 55us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997873.613157:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1789997873.613165:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00080000:3.0:1789997873.613205:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997873.613209:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997873.613256:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713065472:0@lo:400:kworker.0 00000100:00100000:0.0:1789997873.613257:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713065600:12345-0@lo:400:kworker.0 Request processed in 420us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997873.613269:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1789997873.613276:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713065088:0@lo:400:kworker.0 00000100:00100000:1.0:1789997873.613290:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713065600:0@lo:400:kworker.0 10000000:01000000:1.0:1789997873.740054:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997873.740063:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997873.740069:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997873.740118:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997873.740131:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997873.740142:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997873.740167:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713065856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997873.740231:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997873.740279:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789997873.741642:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713065856 00000100:00100000:0.0:1789997873.742072:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713065856 00000100:00100000:0.0:1789997873.742151:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:0.0:1789997873.742162:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713065856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997873.742177:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997873.742195:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dfa2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997873.742222:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997873.742233:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997873.742242:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997873.742312:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713065856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (2080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997873.742319:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1789997873.742630:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713065856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997873.742684:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997873.742693:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997873.742714:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997873.742719:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997873.742726:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997873.937123:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997874.965480:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997875.478776:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997875.478916:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704585216 00000100:00100000:3.0:1789997875.478926:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704585216 00000100:00100000:3.0:1789997875.479004:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1515 00000100:00100000:3.0:1789997875.479015:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585216:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997875.479086:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585216:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997875.479095:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1515 00000100:00080000:0.0:1789997875.479382:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997875.480686:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997875.480868:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704585472 00000100:00100000:3.0:1789997875.480877:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704585472 00000100:00100000:3.0:1789997875.480945:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1037 00000100:00100000:3.0:1789997875.480957:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585472:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997875.481017:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585472:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997875.481025:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1037 00000100:00080000:0.0:1789997875.481191:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997875.490046:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997875.490096:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997875.490128:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704585344 00000100:00100000:0.0:1789997875.490151:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704585344 00000100:00100000:0.0:1789997875.490218:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1038 00000100:00100000:0.0:1789997875.490230:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585344:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997875.490307:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585344:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997875.490315:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1038 00000100:00080000:0.0:1789997875.490342:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997875.490516:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704585088 00000100:00100000:2.0:1789997875.490522:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704585088 00000100:00100000:2.0:1789997875.490565:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1218 00000100:00100000:2.0:1789997875.490582:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704585088:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997875.490630:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704585088:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 58us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997875.490637:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1218 00000100:00100000:1.0:1789997875.660056:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997875.660279:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713066112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997875.660361:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997875.660473:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713066112 00000100:00100000:2.0:1789997875.660483:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713066112 00000100:00100000:2.0:1789997875.660557:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:2.0:1789997875.660567:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713066112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997875.660601:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997875.660697:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713065984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997875.660725:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997875.660757:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713065984 00000100:00100000:1.0:1789997875.660761:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713065984 00000100:00100000:1.0:1789997875.660783:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1789997875.660789:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713065984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997875.660809:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997875.660842:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713065984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997875.660848:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:1.0:1789997875.660891:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713065984:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997875.660925:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997875.660930:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997875.661239:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713066112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 672us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997875.661246:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1789997875.661361:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713066112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997875.978814:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997876.974463:0:97128:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd6fc5f00 20000000:00000080:1.0:1789997876.974481:0:97128:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa4800 uarg=0000000000000000 00010000:00010000:1.0:1789997876.975121:0:97128:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789997876.975138:0:97128:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789997876.975167:0:97128:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997876.975184:0:97128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997876.975313:0:97128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997876.975321:0:97128:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997876.975360:0:97128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997876.975375:0:97128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 18 pid: 5803 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997876.975389:0:97128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97128:1876946713066240:0@lo:104: 00000100:00100000:1.0:1789997876.975456:0:97128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997876.975568:0:97128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789997876.975727:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789997876.975741:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713066240 00000100:00100000:3.0:1789997876.975748:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713066240 00000100:00100000:3.0:1789997876.975903:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789997876.975914:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b12450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97128:x1876946713066240:12345-0@lo:104: 00010000:00010000:3.0:1789997876.975928:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997876.976004:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997876.976010:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b12450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97128:x1876946713066240:12345-0@lo:104: Request processed in 99us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997876.976018:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00010000:2.0:1789997876.976086:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997876.976094:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976102:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997876.976106:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976115:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997876.976123:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997876.976132:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997876.976174:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976181:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997876.976207:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976215:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dfa2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976231:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997876.976233:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997876.976235:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997876.976252:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713066368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997876.976281:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997876.976314:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713066368 00000100:00100000:2.0:1789997876.976318:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713066368 00010000:00010000:2.0:1789997876.976334:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 19 pid: 5803 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997876.976354:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1789997876.976359:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713066368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997876.976369:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997876.976373:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 19 pid: 5803 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976382:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 19 pid: 5803 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976397:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976406:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976419:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976426:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976433:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976440:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976444:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997876.976448:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976454:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976462:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997876.976470:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997876.976497:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713066368:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997876.976506:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1789997876.976541:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713066368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997876.976713:0:97128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592dfa9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dfa2 expref: 18 pid: 5803 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997876.976733:0:97128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97128:1876946713066240:0@lo:104: 00010000:00010000:1.0:1789997876.976746:0:97128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997876.976759:0:97128:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997876.976766:0:97128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997876.976772:0:97128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592dfb0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997877.006363:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997878.026905:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997878.731040:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713066496:0@lo:400:kworker.0 00000100:00100000:1.0:1789997878.731113:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997878.731157:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713067008:0@lo:400:kworker.0 00000100:00100000:1.0:1789997878.731190:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997878.731216:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789997878.731221:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713066624:0@lo:400:kworker.0 00000100:00100000:1.0:1789997878.731243:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997878.731314:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713067136:0@lo:400:kworker.0 00000100:00100000:1.0:1789997878.731348:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997878.731383:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713066752:0@lo:400:kworker.0 00000100:00100000:1.0:1789997878.731406:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997878.731437:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997878.731443:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713066880:0@lo:400:kworker.0 00000100:00100000:1.0:1789997878.731464:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997878.731497:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713066496 00000100:00100000:1.0:1789997878.731505:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713066496 00000100:00100000:1.0:1789997878.731564:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1789997878.731573:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713066496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997878.731618:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713066496:12345-0@lo:400:kworker.0 Request processed in 46us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997878.731625:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1789997878.731705:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713066496:0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.731859:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713067008 00000100:00100000:3.0:1789997878.731864:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713067008 00000100:00100000:3.0:1789997878.731907:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713066880 00000100:00100000:3.0:1789997878.731910:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713066880 00000100:00100000:3.0:1789997878.731931:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1789997878.731939:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713067008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.731984:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713067008:12345-0@lo:400:kworker.0 Request processed in 46us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997878.731990:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1789997878.732004:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1789997878.732010:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713066880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.732042:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713066880:12345-0@lo:400:kworker.0 Request processed in 32us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997878.732047:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1789997878.732064:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713066624 00000100:00100000:3.0:1789997878.732068:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713066624 00000100:00100000:3.0:1789997878.732109:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713067136 00000100:00100000:3.0:1789997878.732112:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713067136 00000100:00100000:3.0:1789997878.732127:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713066752 00000100:00100000:3.0:1789997878.732130:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713066752 00000100:00100000:3.0:1789997878.732146:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:3.0:1789997878.732153:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713066624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.732182:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713066624:12345-0@lo:400:kworker.0 Request processed in 30us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997878.732189:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:3.0:1789997878.732200:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1789997878.732205:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713067136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.732231:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713067136:12345-0@lo:400:kworker.0 Request processed in 26us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997878.732239:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1789997878.732249:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:3.0:1789997878.732254:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713066752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.732279:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713066752:12345-0@lo:400:kworker.0 Request processed in 25us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997878.732285:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:3.0:1789997878.732336:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713066880:0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.732347:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713066752:0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.732388:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713066624:0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.732398:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713067136:0@lo:400:kworker.0 00000100:00100000:3.0:1789997878.732406:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713067008:0@lo:400:kworker.0 00000100:00080000:1.0:1789997878.732511:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997878.732517:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997878.732519:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1789997878.922881:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997878.922890:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997878.922896:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997878.922946:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997878.922959:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997878.922971:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997878.922997:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713067264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997878.923065:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997878.923113:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713067264 00000100:00100000:2.0:1789997878.923114:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789997878.923134:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713067264 00000100:00100000:1.0:1789997878.923189:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:1.0:1789997878.923200:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713067264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997878.923213:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997878.923227:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dfb7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997878.923250:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997878.923260:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997878.923269:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997878.923316:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713067264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997878.923323:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1789997878.923991:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713067264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997878.924009:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997878.924019:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997878.924039:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997878.924044:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997878.924052:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997879.052454:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997880.075038:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997880.601178:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997880.601218:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997880.601249:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704585600 00000100:00100000:0.0:1789997880.601251:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997880.601263:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704585600 00000100:00100000:0.0:1789997880.601297:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997880.601320:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1221 00000100:00100000:1.0:1789997880.601334:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704585600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997880.601425:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704585728 00000100:00100000:2.0:1789997880.601430:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704585728 00000100:00100000:2.0:1789997880.601475:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1519 00000100:00100000:2.0:1789997880.601483:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585728:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997880.601533:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704585856 00000100:00100000:3.0:1789997880.601538:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704585856 00000100:00100000:3.0:1789997880.601573:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704585984 00000100:00100000:2.0:1789997880.601573:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585728:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 89us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997880.601577:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704585984 00000100:00100000:2.0:1789997880.601597:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1519 00000100:00100000:3.0:1789997880.601603:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1041 00000100:00100000:3.0:1789997880.601613:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704585856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997880.601647:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704585856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997880.601683:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1041 00000100:00100000:3.0:1789997880.601706:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1042 00000100:00100000:3.0:1789997880.601714:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997880.601755:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704585984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997880.601762:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1042 00000100:00080000:1.0:1789997880.601867:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997880.601872:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997880.601875:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997880.602629:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704585600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1294us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997880.602639:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1221 00000100:00100000:1.0:1789997880.779203:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713067392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997880.779274:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997880.779339:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997880.779346:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713067520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997880.779370:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997880.782881:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713067392 00000100:00100000:2.0:1789997880.782900:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713067392 00000100:00100000:2.0:1789997880.783019:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713067520 00000100:00100000:2.0:1789997880.783023:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713067520 00000100:00100000:0.0:1789997880.783157:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1789997880.783171:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713067392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997880.783212:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997880.783308:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713067392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (4033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997880.783316:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1789997880.784905:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713067392:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997880.786294:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997880.786302:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997880.787619:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1789997880.787638:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713067520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997880.787705:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997880.787931:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713067520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 300us (8558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997880.787940:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1789997880.788049:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713067520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997881.099012:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997882.126466:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997883.146925:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997883.850910:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713067904:0@lo:400:kworker.0 00000100:00100000:1.0:1789997883.850979:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997883.851034:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997883.851041:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713068032:0@lo:400:kworker.0 00000100:00100000:1.0:1789997883.851068:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997883.851177:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713067776:0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.851221:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997883.851245:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713068288:0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.851264:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997883.851282:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789997883.851287:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713067648:0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.851313:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997883.851622:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713068160:0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.851668:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997883.851710:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713067904 00000100:00100000:0.0:1789997883.851717:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713067904 00000100:00100000:0.0:1789997883.851769:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713067776 00000100:00100000:0.0:1789997883.851772:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713067776 00000100:00100000:0.0:1789997883.851789:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713068288 00000100:00100000:0.0:1789997883.851791:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713068288 00000100:00100000:0.0:1789997883.851813:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1789997883.851821:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713067904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.851874:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713067904:12345-0@lo:400:kworker.0 Request processed in 54us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997883.851882:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1789997883.851898:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1789997883.851904:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713067776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.851935:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713067776:12345-0@lo:400:kworker.0 Request processed in 31us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997883.851941:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1789997883.851951:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1789997883.851957:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713068288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.851982:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713068288:12345-0@lo:400:kworker.0 Request processed in 25us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997883.851987:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00080000:0.0:1789997883.852005:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997883.852036:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713067904:0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.852066:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713067776:0@lo:400:kworker.0 00000100:00100000:0.0:1789997883.852075:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713068288:0@lo:400:kworker.0 00000100:00100000:3.0:1789997883.852205:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713068032 00000100:00100000:3.0:1789997883.852209:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713068032 00000100:00100000:3.0:1789997883.852249:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713068160 00000100:00100000:3.0:1789997883.852253:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713068160 00000100:00100000:3.0:1789997883.852273:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1789997883.852280:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713068032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997883.852327:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713068032:12345-0@lo:400:kworker.0 Request processed in 48us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997883.852333:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1789997883.852356:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1789997883.852363:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713068160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997883.852396:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713068160:12345-0@lo:400:kworker.0 Request processed in 34us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997883.852402:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1789997883.852431:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713068032:0@lo:400:kworker.0 00000100:00100000:3.0:1789997883.852468:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713068160:0@lo:400:kworker.0 00000100:00080000:0.0:1789997883.853031:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997883.853036:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997883.853111:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713067648 00000100:00100000:3.0:1789997883.853118:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713067648 00000100:00100000:3.0:1789997883.853156:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1789997883.853164:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713067648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997883.853323:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713067648:12345-0@lo:400:kworker.0 Request processed in 160us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997883.853330:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1789997883.853475:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713067648:0@lo:400:kworker.0 00010000:00010000:2.0:1789997884.173478:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789997885.164091:0:97473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 22: test nodemap mapped_trusted_admin fileops ========================================================== 09:38:03 (1789997883) 00010000:00010000:2.0:1789997885.194875:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997885.722578:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997885.722628:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997885.722699:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997885.722723:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997885.722751:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704586496 00000100:00100000:0.0:1789997885.722761:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704586496 00000100:00100000:0.0:1789997885.722817:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704586368 00000100:00100000:0.0:1789997885.722820:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704586368 00000100:00100000:0.0:1789997885.722847:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1045 00000100:00100000:0.0:1789997885.722860:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704586496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997885.722933:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704586496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997885.722940:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1045 00000100:00100000:0.0:1789997885.722958:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1046 00000100:00100000:0.0:1789997885.722965:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704586368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997885.722992:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704586368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997885.722997:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1046 00000100:00100000:0.0:1789997885.723031:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704586112 00000100:00100000:0.0:1789997885.723035:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704586112 00000100:00100000:0.0:1789997885.723061:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1223 00000100:00100000:0.0:1789997885.723067:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704586112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997885.723090:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704586112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 23us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997885.723096:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1223 00000100:00080000:0.0:1789997885.723122:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997885.723126:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997885.723559:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704586240 00000100:00100000:2.0:1789997885.723564:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704586240 00000100:00100000:2.0:1789997885.723611:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1523 00000100:00100000:2.0:1789997885.723619:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704586240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997885.723676:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704586240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 57us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997885.723682:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1523 00000100:00080000:0.0:1789997885.723777:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997885.901853:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713068416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997885.901931:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997885.910754:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713068416 00000100:00100000:0.0:1789997885.910769:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713068416 00000100:00100000:0.0:1789997885.910837:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1789997885.910847:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713068416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997885.910886:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997885.910964:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713068416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (9033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997885.910976:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00080000:0.0:1789997885.910998:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997885.911548:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713068416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997885.911966:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713068544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997885.912015:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997885.912117:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713068544 00000100:00100000:2.0:1789997885.912123:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713068544 00000100:00100000:2.0:1789997885.912181:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1789997885.912190:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713068544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997885.912214:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997885.912251:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713068544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997885.912258:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1789997885.912329:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713068544:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789997885.912348:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997886.219489:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:0.0:1789997886.239991:0:97521:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:0.0:1789997886.254622:0:97521:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000020:00000080:0.0:1789997887.132340:0:97570:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc5475980 20000000:00000080:0.0:1789997887.132358:0:97570:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e6800 uarg=0000000000000000 10000000:01000000:0.0:1789997887.133579:0:97570:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997887.133602:0:97570:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997887.133620:0:97570:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997887.134245:0:97570:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997887.134331:0:97570:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997887.134346:0:97570:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 18 pid: 5804 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997887.134361:0:97570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97570:1876946713068672:0@lo:104: 00000100:00100000:0.0:1789997887.134436:0:97570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997887.134501:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713068672 00000100:00100000:3.0:1789997887.134508:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713068672 00000100:00100000:0.0:1789997887.134526:0:97570:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9b5c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789997887.134564:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789997887.134575:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97570:x1876946713068672:12345-0@lo:104: 00010000:00010000:3.0:1789997887.134588:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997887.134689:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997887.134695:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97570:x1876946713068672:12345-0@lo:104: Request processed in 122us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997887.134702:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00010000:00010000:2.0:1789997887.134882:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997887.134890:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.134898:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997887.134903:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.134911:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997887.134918:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997887.134923:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997887.134960:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.134967:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997887.134988:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.134995:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3400/0x65b43101d592dfb7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfbe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135009:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997887.135010:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997887.135012:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997887.135019:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997887.135028:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713068800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997887.135059:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997887.135092:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713068800 00000100:00100000:2.0:1789997887.135096:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713068800 00010000:00010000:2.0:1789997887.135116:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 19 pid: 5804 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997887.135135:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1789997887.135141:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713068800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997887.135151:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997887.135156:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 19 pid: 5804 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135166:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 19 pid: 5804 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135181:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135189:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135203:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135210:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135216:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135222:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135232:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997887.135236:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135243:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135253:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.135261:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997887.135296:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713068800:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997887.135303:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1789997887.135335:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713068800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997887.135529:0:97570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592dfbe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dfb7 expref: 18 pid: 5804 timeout: 2175 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997887.135539:0:97570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97570:1876946713068672:0@lo:104: 00010000:00010000:0.0:1789997887.135554:0:97570:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997887.135563:0:97570:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997887.135568:0:97570:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997887.135574:0:97570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfc5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997887.243309:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997888.021725:0:97618:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcece61890 20000000:00000080:0.0:1789997888.021747:0:97618:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c8593800 uarg=0000000000000000 10000000:01000000:0.0:1789997888.022593:0:97618:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997888.022616:0:97618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022633:0:97618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022643:0:97618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022649:0:97618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022737:0:97618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022744:0:97618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022754:0:97618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997888.022759:0:97618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022766:0:97618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022779:0:97618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022787:0:97618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.022792:0:97618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592dfcc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.267334:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997888.841065:0:97666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc0ef611d0 20000000:00000080:3.0:1789997888.841083:0:97666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38faae1c00 uarg=0000000000000000 10000000:01000000:3.0:1789997888.841535:0:97666:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997888.841557:0:97666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841574:0:97666:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841586:0:97666:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841593:0:97666:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841600:0:97666:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841609:0:97666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841616:0:97666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997888.841620:0:97666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841628:0:97666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841641:0:97666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.841651:0:97666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997888.844072:0:97666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfd3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997888.844082:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997888.844086:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997888.844090:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997888.844137:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.844145:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.845063:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997888.845098:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713068928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997888.845187:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997888.845244:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6180 going to sleep for 11 seconds 00000100:00100000:0.0:1789997888.846521:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713068928 00000100:00100000:0.0:1789997888.846533:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713068928 00000100:00100000:0.0:1789997888.846624:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1789997888.846634:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713068928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997888.846650:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997888.846682:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dfda expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.846890:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dfda expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.846904:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dfda expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997888.846914:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997888.846980:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713068928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 347us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997888.846987:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1789997888.849795:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713068928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997888.849824:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997888.849838:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997888.849862:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997888.849867:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997888.849875:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997888.972405:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713069056:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.972467:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997888.972511:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713069568:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.972531:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997888.972553:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997888.972558:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713069440:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.972579:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997888.972606:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713069184:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.972628:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997888.972646:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789997888.972668:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713069312:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.972691:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997888.972725:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713069056 00000100:00100000:1.0:1789997888.972732:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713069056 00000100:00100000:1.0:1789997888.972771:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713069568 00000100:00100000:1.0:1789997888.972774:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713069568 00000100:00100000:1.0:1789997888.972797:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713069184 00000100:00100000:1.0:1789997888.972800:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713069184 00000100:00100000:1.0:1789997888.972823:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:1.0:1789997888.972832:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713069056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.972876:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713069056:12345-0@lo:400:kworker.0 Request processed in 46us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997888.972882:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:1.0:1789997888.972898:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:1.0:1789997888.972904:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713069568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.972928:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713069568:12345-0@lo:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997888.972932:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:1.0:1789997888.972942:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:1.0:1789997888.972947:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713069184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.972971:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713069184:12345-0@lo:400:kworker.0 Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997888.972976:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:1.0:1789997888.972990:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713069440 00000100:00100000:1.0:1789997888.972993:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713069440 00000100:00100000:1.0:1789997888.973013:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713069312 00000100:00100000:1.0:1789997888.973016:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713069312 00000100:00100000:1.0:1789997888.973031:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1789997888.973037:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713069440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.973062:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713069440:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997888.973068:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1789997888.973078:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1789997888.973084:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713069312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.973108:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713069312:12345-0@lo:400:kworker.0 Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997888.973113:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00080000:1.0:1789997888.973135:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997888.973139:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997888.973141:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997888.973177:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713069312:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.973188:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713069184:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.973216:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713069440:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.973224:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713069056:0@lo:400:kworker.0 00000100:00100000:1.0:1789997888.973232:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713069568:0@lo:400:kworker.0 00010000:00010000:0.0:1789997889.294093:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997889.523462:0:97714:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2a2b2b20 20000000:00000080:3.0:1789997889.523479:0:97714:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63a2c00 uarg=0000000000000000 10000000:01000000:3.0:1789997889.523701:0:97714:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997889.523721:0:97714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997889.523742:0:97714:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dfda expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997889.523749:0:97714:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997889.523794:0:97714:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dfda expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997889.523808:0:97714:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dfda expref: 18 pid: 5804 timeout: 2178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997889.523822:0:97714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97714:1876946713069696:0@lo:104: 00000100:00100000:3.0:1789997889.523887:0:97714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997889.523938:0:97714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789997889.524128:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713069696 00000100:00100000:0.0:1789997889.524136:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713069696 00000100:00100000:0.0:1789997889.524178:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789997889.524188:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97714:x1876946713069696:12345-0@lo:104: 00010000:00010000:0.0:1789997889.524201:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524268:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997889.524274:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97714:x1876946713069696:12345-0@lo:104: Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997889.524283:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00010000:0.0:1789997889.524303:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997889.524309:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524316:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789997889.524320:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524328:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789997889.524344:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997889.524351:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789997889.524379:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524384:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789997889.524404:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524410:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592dfda lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dfe1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524432:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997889.524433:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997889.524435:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997889.524446:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713069824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997889.524476:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997889.524513:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713069824 00000100:00100000:0.0:1789997889.524517:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713069824 00010000:00010000:0.0:1789997889.524534:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dfda expref: 19 pid: 5804 timeout: 2178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997889.524556:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789997889.524563:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713069824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789997889.524573:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997889.524578:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dfda expref: 19 pid: 5804 timeout: 2178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524588:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dfda expref: 19 pid: 5804 timeout: 2178 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524605:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524612:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524625:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524632:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524640:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524646:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524676:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997889.524681:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524688:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524697:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997889.524706:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997889.524736:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713069824:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997889.524743:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789997889.524808:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713069824:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997889.525160:0:97714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592dfe1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dfda expref: 18 pid: 5804 timeout: 2178 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997889.525173:0:97714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97714:1876946713069696:0@lo:104: 00010000:00010000:3.0:1789997889.525190:0:97714:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997889.525197:0:97714:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997889.525204:0:97714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997889.525210:0:97714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592dfe8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789997890.220925:0:97762:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc84fb4110 20000000:00000080:3.0:1789997890.220941:0:97762:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63a3000 uarg=0000000000000000 10000000:01000000:3.0:1789997890.221135:0:97762:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997890.221158:0:97762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221175:0:97762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221185:0:97762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221192:0:97762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221199:0:97762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221207:0:97762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221213:0:97762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997890.221217:0:97762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221224:0:97762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221236:0:97762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221244:0:97762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.221251:0:97762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b200/0x65b43101d592dfef lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997890.317573:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997890.570743:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997890.570752:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997890.570757:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997890.570804:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997890.570816:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997890.570833:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997890.570860:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6deea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713069952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997890.570928:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997890.571036:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee4cecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997890.574724:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713069952 00000100:00100000:0.0:1789997890.574741:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713069952 00000100:00100000:0.0:1789997890.574796:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1789997890.574806:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713069952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997890.574823:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997890.574842:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592dff6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997890.574870:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592dff6 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997890.574883:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dff6 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997890.574898:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997890.574994:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713069952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (4066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997890.575001:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1789997890.575584:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6deea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713069952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997890.575605:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.575615:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997890.575686:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997890.575693:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997890.575701:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997890.838947:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997890.838993:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997890.839029:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997890.839061:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704586752 00000100:00100000:1.0:1789997890.839072:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704586752 00000100:00100000:0.0:1789997890.839077:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997890.839123:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704586880 00000100:00100000:0.0:1789997890.839129:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704586880 00000100:00100000:1.0:1789997890.839145:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1527 00000100:00100000:1.0:1789997890.839157:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704586752:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997890.839167:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704587008 00000100:00100000:0.0:1789997890.839171:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704587008 00000100:00100000:0.0:1789997890.839198:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 595 00000100:00100000:0.0:1789997890.839221:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704586880:12345-192.168.204.4@tcp:9:kworker.0 00000100:00100000:1.0:1789997890.839235:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704586752:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997890.839242:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1527 00000020:00000080:0.0:1789997890.839245:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592dd17 00000100:00080000:0.0:1789997890.839257:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec2800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1789997890.839266:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997890.839281:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997890.839285:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:0.0:1789997890.839300:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967365 00000100:00100000:2.0:1789997890.839398:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704586624 00000100:00100000:2.0:1789997890.839404:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704586624 00000100:00100000:2.0:1789997890.839450:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1226 00000100:00100000:2.0:1789997890.839458:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704586624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997890.839490:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704586624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997890.839497:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1226 00000100:00100000:0.0:1789997890.839607:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704586880:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 400us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997890.839616:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 595 00000100:00100000:0.0:1789997890.839630:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 596 00000100:00100000:0.0:1789997890.839637:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704587008:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:0.0:1789997890.839649:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592d6db 00000100:00080000:0.0:1789997890.839688:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789997890.839711:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967365 00010000:00010000:2.0:1789997890.839724:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997890.839859:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704587008:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 222us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997890.839866:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 596 00010000:00010000:0.0:1789997890.839993:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997891.019395:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713070080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997891.019487:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997891.019626:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713070080 00000100:00100000:1.0:1789997891.019635:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713070080 00000100:00100000:1.0:1789997891.019711:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:1.0:1789997891.019721:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713070080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997891.019757:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997891.019804:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713070080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997891.019811:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00080000:0.0:1789997891.019989:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997891.020027:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713070080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997891.020190:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713070208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997891.020219:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997891.020293:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713070208 00000100:00100000:2.0:1789997891.020298:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713070208 00000100:00100000:2.0:1789997891.020346:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1789997891.020355:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713070208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997891.020374:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997891.020426:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713070208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997891.020433:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00080000:0.0:1789997891.020577:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997891.020602:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713070208:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789997891.106295:0:97810:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2212bf50 20000000:00000080:1.0:1789997891.106325:0:97810:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa5800 uarg=0000000000000000 10000000:01000000:1.0:1789997891.110414:0:97810:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997891.110442:0:97810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997891.110461:0:97810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592dff6 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997891.110470:0:97810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997891.110582:0:97810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592dff6 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997891.110600:0:97810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592dff6 expref: 18 pid: 5803 timeout: 2179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997891.110615:0:97810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97810:1876946713070336:0@lo:104: 00000100:00100000:1.0:1789997891.110706:0:97810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997891.110764:0:97810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789997891.110767:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713070336 00000100:00100000:0.0:1789997891.110775:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713070336 00000100:00100000:0.0:1789997891.110835:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789997891.110848:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97810:x1876946713070336:12345-0@lo:104: 00010000:00010000:0.0:1789997891.110862:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997891.110947:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997891.110953:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97810:x1876946713070336:12345-0@lo:104: Request processed in 107us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997891.110960:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00010000:2.0:1789997891.111025:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997891.111032:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111040:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997891.111044:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111053:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997891.111062:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997891.111068:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997891.111109:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111115:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997891.111137:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111144:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592dff6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592dffd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111165:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997891.111167:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997891.111168:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997891.111179:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713070464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997891.111211:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997891.111248:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713070464 00000100:00100000:2.0:1789997891.111252:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713070464 00010000:00010000:2.0:1789997891.111271:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dff6 expref: 19 pid: 5803 timeout: 2179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997891.111294:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789997891.111300:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713070464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997891.111323:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997891.111328:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592dff6 expref: 19 pid: 5803 timeout: 2179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111339:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592dff6 expref: 19 pid: 5803 timeout: 2179 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111358:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111367:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111381:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111387:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111394:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111414:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111419:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997891.111423:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111431:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111439:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.111448:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997891.111476:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713070464:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997891.111482:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789997891.111518:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713070464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997891.112127:0:97810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592dffd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592dff6 expref: 18 pid: 5803 timeout: 2179 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997891.112149:0:97810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97810:1876946713070336:0@lo:104: 00010000:00010000:1.0:1789997891.112164:0:97810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997891.112173:0:97810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997891.112179:0:97810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997891.112190:0:97810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2e00/0x65b43101d592e004 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997891.339074:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997892.362866:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789997892.490741:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997892.490750:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997892.490755:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997892.490805:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997892.490818:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997892.490830:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997892.490858:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713070592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997892.490924:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997892.490996:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c8018540 going to sleep for 11 seconds 00000100:00100000:1.0:1789997892.491188:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713070592 00000100:00100000:1.0:1789997892.491196:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713070592 00000100:00100000:1.0:1789997892.491250:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1789997892.491260:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713070592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997892.491273:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997892.491440:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e00b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997892.491465:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e00b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997892.491477:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e00b expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997892.491487:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997892.491555:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713070592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 296us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997892.491562:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1789997892.491680:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713070592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997892.491707:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997892.491718:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997892.491740:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997892.491746:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997892.491755:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997893.386989:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997894.090890:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713070848:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.090959:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997894.091006:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713071360:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091028:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997894.091068:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789997894.091074:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713070720:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091102:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997894.091125:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713071232:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091150:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997894.091175:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713070976:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091199:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997894.091216:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997894.091223:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713071104:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091243:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997894.091286:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713070848 00000100:00100000:1.0:1789997894.091295:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713070848 00000100:00100000:1.0:1789997894.091338:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713071360 00000100:00100000:1.0:1789997894.091341:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713071360 00000100:00100000:1.0:1789997894.091368:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713070976 00000100:00100000:1.0:1789997894.091370:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713070976 00000100:00100000:1.0:1789997894.091390:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1789997894.091398:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713070848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091450:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713070848:12345-0@lo:400:kworker.0 Request processed in 52us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997894.091457:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1789997894.091474:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:1.0:1789997894.091480:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713071360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091505:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713071360:12345-0@lo:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997894.091510:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:1.0:1789997894.091521:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1789997894.091526:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713070976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091558:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713070976:12345-0@lo:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997894.091563:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1789997894.091584:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713070720 00000100:00100000:1.0:1789997894.091588:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713070720 00000100:00100000:1.0:1789997894.091609:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:1.0:1789997894.091631:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713070720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091689:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713070720:12345-0@lo:400:kworker.0 Request processed in 74us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997894.091695:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:1.0:1789997894.091721:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713071232 00000100:00100000:1.0:1789997894.091724:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713071232 00000100:00100000:1.0:1789997894.091748:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713071104 00000100:00100000:1.0:1789997894.091751:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713071104 00000100:00100000:1.0:1789997894.091768:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:1.0:1789997894.091774:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713071232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091803:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713071232:12345-0@lo:400:kworker.0 Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997894.091808:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:1.0:1789997894.091819:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:1.0:1789997894.091824:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713071104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091844:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713071104:12345-0@lo:400:kworker.0 Request processed in 21us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997894.091849:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00080000:1.0:1789997894.091872:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997894.091876:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997894.091878:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997894.091918:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6064a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713071104:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091928:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713070976:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091957:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713070720:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091966:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713071232:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091975:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713070848:0@lo:400:kworker.0 00000100:00100000:1.0:1789997894.091984:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713071360:0@lo:400:kworker.0 00000020:00000080:0.0:1789997894.144355:0:97958:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeff347420 20000000:00000080:0.0:1789997894.144376:0:97958:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae3b000 uarg=0000000000000000 10000000:01000000:0.0:1789997894.145446:0:97958:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997894.145470:0:97958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997894.146077:0:97958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e00b expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997894.146086:0:97958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997894.146126:0:97958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e00b expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997894.146142:0:97958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e00b expref: 18 pid: 5803 timeout: 2182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997894.146156:0:97958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97958:1876946713071488:0@lo:104: 00000100:00100000:0.0:1789997894.146212:0:97958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997894.146289:0:97958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c8018540 going to sleep for 11 seconds 00000100:00100000:3.0:1789997894.146523:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713071488 00000100:00100000:3.0:1789997894.146531:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713071488 00000100:00100000:3.0:1789997894.146592:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789997894.146602:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97958:x1876946713071488:12345-0@lo:104: 00010000:00010000:3.0:1789997894.146621:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.146722:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997894.146727:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:97958:x1876946713071488:12345-0@lo:104: Request processed in 127us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997894.146734:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00010000:3.0:1789997894.146929:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997894.146935:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.146944:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789997894.146947:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.146962:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789997894.146969:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997894.146975:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789997894.147007:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147013:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997894.147033:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147040:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e00b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e012 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147063:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997894.147065:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997894.147066:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997894.147077:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713071616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789997894.147105:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997894.147147:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713071616 00000100:00100000:3.0:1789997894.147151:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713071616 00010000:00010000:3.0:1789997894.147173:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e00b expref: 19 pid: 5803 timeout: 2182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997894.147201:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1789997894.147210:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713071616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997894.147220:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997894.147225:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e00b expref: 19 pid: 5803 timeout: 2182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147234:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e00b expref: 19 pid: 5803 timeout: 2182 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147262:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147270:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147283:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147290:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147297:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147303:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147308:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997894.147312:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147319:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147328:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997894.147336:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997894.147371:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713071616:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997894.147378:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00010000:00010000:0.0:1789997894.148235:0:97958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e012 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e00b expref: 18 pid: 5803 timeout: 2182 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997894.148261:0:97958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab29880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97958:1876946713071488:0@lo:104: 00010000:00010000:0.0:1789997894.148283:0:97958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997894.148295:0:97958:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997894.148301:0:97958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997894.148310:0:97958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e019 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997894.154175:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713071616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997894.410868:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789997894.644425:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997894.644435:0:7614:0:(genops.c:885:class_export_put()) final put ffff8a37c6ec1000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789997894.644476:0:84165:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c6ec1000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0001 00000020:00000080:1.0:1789997894.644519:0:84165:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c6ec4800 for lustre-OST0001 00000001:00100000:0.0:1789997894.671722:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789997894.671731:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a37c6ec5800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:3.0:1789997894.671862:0:40741:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c6ec5800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:3.0:1789997894.671909:0:40741:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c6ec2800 for lustre-OST0000 00000020:00000080:3.0:1789997895.123150:0:98008:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe71eef8f0 20000000:00000080:3.0:1789997895.123168:0:98008:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fad8cc00 uarg=0000000000000000 10000000:01000000:3.0:1789997895.123381:0:98008:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997895.123405:0:98008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123420:0:98008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123431:0:98008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123438:0:98008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123444:0:98008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123457:0:98008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123463:0:98008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997895.123467:0:98008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123474:0:98008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123487:0:98008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123495:0:98008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997895.123501:0:98008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592e020 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997895.435626:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997895.966856:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997895.967028:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704587264 00000100:00100000:2.0:1789997895.967037:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704587264 00000100:00100000:2.0:1789997895.967241:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1531 00000100:00100000:2.0:1789997895.967252:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704587264:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997895.967288:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00080000:1.0:1789997895.967398:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997895.968355:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704587264:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1101us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997895.968366:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1531 00000100:00100000:3.0:1789997895.970077:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704587136 00000100:00100000:3.0:1789997895.970089:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704587136 00000100:00100000:3.0:1789997895.970136:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1229 00000100:00100000:3.0:1789997895.970146:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704587136:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997895.970203:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704587136:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 58us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997895.970224:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1229 10000000:01000000:0.0:1789997896.075576:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997896.075584:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997896.075590:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997896.075637:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997896.075688:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997896.075701:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997896.075729:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713071744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997896.075803:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997896.075853:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b5e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789997896.075874:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713071744 00000100:00100000:0.0:1789997896.075883:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713071744 00000100:00100000:0.0:1789997896.075929:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1789997896.075939:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713071744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997896.077282:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997896.077307:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e027 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997896.077345:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e027 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997896.077356:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e027 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997896.077365:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997896.077444:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713071744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1506us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997896.077581:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:0.0:1789997896.079860:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713071744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997896.079889:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997896.079901:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997896.079924:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997896.079929:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997896.079937:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997896.138963:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713071872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997896.139037:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997896.139123:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713071872 00000100:00100000:1.0:1789997896.139131:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713071872 00000100:00100000:1.0:1789997896.139194:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1789997896.139218:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713071872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997896.139254:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997896.139307:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713071872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997896.139314:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00080000:1.0:1789997896.139335:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997896.139430:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713071872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997896.139771:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713072000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997896.139804:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997896.139888:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713072000 00000100:00100000:2.0:1789997896.139894:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713072000 00000100:00100000:2.0:1789997896.139942:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1789997896.139960:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713072000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997896.139980:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997896.140016:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713072000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997896.140023:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1789997896.140053:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713072000:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997896.140196:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789997896.458930:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997897.482918:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997898.508599:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997898.633048:0:98205:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd9f43320 20000000:00000080:3.0:1789997898.633067:0:98205:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fad8c800 uarg=0000000000000000 00010000:00010000:3.0:1789997898.634693:0:98205:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997898.634712:0:98205:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997898.634727:0:98205:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997898.634746:0:98205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997898.634923:0:98205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e027 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997898.634935:0:98205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997898.634976:0:98205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e027 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997898.634990:0:98205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e027 expref: 18 pid: 5805 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997898.635005:0:98205:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98205:1876946713072128:0@lo:104: 00000100:00100000:3.0:1789997898.635066:0:98205:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997898.635177:0:98205:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c480 going to sleep for 11 seconds 00000100:00100000:0.0:1789997898.639762:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713072128 00000100:00100000:0.0:1789997898.639785:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713072128 00000100:00100000:0.0:1789997898.639853:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789997898.639865:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:98205:x1876946713072128:12345-0@lo:104: 00010000:00010000:0.0:1789997898.639884:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997898.639984:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997898.639991:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:98205:x1876946713072128:12345-0@lo:104: Request processed in 129us (4926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997898.639998:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00010000:00010000:2.0:1789997898.640178:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997898.640185:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640193:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997898.640198:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640207:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997898.640215:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997898.640225:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997898.640267:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640274:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997898.640303:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640310:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e027 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e02e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640337:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997898.640339:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997898.640341:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997898.640349:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997898.640363:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713072256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997898.640417:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997898.640461:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713072256 00000100:00100000:2.0:1789997898.640465:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713072256 00010000:00010000:2.0:1789997898.640484:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e027 expref: 19 pid: 5805 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997898.640504:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789997898.640510:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713072256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997898.640520:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997898.640524:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e027 expref: 19 pid: 5805 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640539:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e027 expref: 19 pid: 5805 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640556:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640564:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640578:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640585:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640593:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640599:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640604:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997898.640608:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640615:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640623:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997898.640636:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997898.640683:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713072256:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997898.640689:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789997898.640722:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713072256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997898.640955:0:98205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592e02e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e027 expref: 18 pid: 5805 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997898.640968:0:98205:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98205:1876946713072128:0@lo:104: 00010000:00010000:1.0:1789997898.640983:0:98205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997898.640992:0:98205:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997898.640998:0:98205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997898.641004:0:98205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592e035 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997899.210916:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713072640:0@lo:400:kworker.0 00000100:00100000:2.0:1789997899.210988:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997899.211027:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713072384:0@lo:400:kworker.0 00000100:00100000:2.0:1789997899.211041:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997899.211046:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713072768:0@lo:400:kworker.0 00000100:00100000:0.0:1789997899.211061:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997899.211065:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997899.211082:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713072896:0@lo:400:kworker.0 00000100:00100000:0.0:1789997899.211103:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997899.211116:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713072640 00000100:00100000:0.0:1789997899.211124:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997899.211129:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713072512:0@lo:400:kworker.0 00000100:00100000:0.0:1789997899.211165:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997899.211208:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713072384 00000100:00100000:0.0:1789997899.211212:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713072384 00000100:00100000:0.0:1789997899.211256:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713072896 00000100:00100000:0.0:1789997899.211259:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713072896 00000100:00100000:0.0:1789997899.211288:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713072512 00000100:00100000:0.0:1789997899.211291:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713072512 00000100:00100000:0.0:1789997899.211316:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:2.0:1789997899.211317:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713072640 00000100:00100000:0.0:1789997899.211325:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713072384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997899.211350:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713072768 00000100:00100000:2.0:1789997899.211354:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713072768 00000100:00100000:2.0:1789997899.211379:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1789997899.211379:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713072384:12345-0@lo:400:kworker.0 Request processed in 55us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997899.211390:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:0.0:1789997899.211409:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:0.0:1789997899.211417:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713072896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997899.211446:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713072896:12345-0@lo:400:kworker.0 Request processed in 31us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997899.211452:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:0.0:1789997899.211464:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:0.0:1789997899.211471:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713072512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997899.211501:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713072512:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997899.211507:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:2.0:1789997899.211523:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713072640:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789997899.211535:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997899.211540:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997899.211543:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997899.211567:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713072640:12345-0@lo:400:kworker.0 Request processed in 181us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997899.211573:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1789997899.211575:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713072512:0@lo:400:kworker.0 00000100:00100000:2.0:1789997899.211587:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1789997899.211587:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713072384:0@lo:400:kworker.0 00000100:00100000:2.0:1789997899.211594:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713072768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997899.211597:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713072896:0@lo:400:kworker.0 00000100:00100000:2.0:1789997899.211620:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713072768:12345-0@lo:400:kworker.0 Request processed in 27us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997899.211625:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1789997899.211703:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713072768:0@lo:400:kworker.0 00000100:00100000:2.0:1789997899.211717:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713072640:0@lo:400:kworker.0 00010000:00010000:2.0:1789997899.532268:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997900.556093:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997900.622366:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997900.622371:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997900.622376:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997900.622420:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997900.622434:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997900.622445:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997900.622471:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713073024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997900.622542:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997900.622603:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e0fd9480 going to sleep for 11 seconds 00000100:00100000:3.0:1789997900.628585:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713073024 00000100:00100000:3.0:1789997900.628599:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713073024 00000100:00100000:3.0:1789997900.628725:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:3.0:1789997900.628735:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713073024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997900.628754:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997900.628774:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e03c expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997900.628802:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e03c expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997900.628813:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e03c expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997900.628822:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997900.628901:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713073024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (6360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997900.628908:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:3.0:1789997900.628963:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713073024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997900.628982:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997900.628992:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997900.629013:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997900.629019:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997900.629026:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997901.079163:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997901.079235:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704587392 00000100:00100000:1.0:1789997901.079244:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704587392 00000100:00100000:1.0:1789997901.079303:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1232 00000100:00100000:1.0:1789997901.079313:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704587392:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997901.079393:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704587392:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997901.079400:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1232 00000100:00100000:1.0:1789997901.082176:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997901.082276:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704587520 00000100:00100000:2.0:1789997901.082297:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704587520 00000100:00100000:2.0:1789997901.082382:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1535 00000100:00100000:2.0:1789997901.082392:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704587520:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997901.082464:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704587520:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997901.082472:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1535 00000100:00080000:3.0:1789997901.082703:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997901.258942:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713073152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997901.259006:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997901.259124:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713073152 00000100:00100000:2.0:1789997901.259132:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713073152 00000100:00100000:2.0:1789997901.259192:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1789997901.259202:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713073152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997901.259233:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997901.259276:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713073152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997901.259282:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00080000:0.0:1789997901.259339:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997901.259371:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713073152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997901.260001:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997901.260011:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713073280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997901.260045:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997901.260080:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713073280 00000100:00100000:0.0:1789997901.260084:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713073280 00000100:00100000:0.0:1789997901.260126:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:0.0:1789997901.260134:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713073280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997901.260156:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997901.260192:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713073280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997901.260198:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00080000:0.0:1789997901.260212:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997901.260234:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713073280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997901.580596:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997901.959464:0:98406:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2eecb290 20000000:00000080:3.0:1789997901.959480:0:98406:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63a1800 uarg=0000000000000000 00010000:00010000:3.0:1789997901.960643:0:98406:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997901.960681:0:98406:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997901.960699:0:98406:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997901.960717:0:98406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997901.960734:0:98406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e03c expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997901.960743:0:98406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997901.960779:0:98406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e03c expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997901.960793:0:98406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e03c expref: 18 pid: 7594 timeout: 2190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997901.960807:0:98406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98406:1876946713073408:0@lo:104: 00000100:00100000:3.0:1789997901.961324:0:98406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997901.961432:0:98406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3e9fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789997901.961622:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713073408 00000100:00100000:0.0:1789997901.961629:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713073408 00000100:00100000:0.0:1789997901.961824:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789997901.961833:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:98406:x1876946713073408:12345-0@lo:104: 00010000:00010000:0.0:1789997901.961846:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997901.961947:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789997901.961953:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:98406:x1876946713073408:12345-0@lo:104: Request processed in 122us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997901.961960:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00010000:00010000:2.0:1789997901.962089:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997901.962107:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997901.962124:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997901.962128:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997901.962141:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997901.962148:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997901.962154:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997901.962192:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997901.962199:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997901.962226:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997901.962234:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2800/0x65b43101d592e03c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e043 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997901.962377:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713073536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997901.962412:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997901.962441:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713073536 00000100:00100000:1.0:1789997901.962447:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713073536 00010000:00010000:1.0:1789997901.962473:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e03c expref: 19 pid: 7594 timeout: 2190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997901.962499:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997901.962501:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997901.962503:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997901.962573:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1789997901.962581:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713073536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997901.962592:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997901.962598:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e03c expref: 19 pid: 7594 timeout: 2190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962609:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e03c expref: 19 pid: 7594 timeout: 2190 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962624:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962632:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962647:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962690:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962696:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962712:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962717:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997901.962721:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962727:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962736:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997901.962744:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997901.962784:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713073536:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997901.962792:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1789997901.962815:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713073536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997901.966076:0:98406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e043 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e03c expref: 18 pid: 7594 timeout: 2190 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997901.966108:0:98406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98406:1876946713073408:0@lo:104: 00010000:00010000:3.0:1789997901.966135:0:98406:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997901.966149:0:98406:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997901.966156:0:98406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997901.966167:0:98406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b200/0x65b43101d592e04a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997902.604010:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997902.740487:0:98455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2cf5c9a0 20000000:00000080:3.0:1789997902.740503:0:98455:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb17b000 uarg=0000000000000000 00010000:00010000:3.0:1789997902.740855:0:98455:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789997902.740870:0:98455:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789997902.740883:0:98455:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997902.740901:0:98455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740916:0:98455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740926:0:98455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740933:0:98455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740939:0:98455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740947:0:98455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740954:0:98455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997902.740958:0:98455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740965:0:98455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740977:0:98455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740984:0:98455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997902.740990:0:98455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e051 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997903.502970:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789997903.502978:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789997903.502982:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789997903.503031:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997903.503044:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997903.503056:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997903.503096:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713073664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789997903.503187:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997903.503245:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789997903.503820:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713073664 00000100:00100000:3.0:1789997903.503830:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713073664 00000100:00100000:3.0:1789997903.503900:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1789997903.503913:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713073664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997903.503928:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997903.503945:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e058 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997903.503976:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e058 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997903.503987:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e058 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997903.504123:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997903.504194:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713073664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 282us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997903.504200:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:1.0:1789997903.504969:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713073664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997903.504990:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997903.505003:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997903.505031:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997903.505036:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997903.505044:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997903.629764:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997904.337063:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713073792:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337154:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997904.337208:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713074304:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337235:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997904.337262:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789997904.337268:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713073920:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337292:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997904.337312:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713074432:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337333:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997904.337358:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713074048:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337376:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997904.337391:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997904.337396:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713074176:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337412:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997904.337439:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713074304 00000100:00100000:2.0:1789997904.337445:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713074304 00000100:00100000:2.0:1789997904.337688:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713074176 00000100:00100000:2.0:1789997904.337692:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713074176 00000100:00100000:2.0:1789997904.337716:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1789997904.337723:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713074304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337777:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713074304:12345-0@lo:400:kworker.0 Request processed in 54us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997904.337785:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1789997904.337802:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1789997904.337809:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713074176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337840:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713074176:12345-0@lo:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997904.337846:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1789997904.337866:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713073920 00000100:00100000:2.0:1789997904.337870:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713073920 00000100:00100000:2.0:1789997904.337894:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713074432 00000100:00100000:2.0:1789997904.337897:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713074432 00000100:00100000:2.0:1789997904.337913:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713074048 00000100:00100000:2.0:1789997904.337916:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713074048 00000100:00100000:2.0:1789997904.337937:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1789997904.337944:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713073920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.337972:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713073920:12345-0@lo:400:kworker.0 Request processed in 29us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997904.337979:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1789997904.337989:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:2.0:1789997904.337995:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713074432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.338020:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713074432:12345-0@lo:400:kworker.0 Request processed in 26us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997904.338026:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:2.0:1789997904.338037:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:2.0:1789997904.338043:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713074048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.338081:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713074048:12345-0@lo:400:kworker.0 Request processed in 38us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997904.338087:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00080000:2.0:1789997904.338115:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997904.338120:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997904.338121:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997904.338180:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713074176:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.338191:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713074048:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.338234:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713073920:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.338244:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713074432:0@lo:400:kworker.0 00000100:00100000:2.0:1789997904.338255:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713074304:0@lo:400:kworker.0 00000100:00100000:3.0:1789997904.338342:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713073792 00000100:00100000:3.0:1789997904.338347:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713073792 00000100:00100000:3.0:1789997904.338386:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:3.0:1789997904.338393:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713073792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997904.338440:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713073792:12345-0@lo:400:kworker.0 Request processed in 47us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997904.338446:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:2.0:1789997904.338860:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713073792:0@lo:400:kworker.0 00010000:00010000:2.0:1789997904.651421:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997905.676977:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997906.198264:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997906.198318:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997906.198404:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704587776 00000100:00100000:2.0:1789997906.198415:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704587776 00000100:00100000:2.0:1789997906.198487:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1539 00000100:00100000:2.0:1789997906.198497:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704587776:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997906.198569:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704587776:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997906.198576:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1539 00000100:00100000:1.0:1789997906.198724:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704587648 00000100:00100000:1.0:1789997906.198729:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704587648 00000100:00100000:1.0:1789997906.198762:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1235 00000100:00100000:1.0:1789997906.198769:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704587648:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997906.198794:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704587648:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997906.198800:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1235 00000100:00080000:3.0:1789997906.199056:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997906.383435:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713074560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997906.383505:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997906.383579:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713074560 00000100:00100000:2.0:1789997906.383587:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713074560 00000100:00100000:2.0:1789997906.383669:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:2.0:1789997906.383679:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713074560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997906.383713:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997906.383759:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713074560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997906.383766:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:2.0:1789997906.383812:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713074560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997906.384018:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997906.384027:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997906.384036:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713074688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997906.384064:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997906.384097:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713074688 00000100:00100000:3.0:1789997906.384100:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713074688 00000100:00100000:3.0:1789997906.384128:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1789997906.384136:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713074688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997906.384154:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997906.384189:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6aded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713074688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997906.384195:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00080000:3.0:1789997906.384210:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997906.385804:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713074688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997906.699333:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997907.724413:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997907.809395:0:98747:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff13220940 20000000:00000080:0.0:1789997907.809414:0:98747:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae3ac00 uarg=0000000000000000 10000000:01000000:0.0:1789997907.809459:0:98747:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997907.809481:0:98747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997907.809498:0:98747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e058 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997907.809508:0:98747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997907.809547:0:98747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e058 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997907.809562:0:98747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e058 expref: 18 pid: 7594 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997907.809575:0:98747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98747:1876946713074816:0@lo:104: 00000100:00100000:0.0:1789997907.809644:0:98747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997907.809715:0:98747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789997907.809763:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789997907.809778:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713074816 00000100:00100000:3.0:1789997907.809792:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713074816 00000100:00100000:3.0:1789997907.809836:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789997907.809845:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38faae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:98747:x1876946713074816:12345-0@lo:104: 00010000:00010000:3.0:1789997907.809857:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997907.809926:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997907.809932:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38faae3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:98747:x1876946713074816:12345-0@lo:104: Request processed in 89us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997907.809947:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00010000:00010000:1.0:1789997907.810189:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997907.810197:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.810204:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789997907.810208:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.810216:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789997907.810222:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997907.810228:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789997907.810268:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.810274:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789997907.810294:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.810300:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0a00/0x65b43101d592e058 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e05f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.810321:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997907.810323:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997907.810324:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997907.810332:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997907.810342:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713074944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789997907.810373:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997907.810402:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713074944 00000100:00100000:1.0:1789997907.810406:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713074944 00010000:00010000:1.0:1789997907.810425:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e058 expref: 19 pid: 7594 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997907.810444:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1789997907.810451:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713074944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997907.810461:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997907.810466:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e058 expref: 19 pid: 7594 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.810481:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e058 expref: 19 pid: 7594 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997907.811156:0:98747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98747:1876946713074816:0@lo:104: 00010000:00010000:0.0:1789997907.813768:0:98747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814323:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e05f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e058 expref: 19 pid: 7594 timeout: 2196 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814342:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814351:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814374:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814381:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814389:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814397:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814403:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997907.814407:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814414:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814442:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997907.814454:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997907.814472:0:98747:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997907.814479:0:98747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997907.814484:0:98747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592e066 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997907.814578:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713074944:12345-0@lo:103:ldlm_bl.0 Request processed in 4126us (4202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997907.814588:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1789997907.814759:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713074944:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789997908.517465:0:98795:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6326f8f0 20000000:00000080:0.0:1789997908.517483:0:98795:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae3a400 uarg=0000000000000000 10000000:01000000:0.0:1789997908.517530:0:98795:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997908.517550:0:98795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517634:0:98795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517791:0:98795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517799:0:98795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517806:0:98795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517813:0:98795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517819:0:98795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997908.517824:0:98795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517833:0:98795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517846:0:98795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517854:0:98795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.517861:0:98795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e06d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997908.749751:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997909.450903:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713075328:0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.450990:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997909.451052:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789997909.451059:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713075200:0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.451080:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997909.451113:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713075712:0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.451133:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997909.451160:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713075328 00000100:00100000:3.0:1789997909.451167:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713075328 00000100:00100000:0.0:1789997909.451272:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713075072:0@lo:400:kworker.0 00000100:00100000:0.0:1789997909.451307:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997909.451335:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713075584:0@lo:400:kworker.0 00000100:00100000:0.0:1789997909.451375:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997909.451394:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997909.451400:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713075456:0@lo:400:kworker.0 00000100:00100000:0.0:1789997909.451421:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997909.451795:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713075584 00000100:00100000:2.0:1789997909.451801:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713075584 00000100:00100000:2.0:1789997909.451843:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713075456 00000100:00100000:2.0:1789997909.451846:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713075456 00000100:00100000:2.0:1789997909.451868:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1789997909.451876:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713075584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997909.451931:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713075584:12345-0@lo:400:kworker.0 Request processed in 56us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997909.451938:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1789997909.451967:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1789997909.451973:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713075456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997909.452002:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713075456:12345-0@lo:400:kworker.0 Request processed in 29us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997909.452008:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1789997909.452061:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ade680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713075456:0@lo:400:kworker.0 00000100:00100000:2.0:1789997909.452072:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713075584:0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.452638:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713075200 00000100:00100000:3.0:1789997909.452644:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713075200 00000100:00100000:3.0:1789997909.452678:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713075712 00000100:00100000:3.0:1789997909.452681:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713075712 00000100:00100000:3.0:1789997909.452702:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:3.0:1789997909.452709:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713075328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.452756:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713075328:12345-0@lo:400:kworker.0 Request processed in 47us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997909.452763:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:3.0:1789997909.452776:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1789997909.452782:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713075200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.452810:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713075200:12345-0@lo:400:kworker.0 Request processed in 28us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997909.452815:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1789997909.452827:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:3.0:1789997909.452834:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713075712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.452860:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713075712:12345-0@lo:400:kworker.0 Request processed in 28us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997909.452866:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00080000:3.0:1789997909.452887:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997909.452891:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997909.452894:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997909.452903:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713075072 00000100:00100000:3.0:1789997909.452907:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713075072 00000100:00100000:3.0:1789997909.452927:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1789997909.452932:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713075072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.452978:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713075072:12345-0@lo:400:kworker.0 Request processed in 45us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997909.452983:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1789997909.453023:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713075200:0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.453033:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713075712:0@lo:400:kworker.0 00000100:00100000:3.0:1789997909.453043:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713075328:0@lo:400:kworker.0 00000100:00100000:2.0:1789997909.453497:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6adce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713075072:0@lo:400:kworker.0 00010000:00010000:2.0:1789997909.772643:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789997909.834711:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789997909.834720:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789997909.834725:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789997909.834776:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997909.834788:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997909.834799:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997909.834823:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713075840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789997909.834918:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997909.835009:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789997909.835202:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713075840 00000100:00100000:1.0:1789997909.835211:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713075840 00000100:00100000:1.0:1789997909.835275:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1789997909.835284:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713075840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997909.835299:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997909.835314:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e074 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997909.835338:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e074 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997909.835351:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e074 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997909.835360:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3000, rc 0) 00000100:00100000:1.0:1789997909.835411:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713075840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997909.835418:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:3.0:1789997909.835688:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713075840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789997909.835705:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997909.835719:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789997909.835739:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789997909.835744:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997909.835752:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997910.798151:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997911.240488:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997911.240687:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704587904 00000100:00100000:2.0:1789997911.240701:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704587904 00000100:00100000:2.0:1789997911.240823:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1108 00000100:00100000:2.0:1789997911.240834:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58025:x1876946704587904:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997911.240854:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997911.240956:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592e082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0e0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.241027:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e089 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.241043:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.241056:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997911.241091:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789997911.241108:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997911.241133:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.241157:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3a00/0x65b43101d592e082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0e0 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.241176:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0e0 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.241194:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997911.241197:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997911.241200:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2400, rc 0) 00000100:00100000:2.0:1789997911.241271:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58025:x1876946704587904:12345-192.168.204.4@tcp:101:rm.0 Request processed in 438us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997911.241278:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1108 00000100:00080000:3.0:1789997911.241335:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997911.246395:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997911.246525:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704588032 00000100:00100000:3.0:1789997911.246536:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704588032 00000100:00100000:3.0:1789997911.246609:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1109 00000100:00100000:3.0:1789997911.246631:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58025:x1876946704588032:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997911.246685:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997911.246706:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0e7 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.246765:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.246781:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.246792:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.246833:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.246854:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.246861:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247710:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247720:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247727:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247732:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997911.247737:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247744:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247757:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:3.0:1789997911.247760:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997911.247765:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247772:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247788:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247794:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247800:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247806:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997911.247809:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247815:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247822:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997911.247824:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997911.247827:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247833:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e09e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247879:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e090 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0e7 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247889:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:3.0:1789997911.247892:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997911.247896:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0e7 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.247905:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997911.247992:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58025:x1876946704588032:12345-192.168.204.4@tcp:101:rm.0 Request processed in 1374us (1745us total) trans 0 rc 301/301 00000100:00100000:3.0:1789997911.248000:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1109 00000100:00100000:3.0:1789997911.281427:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997911.281473:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997911.281571:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704588160 00000100:00100000:0.0:1789997911.281583:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704588160 00000100:00100000:0.0:1789997911.281640:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704588416 00000100:00100000:0.0:1789997911.281644:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704588416 00000100:00100000:0.0:1789997911.281705:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1110 00000100:00100000:0.0:1789997911.281782:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704588160:12345-192.168.204.4@tcp:41:mkdir.0 00000100:00100000:3.0:1789997911.281804:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1111 00000100:00100000:3.0:1789997911.281828:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58029:x1876946704588416:12345-192.168.204.4@tcp:36:mkdir.0 00000004:00000024:0.0:1789997911.281834:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00010000:3.0:1789997911.281869:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997911.281897:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e089 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0e0 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997911.281924:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704588160:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 198us (495us total) trans 0 rc 0/0 00010000:00010000:3.0:1789997911.281929:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38d0bdf000) 00000100:00100000:0.0:1789997911.281935:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1110 00010000:00010000:3.0:1789997911.281944:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997911.282193:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.282209:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.282221:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.282952:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.282965:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.282976:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997911.285534:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00010000:3.0:1789997911.285551:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.285561:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.285568:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.285574:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997911.285578:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.285586:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.285601:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e900) 00010000:00010000:3.0:1789997911.285604:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997911.285608:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.285615:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e0a5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997911.285637:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd0a874b reply state 000000009aa75fd3 transno 4294967720 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997911.285676:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997911.286779:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58029:x1876946704588416:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 4948us (5298us total) trans 4294967720 rc 0/0 00000100:00100000:3.0:1789997911.286789:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1111 00010000:00010000:0.0:1789997911.290406:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997911.290430:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997911.290440:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997911.290447:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997911.290452:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997911.290460:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997911.290479:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38ee49ed00) 00010000:00010000:0.0:1789997911.290482:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997911.290488:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997911.290495:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e0ac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997911.318847:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997911.321812:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704588544 00000100:00100000:3.0:1789997911.321827:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704588544 00000100:00100000:0.0:1789997911.322828:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997911.322932:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704588672 00000100:00100000:1.0:1789997911.322937:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704588672 00000100:00100000:1.0:1789997911.323030:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1112 00000100:00100000:1.0:1789997911.323040:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58033:x1876946704588672:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:1.0:1789997911.323063:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997911.323087:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0ee expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.323149:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e0ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.323163:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.323177:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997911.323212:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997911.323216:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997911.323238:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.323260:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0ee expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.323281:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e0ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0ee expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.323291:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997911.323294:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997911.323298:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997911.323368:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58033:x1876946704588672:12345-192.168.204.4@tcp:101:chown.0 Request processed in 329us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997911.323376:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1112 00000100:00100000:2.0:1789997911.323932:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1238 00000100:00100000:2.0:1789997911.323944:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704588544:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997911.323985:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704588544:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (5149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997911.323992:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1238 00000100:00100000:0.0:1789997911.329433:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997911.329527:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704588800 00000100:00100000:2.0:1789997911.329537:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704588800 00000100:00100000:2.0:1789997911.329604:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1113 00000100:00100000:2.0:1789997911.329616:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58033:x1876946704588800:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:2.0:1789997911.329637:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997911.331622:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e0c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0f5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.331824:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.331839:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.331851:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.331866:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.331873:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.331880:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332028:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e0d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332043:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332050:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997911.332081:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789997911.332085:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997911.332104:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332115:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332121:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332129:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332135:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997911.332140:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332147:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332158:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:2.0:1789997911.332161:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997911.332166:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332177:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e0c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332191:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332197:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332203:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332208:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997911.332212:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332218:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332226:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997911.332228:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997911.332231:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332237:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e0cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332268:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e0c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0f5 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332283:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0f5 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.332290:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997911.332293:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997911.332295:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997911.332361:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58033:x1876946704588800:12345-192.168.204.4@tcp:101:chown.0 Request processed in 2746us (2936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997911.332369:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1113 00000100:00100000:2.0:1789997911.341555:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997911.341797:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704589056 00000100:00100000:1.0:1789997911.341808:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704589056 00000100:00100000:1.0:1789997911.341868:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1114 00000100:00100000:1.0:1789997911.341878:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58033:x1876946704589056:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:1.0:1789997911.341939:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997911.341963:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e0d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0f5 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.341983:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38d0bdfa00) 00010000:00010000:1.0:1789997911.341993:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997911.342017:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.342041:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.342051:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997911.342240:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021b1881e reply state 000000004e8ddfdb transno 4294967721 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997911.342250:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997911.342257:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000100:00100000:1.0:1789997911.342340:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58033:x1876946704589056:12345-192.168.204.4@tcp:36:chown.0 Request processed in 462us (794us total) trans 4294967721 rc 0/0 00000100:00100000:1.0:1789997911.342348:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1114 00010000:00010000:2.0:1789997911.345834:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.345851:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.345860:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.345866:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997911.345871:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.345878:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.345893:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:2.0:1789997911.345897:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997911.345901:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.345920:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e0dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997911.498846:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713075968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997911.498933:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997911.498977:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713076096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997911.499013:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713075968 00000100:00100000:3.0:1789997911.499018:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997911.499023:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713075968 00000100:00100000:3.0:1789997911.499061:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713076096 00000100:00100000:3.0:1789997911.499066:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713076096 00000100:00100000:0.0:1789997911.499095:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:0.0:1789997911.499106:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713075968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997911.499153:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997911.499215:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713075968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997911.499222:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:0.0:1789997911.499272:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713075968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997911.499453:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1789997911.499462:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713076096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997911.499482:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997911.499525:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713076096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997911.499532:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00080000:3.0:1789997911.499551:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997911.499555:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997911.499924:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713076096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997911.818986:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997911.931078:0:98990:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff45daaf60 20000000:00000080:3.0:1789997911.931096:0:98990:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38e0fec400 uarg=0000000000000000 10000000:01000000:3.0:1789997911.931141:0:98990:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997911.931161:0:98990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.931179:0:98990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e074 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.931188:0:98990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.931230:0:98990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e074 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.931245:0:98990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e074 expref: 18 pid: 7594 timeout: 2200 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997911.931259:0:98990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98990:1876946713076224:0@lo:104: 00000100:00100000:3.0:1789997911.931319:0:98990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997911.931376:0:98990:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee4c10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789997911.931449:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713076224 00000100:00100000:1.0:1789997911.931457:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713076224 00000100:00100000:1.0:1789997911.931546:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789997911.931557:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:98990:x1876946713076224:12345-0@lo:104: 00010000:00010000:1.0:1789997911.931574:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.931633:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789997911.931639:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:98990:x1876946713076224:12345-0@lo:104: Request processed in 85us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997911.931646:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00010000:2.0:1789997911.931682:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997911.931690:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.931701:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997911.931705:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.931714:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997911.931721:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997911.931728:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997911.931754:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997911.931758:0:98990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98990:1876946713076224:0@lo:104: 00010000:00010000:2.0:1789997911.931762:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789997911.931775:0:98990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.931785:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.931792:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b200/0x65b43101d592e074 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e07b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997911.931806:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997911.931808:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997911.931820:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997911.931882:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713076352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789997911.931926:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997911.932004:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713076352 00000100:00100000:1.0:1789997911.932009:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713076352 00010000:00010000:1.0:1789997911.932030:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e074 expref: 19 pid: 7594 timeout: 2200 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997911.932059:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1789997911.932066:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713076352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789997911.932077:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997911.932082:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e074 expref: 19 pid: 7594 timeout: 2200 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932091:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e074 expref: 19 pid: 7594 timeout: 2200 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932102:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3000/0x65b43101d592e07b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e074 expref: 19 pid: 7594 timeout: 2200 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932121:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932129:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932142:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932149:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932156:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932162:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932168:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052bc00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997911.932172:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932179:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.932264:0:98990:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997911.932272:0:98990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932512:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932521:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052bc00/0x65b43101d592e0e4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997911.932538:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997911.932643:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713076352:12345-0@lo:103:ldlm_bl.0 Request processed in 577us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997911.932672:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:0.0:1789997911.932775:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713076352:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1789997912.043980:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967721 is committed 00000020:00000080:0.0:1789997912.569473:0:99039:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1d9e97e0 20000000:00000080:0.0:1789997912.569490:0:99039:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae3a800 uarg=0000000000000000 10000000:01000000:0.0:1789997912.569535:0:99039:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997912.569555:0:99039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.569572:0:99039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.569584:0:99039:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.569591:0:99039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.569603:0:99039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.569611:0:99039:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.569618:0:99039:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997912.569622:0:99039:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.569630:0:99039:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.569644:0:99039:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.571523:0:99039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997912.571542:0:99039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592e0eb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997912.844514:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789997913.290728:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997913.290736:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997913.290740:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997913.290789:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997913.290801:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997913.290931:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997913.290958:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713076480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997913.291136:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997913.291210:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997913.291520:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713076480 00000100:00100000:2.0:1789997913.291529:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713076480 00000100:00100000:2.0:1789997913.291598:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1789997913.291609:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713076480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789997913.291622:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997913.291637:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e0f2 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997913.291694:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997913.291706:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997913.291715:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3a00, rc 0) 00000100:00100000:2.0:1789997913.291756:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713076480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997913.291763:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1789997913.296023:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713076480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789997913.296209:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997913.296223:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997913.296249:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789997913.296255:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997913.296263:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997913.867757:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997914.571176:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713076736:0@lo:400:kworker.0 00000100:00100000:2.0:1789997914.571498:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997914.571536:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713076608:0@lo:400:kworker.0 00000100:00100000:0.0:1789997914.571559:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713076736 00000100:00100000:2.0:1789997914.571567:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713077248:0@lo:400:kworker.0 00000100:00100000:0.0:1789997914.571568:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713076736 00000100:00100000:3.0:1789997914.571587:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997914.571715:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1789997914.571727:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713076736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997914.572006:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713076736:12345-0@lo:400:kworker.0 Request processed in 280us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997914.572014:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:2.0:1789997914.572043:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997914.572093:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713076736:0@lo:400:kworker.0 00000100:00100000:2.0:1789997914.572133:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713076864:0@lo:400:kworker.0 00000100:00100000:0.0:1789997914.572135:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713077248 00000100:00100000:0.0:1789997914.572141:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713077248 00000100:00100000:2.0:1789997914.572170:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997914.572182:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713076864 00000100:00100000:0.0:1789997914.572187:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713076864 00000100:00100000:2.0:1789997914.572201:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997914.572210:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713076992:0@lo:400:kworker.0 00000100:00100000:0.0:1789997914.572220:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1789997914.572228:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713077120:0@lo:400:kworker.0 00000100:00100000:0.0:1789997914.572231:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713077248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997914.572243:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997914.572269:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997914.572294:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1789997914.572300:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713077248:12345-0@lo:400:kworker.0 Request processed in 71us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997914.572307:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713076864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997914.572312:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1789997914.572315:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713076608 00000100:00100000:3.0:1789997914.572320:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713076608 00000100:00100000:0.0:1789997914.572350:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713077248:0@lo:400:kworker.0 00000100:00100000:3.0:1789997914.572358:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1789997914.572365:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713076864:12345-0@lo:400:kworker.0 Request processed in 61us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997914.572369:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713076608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997914.572380:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:3.0:1789997914.572415:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713076608:12345-0@lo:400:kworker.0 Request processed in 48us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997914.572422:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:2.0:1789997914.572423:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713076992 00000100:00100000:2.0:1789997914.572432:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713076992 00000100:00080000:3.0:1789997914.572463:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997914.572464:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713077120 00000100:00100000:2.0:1789997914.572469:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713077120 00000100:00080000:3.0:1789997914.572470:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997914.572488:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1789997914.572502:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713076992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997914.572534:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713076992:12345-0@lo:400:kworker.0 Request processed in 39us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997914.572787:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1789997914.572795:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997914.573099:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713077120:12345-0@lo:400:kworker.0 Request processed in 304us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997914.573107:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1789997914.573144:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713076992:0@lo:400:kworker.0 00000100:00100000:2.0:1789997914.573154:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713076864:0@lo:400:kworker.0 00000100:00100000:2.0:1789997914.573801:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713076608:0@lo:400:kworker.0 00000100:00100000:2.0:1789997914.573896:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713077120:0@lo:400:kworker.0 00000100:00080000:3.0:1789997914.575043:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997914.579969:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00010000:00010000:1.0:1789997914.894494:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997915.085445:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997915.085516:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704589184 00000100:00100000:3.0:1789997915.085527:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704589184 00000100:00100000:3.0:1789997915.085604:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00100000:3.0:1789997915.085629:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:6036:x1876946704589184:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997915.085645:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997915.085689:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e0ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0ee expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.085707:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:3.0:1789997915.085719:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997915.085772:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:6036:x1876946704589184:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 157us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997915.085779:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 17 00000100:00080000:2.0:1789997915.085986:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997915.849211:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997915.852607:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704589312 00000100:00100000:1.0:1789997915.852623:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704589312 00000100:00100000:1.0:1789997915.852698:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1115 00000100:00100000:1.0:1789997915.852709:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58138:x1876946704589312:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997915.852735:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997915.852756:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e100 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf0fc expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.852839:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e107 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.852855:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.852869:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997915.852912:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789997915.852916:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997915.852936:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.853169:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0fc expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.853190:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0fc expref: 6 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.853198:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:1.0:1789997915.853200:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997915.853203:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2600, rc 0) 00000100:00100000:1.0:1789997915.853349:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58138:x1876946704589312:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 640us (4145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997915.853357:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1115 00000100:00100000:0.0:1789997915.861600:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997915.865246:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704589440 00000100:00100000:3.0:1789997915.865262:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704589440 00000100:00100000:3.0:1789997915.865333:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1116 00000100:00100000:3.0:1789997915.865345:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58138:x1876946704589440:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997915.865366:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997915.865387:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e10e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf103 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.865779:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.865795:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.865807:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.865831:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.865839:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.865846:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866166:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e123 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866175:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866196:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997915.866228:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:3.0:1789997915.866233:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997915.866251:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866268:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866275:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866282:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866287:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997915.866292:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866299:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866309:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:3.0:1789997915.866312:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997915.866317:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866324:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e115 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866335:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866341:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866347:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866354:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997915.866357:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866363:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866369:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997915.866371:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997915.866373:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866379:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e11c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866409:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e10e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf103 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866423:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf103 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.866629:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997915.866632:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997915.866635:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997915.866789:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58138:x1876946704589440:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 1446us (5197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997915.866797:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1116 00000100:00100000:3.0:1789997915.869405:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997915.869489:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704589696 00000100:00100000:1.0:1789997915.869499:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704589696 00000100:00100000:1.0:1789997915.869558:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1117 00000100:00100000:1.0:1789997915.869570:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58138:x1876946704589696:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997915.869621:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997915.869647:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e123 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf103 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.869701:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:1.0:1789997915.869713:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997915.869742:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.869755:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.869764:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997915.915937:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997915.924785:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967722 is committed 00000004:00010000:0.0:1789997915.924909:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f0f7cab reply state 000000009db430d6 transno 4294967722 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997915.924923:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997915.924939:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00080000:0.0:1789997915.925031:0:6536:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789997915.925311:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58138:x1876946704589696:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 55739us (55907us total) trans 4294967722 rc 0/0 00000100:00100000:0.0:1789997915.925321:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1117 00010000:00010000:0.0:1789997915.930782:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.930802:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.930810:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.930816:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997915.930832:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.930840:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.930857:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:0.0:1789997915.930860:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997915.930865:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.930880:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e12a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997915.983862:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997915.984458:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704589824 00000100:00100000:0.0:1789997915.984474:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704589824 00000100:00100000:0.0:1789997915.984626:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1118 00000100:00100000:0.0:1789997915.984638:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58142:x1876946704589824:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997915.984688:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997915.984709:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf10a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.984771:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.984787:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.984798:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.984812:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.984830:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.984837:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985110:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e146 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985119:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985127:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997915.985155:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:0.0:1789997915.985159:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997915.985404:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e146 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985419:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985430:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985437:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985443:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997915.985447:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985454:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985467:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:0.0:1789997915.985471:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997915.985475:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985482:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e138 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985503:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985508:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985514:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985519:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997915.985522:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985528:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985535:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997915.985537:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997915.985541:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985546:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e13f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985585:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf10a expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985599:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e146 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf10a expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997915.985606:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997915.985608:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997915.985610:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789997915.985737:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58142:x1876946704589824:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1100us (1885us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997915.985745:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1118 00000100:00100000:0.0:1789997915.992870:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997915.992958:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704590080 00000100:00100000:1.0:1789997915.992968:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704590080 00000100:00100000:1.0:1789997915.993458:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1119 00000100:00100000:1.0:1789997915.993470:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58142:x1876946704590080:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997915.993491:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997915.993511:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e14d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf111 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.993788:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.993803:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.993815:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.993845:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.993852:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.993859:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997915.997004:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:1.0:1789997915.997362:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997384:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997396:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997428:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997435:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997442:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997448:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997915.997452:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997458:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997470:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:1.0:1789997915.997472:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997915.997477:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997483:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e154 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997915.997495:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a968f8e1 reply state 00000000ab9c1f24 transno 4294967723 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997915.997504:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997915.997535:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e14d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf111 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997549:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf111 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997915.997556:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:1.0:1789997915.997559:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997915.997561:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997915.997640:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58142:x1876946704590080:12345-192.168.204.4@tcp:101:touch.0 Request processed in 4172us (4775us total) trans 4294967723 rc 0/0 00000100:00100000:1.0:1789997915.997649:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1119 00010000:00010000:0.0:1789997916.001407:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997916.001438:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997916.001446:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997916.001453:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997916.001458:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997916.001466:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997916.001483:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38e062df00) 00010000:00010000:0.0:1789997916.001486:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997916.001492:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997916.001499:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e15b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997916.011151:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997916.011277:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704590336 00000100:00100000:3.0:1789997916.011287:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704590336 00000100:00100000:3.0:1789997916.011345:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1120 00000100:00100000:3.0:1789997916.011355:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58142:x1876946704590336:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:3.0:1789997916.011410:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997916.011437:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e162 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf111 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.011458:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:3.0:1789997916.011469:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997916.011510:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.011523:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.011534:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997916.011686:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abd97b1c reply state 000000000e0de859 transno 4294967724 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997916.011696:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997916.011790:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58142:x1876946704590336:12345-192.168.204.4@tcp:36:touch.0 Request processed in 436us (650us total) trans 4294967724 rc 0/0 00000100:00100000:3.0:1789997916.011797:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1120 00010000:00010000:1.0:1789997916.020369:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.020389:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.020397:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.020404:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997916.020409:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.020417:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.020438:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff8a38ee49ee00) 00010000:00010000:1.0:1789997916.020441:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997916.020446:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.020453:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e170 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997916.024182:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997916.024386:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704590464 00000100:00100000:2.0:1789997916.024396:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704590464 00000100:00100000:2.0:1789997916.024491:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1121 00000100:00100000:2.0:1789997916.024501:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58142:x1876946704590464:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997916.024524:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997916.024545:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e177 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf118 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.024608:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e177 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf118 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.024623:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e177 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf118 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.024643:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:2.0:1789997916.024646:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997916.024672:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789997916.024734:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58142:x1876946704590464:12345-192.168.204.4@tcp:101:touch.0 Request processed in 233us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997916.024742:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1121 00000100:00100000:2.0:1789997916.030174:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997916.031915:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704590592 00000100:00100000:0.0:1789997916.031928:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704590592 00000100:00100000:0.0:1789997916.032123:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 597 00000100:00100000:0.0:1789997916.032131:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876946704590592:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:0.0:1789997916.032163:0:6656:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 2104 last 0 00000020:00000080:0.0:1789997916.032190:0:6656:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592e17e 00002000:00100000:0.0:1789997916.032201:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a37c6933000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789997916.032222:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789997916.032420:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789997916.032449:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a37c6934000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789997916.032519:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704590592:12345-192.168.204.4@tcp:8:touch.0 Request processed in 387us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997916.032526:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 597 00000100:00100000:3.0:1789997916.042815:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997916.042943:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704590720 00000100:00100000:2.0:1789997916.042953:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704590720 00000100:00100000:2.0:1789997916.043028:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 598 00000100:00100000:2.0:1789997916.043054:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:0:x1876946704590720:12345-192.168.204.4@tcp:2:touch.0 00000100:00080000:3.0:1789997916.043524:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997916.075846:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:0:x1876946704590720:12345-192.168.204.4@tcp:2:touch.0 Request processed in 32799us (33030us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789997916.075858:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 598 00000001:00100000:1.0:1789997916.076872:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000001:00080000:1.0:1789997916.076889:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967366 is committed 00000100:00100000:2.0:1789997916.080634:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997916.080958:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704590976 00000100:00100000:3.0:1789997916.080969:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704590976 00000100:00100000:3.0:1789997916.081024:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:3.0:1789997916.081035:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58142:x1876946704590976:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:3.0:1789997916.081383:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58142:x1876946704590976:12345-192.168.204.4@tcp:35:touch.0 Request processed in 348us (757us total) trans 4294967725 rc 0/0 00000100:00100000:3.0:1789997916.081390:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 114 00000100:00100000:2.0:1789997916.137624:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997916.137689:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704591104 00000100:00100000:3.0:1789997916.137700:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704591104 00000100:00100000:3.0:1789997916.137788:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1122 00000100:00100000:3.0:1789997916.137812:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58146:x1876946704591104:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997916.137864:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997916.137895:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e185 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf11f expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138006:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138032:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138124:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138154:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138167:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138195:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138366:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e19a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138375:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e19a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138399:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e19a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997916.138793:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 0 00000004:00200000:3.0:1789997916.138798:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997916.138855:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e19a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138868:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e19a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138876:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138895:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138902:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138926:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997916.138930:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.138950:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139378:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:3.0:1789997916.139382:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997916.139404:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139412:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e18c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139588:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139596:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139602:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139606:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997916.139609:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139614:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139626:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997916.139629:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997916.139631:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139637:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e193 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139924:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e185 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf11f expref: 13 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139938:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e19a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf11f expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.139945:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997916.139947:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997916.139949:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997916.140065:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58146:x1876946704591104:12345-192.168.204.4@tcp:101:rm.0 Request processed in 2267us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997916.140074:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1122 00000100:00100000:0.0:1789997916.143022:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997916.143327:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704591232 00000100:00100000:2.0:1789997916.143338:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704591232 00000100:00100000:2.0:1789997916.143430:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 599 00000100:00100000:2.0:1789997916.143456:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704591232:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997916.143483:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997916.143517:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf126 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997916.143734:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x6ab1335b, atime: 0x6ab1335b, ctime: 0x6ab1335b, blocks: 0x1 00010000:00010000:2.0:1789997916.143753:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=2104s v=(0 0) 00010000:00010000:2.0:1789997916.143758:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997916.143767:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.143784:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.143796:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3200, rc 0) 00000100:00100000:2.0:1789997916.143870:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704591232:12345-192.168.204.4@tcp:101:rm.0 Request processed in 431us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997916.143877:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 599 00000100:00100000:0.0:1789997916.149257:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997916.149353:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704591488 00000100:00100000:3.0:1789997916.149362:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704591488 00000100:00100000:3.0:1789997916.149439:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1123 00000100:00100000:3.0:1789997916.149449:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58146:x1876946704591488:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:3.0:1789997916.149498:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997916.149523:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e19a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf11f expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149550:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e177 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf118 expref: 11 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149561:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff8a38d0bdf300) 00010000:00010000:3.0:1789997916.149569:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997916.149587:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149600:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149609:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149622:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149628:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149635:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149805:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149813:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.149832:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789997916.150342:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].35, 64 off10432 00000004:00080000:3.0:1789997916.150350:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2104842696141ns, next at 2105842694256ns, rc = 0 00010000:00010000:3.0:1789997916.150400:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.150409:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.150416:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.150424:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.150430:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.150436:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151721:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997916.151756:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151766:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151773:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151778:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997916.151783:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151791:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151805:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997916.151808:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789997916.151813:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151832:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e1b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151858:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151864:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151869:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151874:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997916.151877:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151883:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151890:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:3.0:1789997916.151893:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997916.151896:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.151901:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997916.151910:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000add30635 reply state 00000000143e7c74 transno 4294967726 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997916.151918:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789997916.152014:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58146:x1876946704591488:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2564us (2779us total) trans 4294967726 rc 0/0 00000100:00100000:3.0:1789997916.152024:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1123 00010000:00010000:1.0:1789997916.153613:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997916.153625:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.153634:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997916.153638:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.153646:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.153746:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997916.153749:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997916.153754:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.153760:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e1bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997916.153782:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997916.153784:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997916.153786:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997916.158277:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.158296:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.158305:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.158312:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997916.158317:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.158324:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.158340:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38ee49ec00) 00010000:00010000:2.0:1789997916.158343:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997916.158347:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.158354:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e1af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997916.443511:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997916.443594:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704591616 00000100:00100000:1.0:1789997916.443605:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704591616 00000100:00100000:1.0:1789997916.443770:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1241 00000100:00100000:1.0:1789997916.443783:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704591616:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997916.443866:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704591616:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997916.443874:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1241 00000100:00100000:2.0:1789997916.620032:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997916.620055:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713077376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997916.620139:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997916.620205:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713077376 00000100:00100000:2.0:1789997916.620213:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713077376 00000100:00100000:2.0:1789997916.620263:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:2.0:1789997916.620274:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713077376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997916.620307:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997916.620591:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713077376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 318us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997916.620600:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00080000:2.0:1789997916.620633:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997916.620818:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997916.620828:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713077504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997916.620943:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997916.621034:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713077504 00000100:00100000:3.0:1789997916.621040:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713077504 00000100:00100000:3.0:1789997916.621085:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:3.0:1789997916.621094:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713077504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997916.621109:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789997916.621123:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997916.621168:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713077504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997916.621177:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:2.0:1789997916.621201:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c5f11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713077504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997916.621755:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713077376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789997916.946495:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997916.974367:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997916.974456:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704591744 00000100:00100000:2.0:1789997916.974467:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704591744 00000100:00100000:2.0:1789997916.974530:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1124 00000100:00100000:2.0:1789997916.974540:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58161:x1876946704591744:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997916.974566:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997916.974587:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e1c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf12d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.974683:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e1cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.974698:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.974709:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997916.974743:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789997916.974747:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997916.974766:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.974793:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e1c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf12d expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.974825:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf12d expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997916.974833:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:2.0:1789997916.974836:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997916.974840:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3800, rc 0) 00000100:00100000:2.0:1789997916.974899:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58161:x1876946704591744:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 360us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997916.974907:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1124 00000100:00100000:1.0:1789997916.985006:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997916.985192:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704592000 00000100:00100000:3.0:1789997916.985204:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704592000 00000100:00100000:3.0:1789997916.985266:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1125 00000100:00100000:3.0:1789997916.985276:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58161:x1876946704592000:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997916.985342:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997916.985369:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e1cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf12d expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.985398:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e146 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf10a expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.985416:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:3.0:1789997916.985430:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997916.985452:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.985464:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997916.985474:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789997917.032678:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967723 is committed 00000001:00080000:1.0:1789997917.032697:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967727 is committed 00000004:00080000:1.0:1789997917.032706:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000100:00100000:0.0:1789997917.032876:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997917.032895:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713077632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997917.032957:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997917.033011:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713077632 00000100:00100000:0.0:1789997917.033017:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713077632 00000100:00100000:0.0:1789997917.033059:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1789997917.033068:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713077632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789997917.033093:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:35 count 1 00010000:00010000:0.0:1789997917.033116:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.033137:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.033147:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789997917.033152:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997917.033157:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.033182:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.033195:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 5 pid: 8169 timeout: 2205 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997917.033208:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946713077760:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997917.033257:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c86c0 going to sleep for 11 seconds 00000004:00010000:2.0:1789997917.035764:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000049570b84 reply state 00000000159bf1f9 transno 4294967727 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997917.035781:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997917.035810:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00080000:2.0:1789997917.035947:0:5811:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789997917.035970:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58161:x1876946704592000:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 50692us (50983us total) trans 4294967727 rc 0/0 00000100:00100000:2.0:1789997917.035979:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1125 00010000:00010000:1.0:1789997917.036140:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.036149:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.036156:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.036161:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997917.036165:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.036172:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.036186:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49ef00) 00010000:00010000:1.0:1789997917.036190:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789997917.036195:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.036200:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e1d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997917.040208:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997917.040252:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704592128 00000100:00100000:0.0:1789997917.040262:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704592128 00010000:00010000:0.0:1789997917.040299:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 6 pid: 8169 timeout: 2205 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997917.040333:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 437 00000100:00100000:0.0:1789997917.040343:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704592128:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789997917.040357:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997917.040362:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 6 pid: 8169 timeout: 2205 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.040375:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 6 pid: 8169 timeout: 2205 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.040408:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997917.040412:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997917.040418:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.040428:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.040448:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997917.040494:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704592128:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 152us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997917.040501:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 437 00010000:00010000:2.0:1789997917.041001:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008285d85d/0x65b43101d592e1a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf126 expref: 5 pid: 8169 timeout: 2205 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997917.041014:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6659:1876946713077760:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997917.041032:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.041110:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.041119:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.041129:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.041136:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.041187:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997917.044380:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997917.044396:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.044409:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997917.044414:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.044424:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.044445:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.044452:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003f7abbd/0x65b43101d592e1d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.044476:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997917.044478:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997917.044480:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997917.051569:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713077632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18494us (18604us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789997917.051582:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000004:00080000:2.0:1789997917.052164:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38ffd71f80/2, rc 0, transno 4294967367 00000100:00100000:2.0:1789997917.052172:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713077632:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997917.120903:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997917.121000:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704592256 00000100:00100000:1.0:1789997917.121015:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704592256 00000100:00100000:1.0:1789997917.121127:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1126 00000100:00100000:1.0:1789997917.121138:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58165:x1876946704592256:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:1.0:1789997917.121161:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997917.121183:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e1e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf134 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121257:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121272:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121282:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121296:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121302:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121307:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121615:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e1f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121623:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121630:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997917.121700:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:1.0:1789997917.121704:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997917.121722:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121733:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121740:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121746:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121751:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997917.121755:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121761:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121773:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:1.0:1789997917.121776:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997917.121792:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121813:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e1e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121827:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121832:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121837:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121841:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997917.121844:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121849:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121856:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38e062d500) 00010000:00010000:1.0:1789997917.121859:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997917.121861:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121866:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e1ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121894:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e1e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf134 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121911:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf134 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.121918:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:1.0:1789997917.121920:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997917.121922:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997917.121975:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58165:x1876946704592256:12345-192.168.204.4@tcp:101:touch.0 Request processed in 838us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997917.121981:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1126 00000100:00080000:2.0:1789997917.128214:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997917.134302:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997917.134459:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704592512 00000100:00100000:0.0:1789997917.134470:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704592512 00000100:00100000:0.0:1789997917.134572:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1127 00000100:00100000:0.0:1789997917.134582:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58165:x1876946704592512:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997917.134603:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997917.134624:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e1fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf13b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.134948:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.134965:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.134975:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.134990:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.134997:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.135003:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997917.135718:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23:0x0], index 0: 0 00010000:00010000:0.0:1789997917.135994:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e211 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136006:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136014:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136047:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136054:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136060:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136066:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997917.136070:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136077:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136088:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:0.0:1789997917.136091:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997917.136096:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136102:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e203 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997917.136126:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000031a7bbd reply state 00000000ea2cc960 transno 4294967728 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997917.136134:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997917.136165:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e1fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf13b expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136182:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e211 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf13b expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.136189:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:0.0:1789997917.136191:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997917.136193:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997917.136852:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58165:x1876946704592512:12345-192.168.204.4@tcp:101:touch.0 Request processed in 2269us (2556us total) trans 4294967728 rc 0/0 00000100:00100000:0.0:1789997917.136862:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1127 00010000:00010000:1.0:1789997917.142597:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.142615:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.142622:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.142629:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997917.142633:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.142641:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.142671:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38c28e9e00) 00010000:00010000:1.0:1789997917.142674:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997917.142682:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.142689:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e20a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997917.152548:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997917.152867:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704592768 00000100:00100000:1.0:1789997917.152877:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704592768 00000100:00100000:1.0:1789997917.152937:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1128 00000100:00100000:1.0:1789997917.152947:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58165:x1876946704592768:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:1.0:1789997917.153001:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997917.153297:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e211 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf13b expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.153318:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff8a38c28e9c00) 00010000:00010000:1.0:1789997917.153333:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997917.153376:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.153388:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.153398:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997917.153528:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd2e8999 reply state 00000000f7ff752c transno 4294967729 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997917.153538:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997917.153811:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58165:x1876946704592768:12345-192.168.204.4@tcp:36:touch.0 Request processed in 864us (1272us total) trans 4294967729 rc 0/0 00000100:00100000:1.0:1789997917.153819:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1128 00000100:00100000:0.0:1789997917.162832:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:2.0:1789997917.162924:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.162935:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.162943:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.162949:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997917.162954:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.162961:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.162975:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff8a38e062d500) 00010000:00010000:2.0:1789997917.162978:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997917.162983:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.162988:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e21f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997917.163516:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704592896 00000100:00100000:3.0:1789997917.163526:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704592896 00000100:00100000:3.0:1789997917.163576:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1129 00000100:00100000:3.0:1789997917.163586:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58165:x1876946704592896:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:3.0:1789997917.163608:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997917.163626:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e226 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf142 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997917.163726:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e226 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf142 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997917.163741:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e226 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf142 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997917.163763:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997917.163766:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789997917.163768:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789997917.163834:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58165:x1876946704592896:12345-192.168.204.4@tcp:101:touch.0 Request processed in 249us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997917.163841:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1129 00000100:00100000:3.0:1789997917.169186:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997917.169247:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704593024 00000100:00100000:0.0:1789997917.169258:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704593024 00000100:00100000:0.0:1789997917.169306:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 601 00000100:00100000:0.0:1789997917.169315:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876946704593024:12345-192.168.204.4@tcp:8:touch.0 00010000:00080000:0.0:1789997917.169346:0:6656:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp t0 exp 0000000000000000 cur 2105 last 0 00000020:00000080:0.0:1789997917.169385:0:6656:0:(genops.c:1384:class_connect()) connect: client dca90b7a-8ebc-4a6c-9659-0ee79e2da878, cookie 0x65b43101d592e22d 00002000:00100000:0.0:1789997917.169397:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dca90b7a-8ebc-4a6c-9659-0ee79e2da878/ffff8a37c6930800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789997917.169408:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789997917.169649:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789997917.170255:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a37c6937800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789997917.170377:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704593024:12345-192.168.204.4@tcp:8:touch.0 Request processed in 1059us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997917.170387:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 601 00000100:00100000:2.0:1789997917.173630:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997917.174284:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704593152 00000100:00100000:0.0:1789997917.174297:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704593152 00000100:00100000:0.0:1789997917.174750:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 602 00000100:00100000:0.0:1789997917.174760:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:0:x1876946704593152:12345-192.168.204.4@tcp:2:touch.0 00000100:00080000:3.0:1789997917.175084:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997917.222510:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:0:x1876946704593152:12345-192.168.204.4@tcp:2:touch.0 Request processed in 47740us (48878us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789997917.222526:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 602 00000100:00100000:0.0:1789997917.224860:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997917.224902:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704593408 00000100:00100000:0.0:1789997917.224911:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704593408 00000100:00100000:0.0:1789997917.224962:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 115 00000100:00100000:0.0:1789997917.224974:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58165:x1876946704593408:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:0.0:1789997917.225476:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58165:x1876946704593408:12345-192.168.204.4@tcp:35:touch.0 Request processed in 502us (623us total) trans 4294967730 rc 0/0 00000100:00100000:0.0:1789997917.225483:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 115 00000001:00080000:2.0:1789997917.225847:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00000001:00100000:2.0:1789997917.225857:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000100:00100000:3.0:1789997917.301068:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997917.301241:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704593536 00000100:00100000:2.0:1789997917.301252:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704593536 00000100:00100000:2.0:1789997917.301315:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1130 00000100:00100000:2.0:1789997917.301326:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58169:x1876946704593536:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997917.301350:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997917.301371:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e234 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf149 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301435:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301449:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301459:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301476:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301483:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301488:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301572:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e249 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301581:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301587:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997917.301615:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5d:0x0]: returning size 0 00000004:00200000:2.0:1789997917.301619:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997917.301637:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301686:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e249 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301694:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301701:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301708:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301714:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997917.301718:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301725:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301736:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:2.0:1789997917.301739:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997917.301744:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301750:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e23b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301763:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301769:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301775:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301780:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997917.301783:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301789:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301807:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997917.301809:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997917.301812:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301817:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e242 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301847:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e234 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf149 expref: 13 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301860:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e249 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf149 expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.301866:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:2.0:1789997917.301868:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997917.301870:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997917.301941:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58169:x1876946704593536:12345-192.168.204.4@tcp:101:rm.0 Request processed in 617us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997917.301952:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1130 00000100:00100000:1.0:1789997917.307557:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997917.307643:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704593664 00000100:00100000:2.0:1789997917.307679:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704593664 00000100:00100000:2.0:1789997917.307740:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 603 00000100:00100000:2.0:1789997917.307761:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704593664:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997917.307779:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997917.307810:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf150 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997917.307841:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x6ab1335d, atime: 0x6ab1335d, ctime: 0x6ab1335d, blocks: 0x1 00010000:00010000:2.0:1789997917.307860:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=2105s v=(0 0) 00010000:00010000:2.0:1789997917.307864:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997917.307872:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.307890:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.307908:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997917.307968:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704593664:12345-192.168.204.4@tcp:101:rm.0 Request processed in 219us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997917.307975:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 603 00000100:00100000:3.0:1789997917.312444:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997917.312894:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704593920 00000100:00100000:2.0:1789997917.312905:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704593920 00000100:00100000:2.0:1789997917.312964:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1131 00000100:00100000:2.0:1789997917.312975:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58169:x1876946704593920:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997917.313193:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997917.313225:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e249 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf149 expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313254:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf142 expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313268:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:2.0:1789997917.313279:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997917.313301:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313383:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313393:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313408:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313415:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313420:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313514:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313522:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.313530:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997917.314173:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].35, 64 off10432 00000004:00080000:2.0:1789997917.314185:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2106006530754ns, next at 2107006528139ns, rc = 0 00010000:00010000:2.0:1789997917.314244:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314254:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314263:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314271:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314277:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314282:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314315:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997917.314336:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314343:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314348:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314355:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997917.314359:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314366:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314376:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:2.0:1789997917.314379:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997917.314384:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.314389:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997917.314390:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e265 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.314395:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314404:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314411:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.314412:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997917.314416:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314417:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314423:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997917.314423:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314426:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314431:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.314432:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:1.0:1789997917.314435:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997917.314438:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314443:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:1.0:1789997917.314444:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e26c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314445:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997917.314448:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997917.314452:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e257 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.314456:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997917.314458:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997917.314460:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1789997917.314461:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000577a5b70 reply state 00000000b863ca6f transno 4294967731 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997917.314469:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997917.314551:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58169:x1876946704593920:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1576us (2115us total) trans 4294967731 rc 0/0 00000100:00100000:2.0:1789997917.314560:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1131 00010000:00010000:1.0:1789997917.316851:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.316866:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.316877:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.316883:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997917.316887:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.316896:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.316912:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38d0bdf800) 00010000:00010000:1.0:1789997917.316915:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997917.316920:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997917.316926:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e25e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997917.963815:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997918.263482:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997918.263893:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704594048 00000100:00100000:3.0:1789997918.263905:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704594048 00000100:00100000:3.0:1789997918.263969:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1132 00000100:00100000:3.0:1789997918.263981:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58183:x1876946704594048:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997918.264020:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997918.264042:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf157 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.264102:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e27a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.264117:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e27a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.264141:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e27a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997918.264181:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:3.0:1789997918.264185:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997918.264203:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e27a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.264227:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf157 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.264244:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e27a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf157 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.264252:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:3.0:1789997918.264255:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997918.264259:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997918.264361:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58183:x1876946704594048:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 383us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997918.264369:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1132 00000100:00100000:3.0:1789997918.271687:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997918.271789:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704594304 00000100:00100000:2.0:1789997918.271800:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704594304 00000100:00100000:2.0:1789997918.271863:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1133 00000100:00100000:2.0:1789997918.271873:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58183:x1876946704594304:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997918.271927:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997918.271954:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e27a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf157 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.271978:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e1f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf134 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.271990:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062df00) 00010000:00010000:2.0:1789997918.272002:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997918.272029:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.272042:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.272052:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997918.272311:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5e92956 reply state 000000000e10b9b4 transno 4294967732 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997918.272321:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997918.272329:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000100:00100000:2.0:1789997918.272410:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58183:x1876946704594304:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 538us (761us total) trans 4294967732 rc 0/0 00000100:00100000:2.0:1789997918.272418:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1133 00010000:00010000:2.0:1789997918.283928:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.283958:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.283967:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.283974:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997918.283979:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.283987:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.284016:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997918.284020:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789997918.284025:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997918.284033:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e281 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997918.420979:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997918.421072:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704594432 00000100:00100000:3.0:1789997918.421083:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704594432 00000100:00100000:3.0:1789997918.421139:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1134 00000100:00100000:3.0:1789997918.421151:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58195:x1876946704594432:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997918.421243:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58195:x1876946704594432:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997918.421250:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1134 00000100:00100000:3.0:1789997918.426321:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997918.426411:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704594560 00000100:00100000:1.0:1789997918.426422:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704594560 00000100:00100000:1.0:1789997918.426476:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 604 00000100:00100000:1.0:1789997918.426485:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58195:x1876946704594560:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997918.426916:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58195:x1876946704594560:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 430us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997918.426924:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 604 00000100:00100000:1.0:1789997918.432591:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997918.432682:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704594688 00000100:00100000:2.0:1789997918.432693:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704594688 00000100:00100000:2.0:1789997918.432778:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 605 00000100:00080000:3.0:1789997918.432785:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997918.432792:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58195:x1876946704594688:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997918.433194:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58195:x1876946704594688:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 405us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997918.433202:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 605 00000100:00100000:1.0:1789997918.436975:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997918.437046:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704594816 00000100:00100000:3.0:1789997918.437055:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704594816 00000100:00100000:3.0:1789997918.437105:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1135 00000100:00100000:3.0:1789997918.437114:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58195:x1876946704594816:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997918.437529:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58195:x1876946704594816:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 414us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997918.437537:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1135 00000100:00100000:3.0:1789997918.442232:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997918.442366:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704594944 00000100:00100000:2.0:1789997918.442388:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704594944 00000100:00100000:2.0:1789997918.442446:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1136 00000100:00100000:2.0:1789997918.442457:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58195:x1876946704594944:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997918.442554:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58195:x1876946704594944:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997918.442561:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1136 00000100:00100000:2.0:1789997918.447397:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997918.449968:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704595072 00000100:00100000:1.0:1789997918.449983:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704595072 00000100:00100000:1.0:1789997918.451282:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 606 00000100:00100000:1.0:1789997918.451295:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58195:x1876946704595072:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997918.451691:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7410450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58195:x1876946704595072:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 397us (4301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997918.451700:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 606 00000100:00100000:1.0:1789997918.458110:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997918.458895:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704595200 00000100:00100000:2.0:1789997918.458905:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704595200 00000100:00100000:2.0:1789997918.459018:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 607 00000100:00100000:2.0:1789997918.459029:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58195:x1876946704595200:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997918.459384:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58195:x1876946704595200:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 355us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997918.459392:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 607 00000100:00100000:3.0:1789997918.466013:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997918.466125:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704595328 00000100:00100000:1.0:1789997918.466137:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704595328 00000100:00100000:1.0:1789997918.466198:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1137 00000100:00100000:1.0:1789997918.466219:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58195:x1876946704595328:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997918.467015:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58195:x1876946704595328:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 804us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997918.467025:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1137 00000100:00100000:1.0:1789997918.541018:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997918.541103:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704595456 00000100:00100000:3.0:1789997918.541113:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704595456 00000100:00100000:3.0:1789997918.541173:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1138 00000100:00100000:3.0:1789997918.541183:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58199:x1876946704595456:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:3.0:1789997918.541203:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997918.541224:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf15e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541285:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541300:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541316:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541332:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541344:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541351:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541610:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e29d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541620:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541627:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997918.541697:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:3.0:1789997918.541701:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997918.541722:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e29d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541734:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541741:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541747:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541753:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997918.541757:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541765:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541787:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:3.0:1789997918.541790:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997918.541795:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541802:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e28f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541815:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541821:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541826:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541841:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997918.541844:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541849:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541856:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997918.541859:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997918.541861:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541871:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e296 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541900:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf15e expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541911:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e29d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf15e expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.541917:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997918.541919:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997918.541921:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789997918.541986:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58199:x1876946704595456:12345-192.168.204.4@tcp:101:dd.0 Request processed in 804us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997918.541994:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1138 00000100:00100000:3.0:1789997918.548797:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997918.548947:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704595712 00000100:00100000:0.0:1789997918.548957:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704595712 00000100:00100000:0.0:1789997918.549017:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1139 00000100:00100000:0.0:1789997918.549027:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58199:x1876946704595712:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997918.549048:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997918.549066:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e2a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf165 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549178:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549192:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549204:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549232:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549239:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549245:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997918.549762:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:0.0:1789997918.549941:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e2b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549951:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549959:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549988:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.549998:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.550004:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.550009:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997918.550013:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.550020:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.550031:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:0.0:1789997918.550035:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997918.550039:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.550045:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e2ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997918.550065:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eef661ac reply state 00000000f1164e90 transno 4294967733 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997918.550075:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997918.550102:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e2a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf165 expref: 15 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.550119:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf165 expref: 14 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.550132:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997918.550135:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997918.550137:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997918.550214:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+15:58199:x1876946704595712:12345-192.168.204.4@tcp:101:dd.0 Request processed in 1188us (1428us total) trans 4294967733 rc 0/0 00000100:00100000:0.0:1789997918.550222:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1139 00010000:00010000:1.0:1789997918.556691:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.556711:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.556719:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.556726:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997918.556731:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.556744:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.556761:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38c28e9600) 00010000:00010000:1.0:1789997918.556764:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997918.556780:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.556788:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e2b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997918.570553:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997918.579930:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704595840 00000100:00100000:0.0:1789997918.579946:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704595840 00000100:00100000:0.0:1789997918.580023:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 608 00000100:00100000:0.0:1789997918.580034:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58199:x1876946704595840:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997918.580055:0:6658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997918.580079:0:6658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf16c expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997918.580109:0:6658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789997918.580134:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=2107s v=(0 0) 00010000:00010000:0.0:1789997918.580139:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997918.580149:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.580167:0:6658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 6 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.580180:0:6658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997918.580604:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58199:x1876946704595840:12345-192.168.204.4@tcp:101:dd.0 Request processed in 570us (10059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997918.580612:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 608 00000100:00100000:0.0:1789997918.608623:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997918.608764:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704595968 00000100:00100000:2.0:1789997918.608784:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704595968 00002000:00100000:2.0:1789997918.608848:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x24:0x0] (0->1048575) req@ffff8a38ffd72d80 x1876946704595968/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:139/0 lens 488/0 e 0 to 0 dl 1789997929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997918.608859:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38ffd72d80 with x1876946704595968 ext(0->1048575) 00002000:00010000:2.0:1789997918.608865:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38ffd72d80 00000100:00100000:2.0:1789997918.608894:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 28 00000100:00100000:2.0:1789997918.608903:0:6663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704595968:12345-192.168.204.4@tcp:4:dd.0 00000100:00100000:2.0:1789997918.638154:0:6663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704595968:12345-192.168.204.4@tcp:4:dd.0 Request processed in 29239us (29528us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789997918.638169:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 28 00002000:00100000:2.0:1789997918.638183:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x24:0x0] (0->1048575) req@ffff8a38ffd72d80 x1876946704595968/t4294967368(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:139/0 lens 488/448 e 0 to 0 dl 1789997929 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997918.638194:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38ffd72d80 with x1876946704595968 ext(0->1048575) 00002000:00010000:2.0:1789997918.638202:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38ffd72d80 00000100:00100000:3.0:1789997918.642764:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997918.642957:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704596096 00000100:00100000:1.0:1789997918.642968:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704596096 00000100:00100000:1.0:1789997918.643043:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1140 00000100:00100000:1.0:1789997918.643055:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:58199:x1876946704596096:12345-192.168.204.4@tcp:44:dd.0 00000001:00080000:2.0:1789997918.752579:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967733 is committed 00000004:00080000:2.0:1789997918.752955:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00000100:00100000:1.0:1789997918.753174:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997918.753358:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58199:x1876946704596096:12345-192.168.204.4@tcp:44:dd.0 Request processed in 110299us (110597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997918.753369:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1140 00000100:00100000:1.0:1789997918.754032:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713077888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789997918.754083:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997918.754315:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713077888 00000100:00100000:0.0:1789997918.754323:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713077888 00000100:00100000:0.0:1789997918.754426:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1789997918.754436:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713077888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997918.754461:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:35 count 1 00010000:00010000:0.0:1789997918.754487:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.754508:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.754517:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789997918.754521:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997918.754525:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789997918.754550:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997918.754559:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997918.754574:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 5 pid: 8169 timeout: 2207 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997918.754591:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946713078016:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997918.754649:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61600 going to sleep for 11 seconds 00000100:00100000:3.0:1789997918.768728:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997918.768815:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704596224 00000100:00100000:1.0:1789997918.768826:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704596224 00000100:00100000:1.0:1789997918.768895:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 610 00000100:00100000:1.0:1789997918.768907:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704596224:12345-192.168.204.4@tcp:16:dd.0 00000100:00100000:0.0:1789997918.769409:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6656:1876946713078016:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997918.769435:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997918.770430:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997918.770513:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704596352 00000100:00100000:1.0:1789997918.770521:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704596352 00010000:00010000:1.0:1789997918.770556:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 6 pid: 8169 timeout: 2207 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997918.770603:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 438 00000100:00100000:1.0:1789997918.770623:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704596352:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997918.770637:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997918.770644:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 6 pid: 8169 timeout: 2207 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.770690:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 6 pid: 8169 timeout: 2207 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.770719:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081b0de7d/0x65b43101d592e250 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf150 expref: 6 pid: 8169 timeout: 2207 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.770736:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997918.770741:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997918.770747:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.770758:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.770798:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997918.770851:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704596352:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 239us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997918.770859:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 438 00010000:00010000:1.0:1789997918.770951:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.770960:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.770970:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.770977:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997918.771001:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789997918.771555:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713077888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17119us (17469us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789997918.771564:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000004:00080000:1.0:1789997918.771611:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38ffd73480/2, rc 0, transno 4294967367 00000100:00100000:1.0:1789997918.771618:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713077888:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789997918.772310:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997918.772321:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.772333:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997918.772338:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.772357:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.772387:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.772396:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5caac31/0x65b43101d592e2ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997918.772425:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997918.772427:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997918.772429:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997918.874946:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967367 is committed 00000001:00080000:2.0:1789997918.876029:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967368 is committed 00000100:00100000:1.0:1789997918.877289:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704596224:12345-192.168.204.4@tcp:16:dd.0 Request processed in 108370us (108556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997918.877304:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 610 00000100:00100000:2.0:1789997918.883976:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997918.886533:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704596608 00000100:00100000:1.0:1789997918.886549:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704596608 00000100:00100000:1.0:1789997918.886613:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 116 00000100:00100000:1.0:1789997918.886624:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58199:x1876946704596608:12345-192.168.204.4@tcp:35:dd.0 00000100:00100000:1.0:1789997918.887788:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58199:x1876946704596608:12345-192.168.204.4@tcp:35:dd.0 Request processed in 1161us (3816us total) trans 4294967734 rc 0/0 00000100:00100000:1.0:1789997918.887800:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 116 00010000:00010000:1.0:1789997918.987994:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997919.691948:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713078144:0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.692016:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713078272:0@lo:400:kworker.0 00000100:00100000:0.0:1789997919.692036:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997919.693519:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713078144 00000100:00100000:1.0:1789997919.693711:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713078144 00000100:00100000:1.0:1789997919.693776:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:1.0:1789997919.693786:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713078144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.694270:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997919.694337:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713078784:0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.694380:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997919.694418:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713078400:0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.694444:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997919.694465:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997919.694471:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713078528:0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.694497:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997919.694563:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713078656:0@lo:400:kworker.0 00000100:00100000:0.0:1789997919.694606:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997919.694609:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713078272 00000100:00100000:3.0:1789997919.694615:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713078272 00000100:00100000:0.0:1789997919.694648:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713078528 00000100:00100000:0.0:1789997919.694672:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713078528 00000100:00100000:3.0:1789997919.694676:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713078784 00000100:00100000:3.0:1789997919.694681:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713078784 00000100:00100000:0.0:1789997919.694708:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713078656 00000100:00100000:0.0:1789997919.694712:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713078656 00000100:00100000:3.0:1789997919.694718:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713078400 00000100:00100000:3.0:1789997919.694729:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713078400 00000100:00100000:0.0:1789997919.694743:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1789997919.694767:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713078528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.694772:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:3.0:1789997919.694782:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713078272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997919.694819:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713078528:12345-0@lo:400:kworker.0 Request processed in 54us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997919.694827:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1789997919.694847:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713078272:12345-0@lo:400:kworker.0 Request processed in 66us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997919.694849:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1789997919.694859:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1789997919.694864:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713078656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.694880:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1789997919.694888:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713078784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997919.694923:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713078656:12345-0@lo:400:kworker.0 Request processed in 63us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997919.694930:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713078784:12345-0@lo:400:kworker.0 Request processed in 41us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997919.694944:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1789997919.694945:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1789997919.694974:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1789997919.694981:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713078400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.695006:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713078400:12345-0@lo:400:kworker.0 Request processed in 26us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997919.695012:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00080000:3.0:1789997919.695036:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997919.695039:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997919.695069:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713078528:0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.695079:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713078400:0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.695103:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713078272:0@lo:400:kworker.0 00000100:00100000:3.0:1789997919.695114:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713078784:0@lo:400:kworker.0 00000100:00100000:0.0:1789997919.695166:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:0.0:1789997919.695172:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38ffd71f80, transno 4294967367 00000100:00100000:0.0:1789997919.695185:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713078656:0@lo:400:kworker.0 00000100:00100000:1.0:1789997919.696608:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713078144:12345-0@lo:400:kworker.0 Request processed in 2818us (4567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997919.696620:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:0.0:1789997919.697080:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713078144:0@lo:400:kworker.0 00000001:00080000:2.0:1789997920.011305:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967734 is committed 00010000:00010000:1.0:1789997920.011724:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997921.035313:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997921.175941:0:99432:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2109868284857ns, next at 2107006528139ns, rc = 0 00000004:00080000:0.0:1789997921.176118:0:99432:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2109868463893ns, next at 2105842694256ns, rc = 0 00000004:00080000:3.0:1789997921.179261:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000004:00080000:3.0:1789997921.179286:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00000100:00100000:3.0:1789997921.564888:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997921.564936:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997921.564982:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997921.565021:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997921.565053:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704596992 00000100:00100000:3.0:1789997921.565062:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704596992 00000100:00100000:3.0:1789997921.565131:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704597120 00000100:00100000:3.0:1789997921.565135:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704597120 00000100:00100000:3.0:1789997921.565173:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1061 00000100:00100000:3.0:1789997921.565185:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704596992:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997921.565269:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704596992:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997921.565277:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1061 00000100:00100000:3.0:1789997921.565295:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1062 00000100:00100000:3.0:1789997921.565302:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704597120:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997921.565328:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704597120:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997921.565334:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1062 00000100:00080000:3.0:1789997921.565351:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997921.565355:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997921.565751:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704596864 00000100:00100000:1.0:1789997921.565756:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704596864 00000100:00100000:1.0:1789997921.565799:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1549 00000100:00100000:1.0:1789997921.565806:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704596864:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997921.565838:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704596864:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997921.565844:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1549 00000100:00080000:3.0:1789997921.566640:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997921.566734:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704596736 00000100:00100000:0.0:1789997921.566740:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704596736 00000100:00100000:0.0:1789997921.566781:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1243 00000100:00100000:0.0:1789997921.566788:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704596736:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997921.566834:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704596736:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 47us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997921.566840:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1243 00000100:00100000:3.0:1789997921.743762:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997921.743784:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713078912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997921.743849:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997921.743937:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713079040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997921.743960:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997921.744123:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713078912 00000100:00100000:2.0:1789997921.744130:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713078912 00000100:00100000:2.0:1789997921.744222:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713079040 00000100:00100000:2.0:1789997921.744225:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713079040 00000100:00080000:3.0:1789997921.744265:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997921.744269:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997921.747122:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1789997921.747144:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713078912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789997921.747188:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789997921.747272:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713078912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (3423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997921.747280:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1789997921.747303:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:0.0:1789997921.747317:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713079040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997921.747335:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997921.747363:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713079040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997921.747368:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1789997921.747474:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713079040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997921.747490:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713078912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997922.058987:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789997922.317452:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00000100:00100000:3.0:1789997922.433127:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997922.433211:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704597248 00000100:00100000:0.0:1789997922.433222:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704597248 00000100:00100000:0.0:1789997922.433281:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1141 00000100:00100000:0.0:1789997922.433292:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58392:x1876946704597248:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997922.433382:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58392:x1876946704597248:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997922.433389:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1141 00000100:00100000:2.0:1789997922.448528:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997922.448572:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704597376 00000100:00100000:2.0:1789997922.448582:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704597376 00000100:00100000:2.0:1789997922.448636:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 611 00000100:00100000:2.0:1789997922.448645:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58392:x1876946704597376:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997922.449066:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58392:x1876946704597376:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 420us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997922.449075:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 611 00000100:00100000:1.0:1789997922.467864:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997922.468205:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704597504 00000100:00100000:3.0:1789997922.468216:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704597504 00000100:00100000:3.0:1789997922.468277:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 612 00000100:00100000:3.0:1789997922.468287:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58392:x1876946704597504:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997922.468684:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58392:x1876946704597504:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 397us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997922.468702:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 612 00000100:00100000:3.0:1789997922.478132:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997922.478757:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704597632 00000100:00100000:1.0:1789997922.478768:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704597632 00000100:00100000:1.0:1789997922.478835:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1142 00000100:00100000:1.0:1789997922.478846:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58392:x1876946704597632:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997922.479308:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58392:x1876946704597632:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 463us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997922.479316:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1142 00000100:00100000:2.0:1789997922.490732:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997922.491115:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704597760 00000100:00100000:3.0:1789997922.491127:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704597760 00000100:00100000:3.0:1789997922.491188:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1143 00000100:00100000:3.0:1789997922.491200:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58392:x1876946704597760:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997922.491835:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58392:x1876946704597760:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 635us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997922.491844:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1143 00000100:00100000:1.0:1789997922.495900:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997922.496191:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704597888 00000100:00100000:3.0:1789997922.496201:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704597888 00000100:00100000:3.0:1789997922.496258:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 613 00000100:00100000:3.0:1789997922.496268:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58392:x1876946704597888:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997922.496624:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58392:x1876946704597888:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 356us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997922.496632:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 613 00000100:00100000:2.0:1789997922.506153:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997922.509177:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704598016 00000100:00100000:3.0:1789997922.509196:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704598016 00000100:00100000:3.0:1789997922.509316:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 614 00000100:00100000:3.0:1789997922.509327:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58392:x1876946704598016:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997922.509772:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58392:x1876946704598016:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 445us (3628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997922.509782:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 614 00000100:00100000:1.0:1789997922.541841:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997922.543354:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704598144 00000100:00100000:3.0:1789997922.543368:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704598144 00000100:00100000:3.0:1789997922.543429:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1144 00000100:00100000:3.0:1789997922.543440:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58392:x1876946704598144:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997922.551014:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58392:x1876946704598144:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 7565us (9232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997922.551030:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1144 00000100:00100000:1.0:1789997922.624468:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997922.624893:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704598400 00000100:00100000:2.0:1789997922.624904:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704598400 00000100:00100000:2.0:1789997922.625482:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1145 00000100:00100000:2.0:1789997922.625496:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58396:x1876946704598400:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997922.625549:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997922.625581:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e2b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf165 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.625609:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:2.0:1789997922.625621:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997922.625644:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.625723:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.625736:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.625751:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.625758:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.625765:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.626221:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.626232:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.626250:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997922.627511:0:12471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].36, 64 off10496 00000004:00080000:2.0:1789997922.627525:0:12471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2111319870579ns, next at 2112319867146ns, rc = 0 00010000:00010000:2.0:1789997922.627632:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627646:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627685:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627710:0:12471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627717:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627723:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627813:0:12471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997922.627839:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627845:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627852:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627858:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997922.627862:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627869:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627880:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997922.627884:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997922.627889:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.627899:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e2e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.628067:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.628075:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.628081:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.628086:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997922.628089:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.628096:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.628104:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:2.0:1789997922.628106:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997922.628110:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997922.628116:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e2d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997922.628125:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d75368a9 reply state 00000000446034c2 transno 4294967735 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997922.628134:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997922.628247:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58396:x1876946704598400:12345-192.168.204.4@tcp:36:rm.0 Request processed in 2751us (3786us total) trans 4294967735 rc 0/0 00000100:00100000:2.0:1789997922.628256:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1145 00010000:00010000:1.0:1789997922.628729:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997922.628737:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997922.628745:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997922.628748:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997922.628756:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997922.628767:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:1.0:1789997922.628770:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789997922.628774:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997922.628780:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e2ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997922.628797:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997922.628799:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997922.628801:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997922.632003:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997922.632024:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997922.632032:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997922.632039:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997922.632043:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997922.632051:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997922.632068:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38d0bdf800) 00010000:00010000:0.0:1789997922.632071:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997922.632076:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997922.632087:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e2dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997923.083085:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997924.109232:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789997924.671157:0:99577:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2113363499886ns, next at 2107006528139ns, rc = 0 00000004:00080000:3.0:1789997924.671302:0:99577:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2113363647333ns, next at 2112319867146ns, rc = 0 00000001:00080000:3.0:1789997924.713073:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967735 is committed 00000004:00080000:3.0:1789997924.713088:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 102 committed 00000004:00080000:3.0:1789997924.713111:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 103 committed 00000004:00080000:3.0:1789997924.713117:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00000100:00100000:3.0:1789997924.713499:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997924.713519:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713079168:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789997924.713589:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997924.713864:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713079168 00000100:00100000:1.0:1789997924.713872:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713079168 00000100:00100000:1.0:1789997924.713979:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1789997924.713989:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713079168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789997924.714015:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:36 count 1 00010000:00010000:1.0:1789997924.714040:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997924.714060:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997924.714069:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x24:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1789997924.714075:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997924.714079:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997924.714103:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 5 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997924.714116:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 5 pid: 6658 timeout: 2213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997924.714128:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8169:1876946713079296:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997924.714200:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae10000 going to sleep for 11 seconds 00000100:00080000:3.0:1789997924.714451:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997924.716305:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8169:1876946713079296:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789997924.716331:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997924.716736:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997924.716900:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704598528 00000100:00100000:3.0:1789997924.716907:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704598528 00010000:00010000:3.0:1789997924.716963:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 6 pid: 6658 timeout: 2213 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997924.717010:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 439 00000100:00100000:3.0:1789997924.717020:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704598528:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997924.717034:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997924.717040:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 6 pid: 6658 timeout: 2213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997924.717052:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 6 pid: 6658 timeout: 2213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997924.717078:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093c46b9c/0x65b43101d592e2c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf16c expref: 6 pid: 6658 timeout: 2213 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997924.717104:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997924.717108:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789997924.717114:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997924.717124:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997924.717372:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997924.717428:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704598528:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 408us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997924.717437:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 439 00000100:00080000:0.0:1789997924.717501:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789997924.718431:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997924.718446:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997924.718457:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997924.718466:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997924.718483:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997924.718678:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997924.718685:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997924.718693:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997924.718697:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997924.718705:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997924.718723:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997924.718731:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e2f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997924.718753:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997924.718755:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997924.718757:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997924.720595:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713079168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6602us (7000us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789997924.720607:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000004:00080000:3.0:1789997924.720883:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3bbb80/2, rc 0, transno 4294967369 00000100:00100000:3.0:1789997924.720993:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713079168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997924.811480:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713079808:0@lo:400:kworker.0 00000100:00100000:0.0:1789997924.811550:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997924.811612:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789997924.811619:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713079424:0@lo:400:kworker.0 00000100:00100000:1.0:1789997924.811796:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713079680:0@lo:400:kworker.0 00000100:00100000:1.0:1789997924.811831:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997924.811861:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997924.811868:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713079552:0@lo:400:kworker.0 00000100:00100000:1.0:1789997924.811902:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997924.811932:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713079680 00000100:00100000:1.0:1789997924.811939:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713079680 00000100:00100000:1.0:1789997924.811986:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713079552 00000100:00100000:1.0:1789997924.811989:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713079552 00000100:00100000:1.0:1789997924.812020:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:1.0:1789997924.812029:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713079680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997924.812080:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713079680:12345-0@lo:400:kworker.0 Request processed in 51us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997924.812087:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:1.0:1789997924.812105:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1789997924.812112:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713079552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997924.812139:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713079552:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997924.812145:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00080000:1.0:1789997924.812160:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997924.812186:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713079552:0@lo:400:kworker.0 00000100:00100000:1.0:1789997924.812197:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713079680:0@lo:400:kworker.0 00000100:00100000:0.0:1789997924.813522:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997924.813574:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713079936:0@lo:400:kworker.0 00000100:00100000:0.0:1789997924.813616:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997924.813677:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713079808 00000100:00100000:0.0:1789997924.813683:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713079808 00000100:00100000:3.0:1789997924.813805:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713079936 00000100:00100000:3.0:1789997924.813810:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713079936 00000100:00100000:3.0:1789997924.813857:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:3.0:1789997924.813865:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713079936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997924.813992:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713079936:12345-0@lo:400:kworker.0 Request processed in 127us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997924.814076:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00080000:3.0:1789997924.814099:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997924.814125:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713079936:0@lo:400:kworker.0 00000100:00100000:1.0:1789997924.814203:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713079424 00000100:00100000:1.0:1789997924.814207:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713079424 00000100:00100000:1.0:1789997924.814239:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1789997924.814245:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713079424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997924.814357:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713079424:12345-0@lo:400:kworker.0 Request processed in 112us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997924.814365:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1789997924.814988:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713079424:0@lo:400:kworker.0 00000100:00100000:0.0:1789997924.815132:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1789997924.815139:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713079808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997924.815180:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713079808:12345-0@lo:400:kworker.0 Request processed in 42us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997924.815185:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1789997924.815352:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:3.0:1789997924.815357:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38ffd73480, transno 4294967367 00000100:00100000:3.0:1789997924.815369:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713079808:0@lo:400:kworker.0 00000100:00080000:1.0:1789997924.815793:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789997925.137085:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997926.154905:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997926.679568:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997926.679721:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997926.679758:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997926.679789:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704598912 00000100:00100000:2.0:1789997926.679799:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704598912 00000100:00100000:0.0:1789997926.679816:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997926.679846:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704598656 00000100:00100000:0.0:1789997926.679861:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704598656 00000100:00100000:2.0:1789997926.679866:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704599040 00000100:00100000:2.0:1789997926.679872:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704599040 00000100:00100000:0.0:1789997926.679900:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1245 00000100:00100000:2.0:1789997926.679906:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1064 00000100:00100000:0.0:1789997926.679914:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704598656:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997926.679920:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704598912:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997926.679995:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704598656:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997926.680002:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1245 00000100:00080000:0.0:1789997926.680050:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997926.680055:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997926.680095:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1065 00000100:00100000:0.0:1789997926.680104:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704599040:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997926.681193:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704598912:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1271us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997926.681204:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1064 00000100:00100000:1.0:1789997926.684490:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704598784 00000100:00100000:1.0:1789997926.684514:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704598784 00000100:00100000:1.0:1789997926.684595:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1553 00000100:00100000:1.0:1789997926.684606:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704598784:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:2.0:1789997926.684691:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997926.684740:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704598784:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 136us (5182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997926.684748:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1553 00000100:00100000:0.0:1789997926.686034:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704599040:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 5925us (6269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997926.686046:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1065 00000100:00100000:2.0:1789997926.860918:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713080064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997926.860996:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997926.861282:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713080064 00000100:00100000:0.0:1789997926.861292:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713080064 00000100:00100000:0.0:1789997926.861368:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:0.0:1789997926.861378:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713080064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997926.861412:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997926.861467:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713080064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997926.861474:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00080000:2.0:1789997926.862397:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997926.862449:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713080064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997926.862893:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713080192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997926.862948:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997926.863199:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713080192 00000100:00100000:3.0:1789997926.863205:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713080192 00000100:00100000:3.0:1789997926.863258:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1789997926.863267:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713080192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997926.863297:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997926.863345:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713080192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997926.863361:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1789997926.863394:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713080192:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997926.864507:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997927.181424:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997927.430958:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967369 is committed 00010000:00010000:2.0:1789997928.203063:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997929.226835:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997929.941452:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713080320:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.941554:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997929.941601:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713080832:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.941630:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997929.941673:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789997929.941680:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713080448:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.941704:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997929.941722:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713080960:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.941740:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997929.941768:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713080704:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.941789:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997929.941807:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789997929.941812:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713080576:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.941832:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997929.941859:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713080320 00000100:00100000:1.0:1789997929.941866:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713080320 00000100:00100000:1.0:1789997929.941911:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1789997929.941920:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713080320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.941970:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713080320:12345-0@lo:400:kworker.0 Request processed in 52us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997929.941977:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1789997929.942007:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713080832 00000100:00100000:1.0:1789997929.942011:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713080832 00000100:00100000:1.0:1789997929.942043:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713080704 00000100:00100000:1.0:1789997929.942046:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713080704 00000100:00100000:1.0:1789997929.942067:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1789997929.942073:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713080832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942104:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713080832:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997929.942124:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1789997929.942136:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1789997929.942141:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713080704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942171:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713080704:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997929.942180:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1789997929.942197:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713080448 00000100:00100000:1.0:1789997929.942200:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713080448 00000100:00100000:1.0:1789997929.942222:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713080960 00000100:00100000:1.0:1789997929.942224:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713080960 00000100:00100000:1.0:1789997929.942239:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713080576 00000100:00100000:1.0:1789997929.942242:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713080576 00000100:00100000:1.0:1789997929.942260:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:1.0:1789997929.942266:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713080448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942295:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713080448:12345-0@lo:400:kworker.0 Request processed in 29us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997929.942301:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:1.0:1789997929.942312:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:1.0:1789997929.942318:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713080960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942343:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713080960:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997929.942348:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:1.0:1789997929.942359:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:1.0:1789997929.942364:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713080576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942389:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713080576:12345-0@lo:400:kworker.0 Request processed in 25us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997929.942394:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:1.0:1789997929.942440:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713080448:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942450:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713080960:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942458:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713080320:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942466:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:1.0:1789997929.942471:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3bbb80, transno 4294967369 00000100:00100000:1.0:1789997929.942481:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713080832:0@lo:400:kworker.0 00000100:00080000:1.0:1789997929.942511:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997929.942516:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997929.942518:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997929.942539:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713080576:0@lo:400:kworker.0 00000100:00100000:1.0:1789997929.942561:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffd71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713080704:0@lo:400:kworker.0 00010000:00010000:0.0:1789997930.251100:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997931.278593:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997931.800610:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997931.800685:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997931.800703:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704599168 00000100:00100000:0.0:1789997931.800715:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704599168 00000100:00100000:1.0:1789997931.800733:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997931.800897:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704599296 00000100:00100000:2.0:1789997931.800901:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704599296 00000100:00100000:2.0:1789997931.800944:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1557 00000100:00100000:2.0:1789997931.800955:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704599296:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997931.800962:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704599424 00000100:00100000:3.0:1789997931.800968:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704599424 00000100:00100000:3.0:1789997931.801009:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1068 00000100:00100000:3.0:1789997931.801020:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704599424:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997931.801040:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704599296:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997931.801049:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1557 00000100:00100000:3.0:1789997931.801058:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704599424:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997931.801066:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1068 00000100:00100000:1.0:1789997931.801421:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1247 00000100:00100000:1.0:1789997931.801431:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704599168:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997931.801477:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704599168:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 48us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997931.801484:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1247 00000100:00080000:1.0:1789997931.801521:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997931.801526:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997931.805957:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997931.806100:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704599552 00000100:00100000:2.0:1789997931.806111:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704599552 00000100:00100000:2.0:1789997931.806191:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1069 00000100:00100000:2.0:1789997931.806201:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704599552:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997931.806286:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704599552:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997931.806294:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1069 00000100:00080000:1.0:1789997931.806488:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997931.980556:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789997931.980582:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713081088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997931.980671:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997931.980750:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713081088 00000100:00100000:3.0:1789997931.980757:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713081088 00000100:00100000:3.0:1789997931.980825:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:3.0:1789997931.980835:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713081088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997931.980872:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997931.980922:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713081088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997931.980928:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00080000:3.0:1789997931.980951:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997931.980984:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713081088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997931.982484:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997931.982514:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713081216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997931.982568:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997931.982693:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713081216 00000100:00100000:1.0:1789997931.982701:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713081216 00000100:00100000:1.0:1789997931.982767:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1789997931.982777:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713081216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997931.982817:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997931.982874:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713081216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997931.982881:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:2.0:1789997931.982924:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713081216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997931.983015:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789997932.299004:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997933.322996:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997934.347901:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997935.051795:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713081472:0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.051862:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997935.051923:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713081984:0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.051943:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997935.051968:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789997935.051973:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713081344:0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.051999:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997935.052174:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713081856:0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.052201:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997935.052227:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713081600:0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.052248:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997935.052268:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997935.052273:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713081728:0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.052292:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997935.052325:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713081472 00000100:00100000:3.0:1789997935.052332:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713081472 00000100:00100000:3.0:1789997935.052873:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713081984 00000100:00100000:3.0:1789997935.052878:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713081984 00000100:00100000:3.0:1789997935.052907:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713081600 00000100:00100000:3.0:1789997935.052910:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713081600 00000100:00100000:3.0:1789997935.052934:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:3.0:1789997935.052943:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713081472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.053002:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713081472:12345-0@lo:400:kworker.0 Request processed in 60us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997935.055542:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713081856 00000100:00100000:1.0:1789997935.055556:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713081856 00000100:00100000:1.0:1789997935.055612:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713081728 00000100:00100000:1.0:1789997935.055616:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713081728 00000100:00100000:3.0:1789997935.055623:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:1.0:1789997935.055647:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1789997935.055672:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:3.0:1789997935.055685:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713081984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997935.055694:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713081856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997935.055868:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1789997935.055879:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713081728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997935.056082:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713081856:12345-0@lo:400:kworker.0 Request processed in 426us (3878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997935.056089:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:1.0:1789997935.056112:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:1.0:1789997935.056121:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713081600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997935.056163:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713081600:12345-0@lo:400:kworker.0 Request processed in 44us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997935.056169:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:1.0:1789997935.056194:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713081344 00000100:00100000:1.0:1789997935.056198:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713081344 00000100:00100000:1.0:1789997935.056222:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1789997935.056228:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713081344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997935.056631:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713081600:0@lo:400:kworker.0 00000100:00080000:0.0:1789997935.056731:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997935.056735:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997935.056737:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997935.057205:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713081984:12345-0@lo:400:kworker.0 Request processed in 1521us (5256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997935.057216:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:3.0:1789997935.057334:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713081856:0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.057348:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713081472:0@lo:400:kworker.0 00000100:00100000:3.0:1789997935.057359:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713081984:0@lo:400:kworker.0 00000100:00100000:2.0:1789997935.059080:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713081728:12345-0@lo:400:kworker.0 Request processed in 3199us (6780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997935.059092:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1789997935.059150:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713081728:0@lo:400:kworker.0 00000100:00100000:1.0:1789997935.062541:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713081344:12345-0@lo:400:kworker.0 Request processed in 6304us (10532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997935.062556:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1789997935.062642:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713081344:0@lo:400:kworker.0 00010000:00010000:1.0:1789997935.371891:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997936.395604:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997936.923865:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997936.923902:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997936.923932:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997936.923960:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997936.924030:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704599680 00000100:00100000:1.0:1789997936.924040:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704599680 00000100:00100000:1.0:1789997936.924103:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1249 00000100:00100000:1.0:1789997936.924113:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704599680:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997936.924311:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704599680:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 199us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997936.924319:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1249 00000100:00100000:1.0:1789997936.924354:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704599936 00000100:00100000:1.0:1789997936.924358:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704599936 00000100:00100000:1.0:1789997936.924390:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704600064 00000100:00100000:1.0:1789997936.924393:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704600064 00000100:00100000:1.0:1789997936.924425:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1072 00000100:00100000:1.0:1789997936.924433:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704599936:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997936.924464:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704599936:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997936.924790:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1072 00000100:00100000:1.0:1789997936.924806:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1073 00000100:00100000:1.0:1789997936.924813:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704600064:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997936.924842:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704600064:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997936.924848:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1073 00000100:00100000:0.0:1789997936.925104:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704599808 00000100:00100000:0.0:1789997936.925109:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704599808 00000100:00100000:0.0:1789997936.925146:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1561 00000100:00100000:0.0:1789997936.925153:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704599808:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997936.925196:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704599808:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 44us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997936.925202:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1561 00000100:00080000:0.0:1789997936.925218:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997936.925222:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997936.925224:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997937.099011:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713082240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997937.099097:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997937.099175:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789997937.099182:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713082112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997937.099217:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997937.099257:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713082240 00000100:00100000:1.0:1789997937.099265:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713082240 00000100:00100000:1.0:1789997937.099323:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713082112 00000100:00100000:1.0:1789997937.099327:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713082112 00000100:00100000:1.0:1789997937.099345:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1789997937.099354:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713082240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997937.099389:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997937.099450:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713082240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997937.099457:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1789997937.099487:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1789997937.099493:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713082112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997937.099512:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997937.099540:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713082112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997937.099545:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00080000:0.0:1789997937.099758:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997937.099762:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997937.099797:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713082112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997937.099809:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713082240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789997937.418950:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997938.442945:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997939.467095:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997940.171366:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713082368:0@lo:400:kworker.0 00000100:00100000:0.0:1789997940.171390:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713082624:0@lo:400:kworker.0 00000100:00100000:1.0:1789997940.171448:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713082496:0@lo:400:kworker.0 00000100:00100000:2.0:1789997940.173866:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713082752:0@lo:400:kworker.0 00000100:00100000:3.0:1789997940.175786:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997940.175786:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997940.175971:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713082880:0@lo:400:kworker.0 00000100:00100000:0.0:1789997940.175990:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713082624 00000100:00100000:0.0:1789997940.176000:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713082624 00000100:00100000:3.0:1789997940.176012:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997940.176057:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713082368 00000100:00100000:3.0:1789997940.176062:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713082368 00000100:00100000:0.0:1789997940.176063:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:0.0:1789997940.176076:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713082624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997940.176100:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1789997940.176108:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713082368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997940.179379:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713082880 00000100:00100000:1.0:1789997940.179395:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713082880 00000100:00100000:1.0:1789997940.179466:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1789997940.179472:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997940.179475:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713082880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997940.179494:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713082624:12345-0@lo:400:kworker.0 Request processed in 3418us (3713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997940.179507:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:2.0:1789997940.179508:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713082752 00000100:00100000:2.0:1789997940.179513:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713082752 00000100:00100000:1.0:1789997940.179544:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713082880:12345-0@lo:400:kworker.0 Request processed in 70us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997940.179545:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1789997940.179550:0:6658:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789997940.179551:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1789997940.179554:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713082752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997940.179562:0:6658:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:0.0:1789997940.179581:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997940.179587:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997940.179591:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997940.179603:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997940.179606:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713082752:12345-0@lo:400:kworker.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997940.179611:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1789997940.179704:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713083008:0@lo:400:kworker.0 00000100:00100000:1.0:1789997940.179739:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997940.179809:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713082624:0@lo:400:kworker.0 00000100:00100000:1.0:1789997940.179948:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713082880:0@lo:400:kworker.0 00000100:00100000:2.0:1789997940.180259:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713082752:0@lo:400:kworker.0 00000100:00100000:0.0:1789997940.180416:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713082496 00000100:00100000:0.0:1789997940.180421:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713082496 00000100:00100000:0.0:1789997940.180474:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713083008 00000100:00100000:0.0:1789997940.180477:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713083008 00000100:00100000:0.0:1789997940.180516:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:0.0:1789997940.180525:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713082496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997940.180530:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1789997940.180579:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713082496:12345-0@lo:400:kworker.0 Request processed in 56us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997940.180587:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00080000:0.0:1789997940.180606:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997940.180631:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713082496:0@lo:400:kworker.0 00000100:00100000:2.0:1789997940.180966:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713083008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997940.181011:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713083008:12345-0@lo:400:kworker.0 Request processed in 472us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997940.181097:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1789997940.183356:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713082368:12345-0@lo:400:kworker.0 Request processed in 7233us (7563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997940.183368:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1789997940.184542:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713082368:0@lo:400:kworker.0 00000100:00100000:0.0:1789997940.187476:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713083008:0@lo:400:kworker.0 00000100:00100000:3.0:1789997940.198769:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997940.198915:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704600192 00000100:00100000:0.0:1789997940.198926:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704600192 00000100:00100000:0.0:1789997940.199020:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1146 00000100:00100000:0.0:1789997940.199031:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58614:x1876946704600192:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997940.199123:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58614:x1876946704600192:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 94us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997940.199130:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1146 00000100:00080000:2.0:1789997940.199202:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997940.203863:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997940.204128:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704600320 00000100:00100000:2.0:1789997940.204138:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704600320 00000100:00100000:2.0:1789997940.204214:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 616 00000100:00100000:2.0:1789997940.204225:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58614:x1876946704600320:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:2.0:1789997940.204551:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58614:x1876946704600320:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 327us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997940.204559:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 616 00000100:00080000:0.0:1789997940.205691:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997940.209533:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997940.209650:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704600448 00000100:00100000:1.0:1789997940.209692:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704600448 00000100:00100000:1.0:1789997940.209758:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 617 00000100:00100000:1.0:1789997940.209767:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58614:x1876946704600448:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997940.210156:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58614:x1876946704600448:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 389us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997940.210163:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 617 00000100:00080000:0.0:1789997940.210247:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997940.216592:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997940.216739:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704600576 00000100:00100000:0.0:1789997940.216750:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704600576 00000100:00100000:0.0:1789997940.216814:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1147 00000100:00100000:0.0:1789997940.216824:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58614:x1876946704600576:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997940.217282:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58614:x1876946704600576:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 458us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997940.217290:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1147 00000100:00100000:3.0:1789997940.222141:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997940.222290:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704600704 00000100:00100000:2.0:1789997940.222300:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704600704 00000100:00100000:2.0:1789997940.222368:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1148 00000100:00100000:2.0:1789997940.222378:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58614:x1876946704600704:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997940.222482:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58614:x1876946704600704:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 105us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997940.222490:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1148 00000100:00100000:3.0:1789997940.224145:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997940.224325:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704600832 00000100:00100000:0.0:1789997940.224333:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704600832 00000100:00100000:0.0:1789997940.224392:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 618 00000100:00100000:0.0:1789997940.224403:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58614:x1876946704600832:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997940.224793:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58614:x1876946704600832:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 392us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997940.224800:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 618 00000100:00100000:3.0:1789997940.226744:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997940.227993:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704600960 00000100:00100000:1.0:1789997940.228004:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704600960 00000100:00100000:1.0:1789997940.228072:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 619 00000100:00100000:1.0:1789997940.228083:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58614:x1876946704600960:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997940.228469:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58614:x1876946704600960:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 387us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997940.228477:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 619 00000100:00100000:3.0:1789997940.230522:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997940.231700:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704601088 00000100:00100000:0.0:1789997940.231711:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704601088 00000100:00100000:0.0:1789997940.231816:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1149 00000100:00100000:0.0:1789997940.231825:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58614:x1876946704601088:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997940.232686:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58614:x1876946704601088:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 830us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997940.232695:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1149 00010000:00010000:1.0:1789997940.494647:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997941.521317:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997941.609328:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997941.609421:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704601216 00000100:00100000:0.0:1789997941.609432:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704601216 00000100:00100000:0.0:1789997941.609493:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1150 00000100:00100000:0.0:1789997941.609504:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58628:x1876946704601216:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997941.609525:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997941.609545:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e2f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf173 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.609623:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e2ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.609638:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e2ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.609681:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e2ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997941.609717:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:0.0:1789997941.609722:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997941.609739:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e2ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.609763:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e2f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf173 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.609789:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e2ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf173 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.609798:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:0.0:1789997941.609802:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997941.609805:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997941.609856:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58628:x1876946704601216:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 354us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997941.609863:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1150 00000100:00100000:3.0:1789997941.614432:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997941.614643:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704601472 00000100:00100000:2.0:1789997941.616455:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704601472 00000100:00100000:2.0:1789997941.616589:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1151 00000100:00100000:2.0:1789997941.616602:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58628:x1876946704601472:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997941.616673:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997941.616703:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e2ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf173 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.616730:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e29d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf15e expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.616741:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:2.0:1789997941.616752:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997941.616779:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.616793:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.616803:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997941.681599:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f3f1b84 reply state 000000004bfccf89 transno 4294967736 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997941.681624:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997941.681640:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000100:00100000:0.0:1789997941.681786:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58628:x1876946704601472:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 65182us (67359us total) trans 4294967736 rc 0/0 00000100:00100000:0.0:1789997941.681795:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1151 00000001:00080000:3.0:1789997941.682268:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967736 is committed 00010000:00010000:0.0:1789997941.682513:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.682523:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.682529:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.682535:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997941.682540:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.682605:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.682623:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:0.0:1789997941.682626:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997941.682632:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.682637:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e306 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997941.765774:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997941.765875:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704601600 00000100:00100000:1.0:1789997941.765886:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704601600 00000100:00100000:1.0:1789997941.765982:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1152 00000100:00100000:1.0:1789997941.765993:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58632:x1876946704601600:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997941.766016:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997941.766036:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e30d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf17a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766097:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766115:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766126:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766141:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766147:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766153:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766469:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e322 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766479:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766486:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997941.766508:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:1.0:1789997941.766512:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997941.766531:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e322 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766544:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766554:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766561:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766566:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997941.766570:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766578:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766589:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:1.0:1789997941.766592:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997941.766597:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766604:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766616:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766622:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766628:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766633:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997941.766637:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766642:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766649:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38e062d800) 00010000:00010000:1.0:1789997941.766695:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997941.766698:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766704:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e31b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766734:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e30d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf17a expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766747:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e322 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf17a expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.766755:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789997941.766757:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997941.766759:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997941.766825:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58632:x1876946704601600:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 833us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997941.766833:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1152 00000100:00100000:3.0:1789997941.775886:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997941.776170:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704601856 00000100:00100000:0.0:1789997941.776180:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704601856 00000100:00100000:0.0:1789997941.776284:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1153 00000100:00100000:0.0:1789997941.776294:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58632:x1876946704601856:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:0.0:1789997941.776329:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997941.776349:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e329 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf181 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.776621:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.776638:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.776650:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.776703:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.776711:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.776718:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997941.777451:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24:0x0], index 0: 0 00010000:00010000:0.0:1789997941.777758:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e33e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777771:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777784:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777820:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777827:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777834:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777840:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997941.777845:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777851:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777863:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:0.0:1789997941.777866:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997941.777872:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777878:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e330 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997941.777892:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd2e133a reply state 00000000c2b97b46 transno 4294967737 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997941.777900:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997941.777934:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e329 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf181 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777957:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf181 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.777964:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997941.777966:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997941.777968:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997941.778041:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58632:x1876946704601856:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1749us (2164us total) trans 4294967737 rc 0/0 00000100:00100000:0.0:1789997941.778049:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1153 00010000:00010000:0.0:1789997941.787513:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.787533:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.787542:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.787549:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997941.787554:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.787563:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.787583:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997941.787586:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997941.787593:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.787599:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e337 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997941.788035:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997941.788563:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704602112 00000100:00100000:0.0:1789997941.788573:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704602112 00000100:00100000:0.0:1789997941.788637:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1154 00000100:00100000:0.0:1789997941.788649:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58632:x1876946704602112:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:0.0:1789997941.788743:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997941.788763:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e33e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf181 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.788785:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997941.788794:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997941.788834:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.788846:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.788857:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997941.789434:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afa4d918 reply state 00000000d12d36ec transno 4294967738 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997941.789446:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997941.789640:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58632:x1876946704602112:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 991us (1606us total) trans 4294967738 rc 0/0 00000100:00100000:0.0:1789997941.789651:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1154 00000100:00100000:3.0:1789997941.792820:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:0.0:1789997941.792871:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.792883:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.792900:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.792907:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997941.792912:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.792919:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.792935:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997941.792947:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997941.792952:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.792959:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e34c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997941.793052:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704602240 00000100:00100000:1.0:1789997941.793061:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704602240 00000100:00100000:1.0:1789997941.793129:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1155 00000100:00100000:1.0:1789997941.793139:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58632:x1876946704602240:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997941.793160:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997941.793176:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e353 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf188 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.793227:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e353 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf188 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.793239:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e353 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf188 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997941.793254:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff8a38e062d800) 00010000:00010000:1.0:1789997941.793257:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789997941.793259:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789997941.793998:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58632:x1876946704602240:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 857us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997941.794006:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1155 00000100:00100000:3.0:1789997941.797407:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997941.797631:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704602368 00000100:00100000:2.0:1789997941.797640:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704602368 00000100:00100000:2.0:1789997941.797712:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 620 00000100:00100000:2.0:1789997941.797722:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704602368:12345-192.168.204.4@tcp:2:touch.60003 00000100:00100000:2.0:1789997941.798640:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704602368:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 915us (1236us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789997941.798650:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 620 00000100:00100000:2.0:1789997941.805475:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997941.805607:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704602624 00000100:00100000:0.0:1789997941.805618:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704602624 00000100:00100000:0.0:1789997941.805719:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 117 00000100:00100000:0.0:1789997941.805730:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de233850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58632:x1876946704602624:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:0.0:1789997941.806117:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de233850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58632:x1876946704602624:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 388us (651us total) trans 4294967739 rc 0/0 00000100:00100000:0.0:1789997941.806126:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 117 00000100:00100000:0.0:1789997941.871688:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997941.871938:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704602752 00000100:00100000:2.0:1789997941.871948:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704602752 00000100:00100000:2.0:1789997941.872019:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1156 00000100:00100000:2.0:1789997941.872031:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58636:x1876946704602752:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:2.0:1789997941.872200:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997941.872222:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e35a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf18f expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872294:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872307:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872328:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872343:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872350:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872357:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872448:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e36f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872456:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872463:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997941.872496:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5f:0x0]: returning size 0 00000004:00200000:2.0:1789997941.872501:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997941.872520:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872532:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872549:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872555:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872561:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872567:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997941.872572:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872579:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872591:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:2.0:1789997941.872595:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997941.872599:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872605:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e361 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872617:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872621:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872628:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872632:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997941.872634:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872640:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.872646:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997941.872648:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997941.872651:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.873067:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e368 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.873104:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e35a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf18f expref: 13 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.873119:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e36f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf18f expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.873126:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff8a38e062d800) 00010000:00010000:2.0:1789997941.873129:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997941.873132:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3200, rc 0) 00000100:00100000:2.0:1789997941.873213:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58636:x1876946704602752:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 1184us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997941.873225:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1156 00000100:00100000:3.0:1789997941.878068:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997941.878891:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704602880 00000100:00100000:2.0:1789997941.878904:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704602880 00000100:00100000:2.0:1789997941.879250:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 621 00000100:00100000:2.0:1789997941.879262:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704602880:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:2.0:1789997941.879290:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997941.879310:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf196 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997941.879347:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x6ab13375, atime: 0x6ab13375, ctime: 0x6ab13375, blocks: 0x1 00010000:00010000:2.0:1789997941.879368:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=2130s v=(0 0) 00010000:00010000:2.0:1789997941.879372:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997941.879382:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.879402:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.879414:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2000, rc 0) 00000100:00100000:2.0:1789997941.879480:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704602880:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 221us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997941.879486:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 621 00000100:00100000:3.0:1789997941.883801:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997941.883971:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704603136 00000100:00100000:0.0:1789997941.883982:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704603136 00000100:00100000:0.0:1789997941.884053:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1157 00000100:00100000:0.0:1789997941.884072:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58636:x1876946704603136:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:0.0:1789997941.884125:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997941.884151:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e36f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf18f expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884175:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e353 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf188 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884188:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff8a38e062d800) 00010000:00010000:0.0:1789997941.884196:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997941.884218:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884231:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884241:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884255:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884261:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884269:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884606:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884615:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.884622:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789997941.885599:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].36, 64 off10496 00000004:00080000:0.0:1789997941.885611:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2130577956498ns, next at 2131577954303ns, rc = 0 00010000:00010000:0.0:1789997941.885697:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885710:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885720:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885729:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885735:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885741:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885768:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997941.885792:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885799:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885806:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885812:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997941.885817:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885825:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885835:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997941.885839:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997941.885843:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885849:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e38b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885873:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885879:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885889:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885894:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997941.885896:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885902:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997941.885910:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:0.0:1789997941.885912:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997941.885915:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997941.886078:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997941.886085:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997941.886092:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997941.886095:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997941.886101:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997941.886110:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:3.0:1789997941.886112:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997941.886115:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997941.886121:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e392 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997941.886138:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997941.886140:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997941.886141:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997941.886614:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e37d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997941.886630:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034a868de reply state 00000000ee0923a6 transno 4294967740 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997941.886638:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997941.886817:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58636:x1876946704603136:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 2743us (3023us total) trans 4294967740 rc 0/0 00000100:00100000:0.0:1789997941.886826:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1157 00010000:00010000:2.0:1789997941.897464:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.897482:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.897491:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.897497:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997941.897501:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.897509:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.897524:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38c28e9400) 00010000:00010000:2.0:1789997941.897526:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997941.897531:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997941.897537:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e384 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997942.039080:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997942.039183:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704603264 00000100:00100000:1.0:1789997942.039193:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704603264 00000100:00100000:1.0:1789997942.039255:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1251 00000100:00100000:1.0:1789997942.039266:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704603264:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997942.039355:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704603264:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997942.039481:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1251 00000100:00100000:3.0:1789997942.040358:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997942.040485:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997942.040569:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704603392 00000100:00100000:0.0:1789997942.040576:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704603392 00000100:00100000:0.0:1789997942.040634:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1565 00000100:00100000:0.0:1789997942.040643:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:2355:x1876946704603392:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997942.040729:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:2355:x1876946704603392:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 86us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997942.040736:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1565 00000100:00080000:3.0:1789997942.041136:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997942.041345:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704603520 00000100:00100000:1.0:1789997942.041351:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704603520 00000100:00100000:1.0:1789997942.041490:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1076 00000100:00100000:1.0:1789997942.041499:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704603520:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1789997942.041614:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997942.041912:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704603520:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 412us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997942.041919:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1076 00000100:00100000:0.0:1789997942.046096:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997942.047027:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704603648 00000100:00100000:1.0:1789997942.047041:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704603648 00000100:00100000:1.0:1789997942.047107:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1077 00000100:00100000:1.0:1789997942.047118:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704603648:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997942.047193:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704603648:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 78us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997942.047201:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1077 00000100:00080000:1.0:1789997942.047223:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997942.218934:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713083136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997942.219009:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997942.219092:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713083136 00000100:00100000:0.0:1789997942.219100:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713083136 00000100:00100000:0.0:1789997942.219155:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1789997942.219165:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713083136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997942.219201:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997942.219250:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713083136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997942.219257:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00080000:0.0:1789997942.219278:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997942.219326:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713083136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997942.219620:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713083264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997942.219691:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997942.219728:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713083264 00000100:00100000:2.0:1789997942.219733:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713083264 00000100:00100000:2.0:1789997942.219764:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1789997942.219770:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713083264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997942.219791:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997942.219825:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713083264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997942.219830:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1789997942.219858:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713083264:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997942.219946:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997942.541909:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997942.795277:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00000100:00100000:0.0:1789997942.823253:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997942.824456:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704603776 00000100:00100000:1.0:1789997942.824470:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704603776 00000100:00100000:0.0:1789997942.824634:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1158 00000100:00100000:0.0:1789997942.824646:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58651:x1876946704603776:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997942.824692:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997942.824714:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf19d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.824776:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e3a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.824792:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.824804:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997942.827983:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:0.0:1789997942.827994:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997942.828030:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.828072:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf19d expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.828107:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf19d expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.828116:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:0.0:1789997942.828120:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997942.828124:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997942.828207:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58651:x1876946704603776:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 3563us (4961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997942.828216:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1158 00000100:00100000:0.0:1789997942.833598:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997942.833692:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704604032 00000100:00100000:1.0:1789997942.833702:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704604032 00000100:00100000:1.0:1789997942.833753:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1159 00000100:00100000:1.0:1789997942.833763:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58651:x1876946704604032:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997942.833814:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997942.833858:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e3a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf19d expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.833889:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e322 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf17a expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.833900:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789997942.833910:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997942.833936:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.833947:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.833957:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997942.905640:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9761090 reply state 000000000827cdb7 transno 4294967741 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997942.905728:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997942.905745:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000100:00100000:0.0:1789997942.905918:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:58651:x1876946704604032:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 72151us (72323us total) trans 4294967741 rc 0/0 00000100:00100000:0.0:1789997942.905927:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1159 00000001:00080000:0.0:1789997942.905965:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967740 is committed 00000004:00080000:0.0:1789997942.905971:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00000001:00080000:0.0:1789997942.906001:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967741 is committed 00010000:00010000:0.0:1789997942.906134:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906144:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906152:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906159:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997942.906163:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906170:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906185:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:0.0:1789997942.906188:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997942.906194:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906200:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e3a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997942.906234:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713083392:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997942.906289:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997942.906379:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713083392 00000100:00100000:0.0:1789997942.906387:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713083392 00000100:00100000:0.0:1789997942.906429:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1789997942.906439:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713083392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997942.906466:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:36 count 1 00010000:00010000:0.0:1789997942.906489:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906508:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906516:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789997942.906520:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997942.906525:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906553:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 5 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.906567:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 5 pid: 8169 timeout: 2231 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997942.906579:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946713083520:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997942.906636:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789997942.917867:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997942.918735:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8169:1876946713083520:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997942.918767:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997942.919382:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704604160 00000100:00100000:1.0:1789997942.919392:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704604160 00010000:00010000:1.0:1789997942.919510:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 6 pid: 8169 timeout: 2231 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997942.919579:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 440 00000100:00100000:1.0:1789997942.919590:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704604160:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789997942.919607:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997942.919613:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 6 pid: 8169 timeout: 2231 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.919628:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 6 pid: 8169 timeout: 2231 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.919698:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5926ff1/0x65b43101d592e376 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf196 expref: 6 pid: 8169 timeout: 2231 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.919714:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997942.919717:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997942.919723:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.919733:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.919760:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789997942.919812:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704604160:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 224us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997942.919819:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 440 00010000:00010000:0.0:1789997942.920247:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.920258:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.920267:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.920275:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997942.920309:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789997942.921079:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713083392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14639us (14788us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1789997942.921088:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000004:00080000:0.0:1789997942.921138:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c571c380/2, rc 0, transno 4294967369 00000100:00100000:0.0:1789997942.921146:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713083392:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789997942.922643:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997942.922678:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.922693:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997942.922698:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.922708:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.922746:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.922753:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088474211/0x65b43101d592e3ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997942.922786:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997942.922788:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997942.922790:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997942.981181:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997942.981273:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704604288 00000100:00100000:2.0:1789997942.981285:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704604288 00000100:00100000:2.0:1789997942.981357:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1160 00000100:00100000:2.0:1789997942.981368:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58655:x1876946704604288:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997942.981393:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997942.981413:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1a4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981488:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981503:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981514:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981527:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981534:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981541:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981881:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e3ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981891:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981900:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997942.981922:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789997942.981926:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997942.981944:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981954:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981961:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981968:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981974:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997942.981978:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981985:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.981996:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:2.0:1789997942.981999:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997942.982004:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982010:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e3bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982024:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982030:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982034:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982039:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997942.982041:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982046:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982053:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38d0bdf200) 00010000:00010000:2.0:1789997942.982056:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997942.982060:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982066:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982096:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1a4 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982109:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1a4 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997942.982120:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997942.982122:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997942.982125:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789997942.982183:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58655:x1876946704604288:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 817us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997942.982192:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1160 00010000:00010000:3.0:1789997943.564744:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997944.018785:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.018903:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704604416 00000100:00100000:2.0:1789997944.018914:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704604416 00000100:00100000:2.0:1789997944.019005:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1161 00000100:00100000:2.0:1789997944.019016:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58669:x1876946704604416:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997944.019036:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997944.019056:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1ab expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.019117:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.019131:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.019142:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997944.019177:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789997944.019182:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997944.019201:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.019231:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ab expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.019248:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ab expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.019257:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997944.019260:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997944.019264:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2400, rc 0) 00000100:00100000:2.0:1789997944.019337:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58669:x1876946704604416:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 323us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997944.019345:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1161 00000100:00080000:3.0:1789997944.019740:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997944.021966:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.022107:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704604672 00000100:00100000:2.0:1789997944.022116:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704604672 00000100:00100000:2.0:1789997944.022174:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1162 00000100:00100000:2.0:1789997944.022185:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58669:x1876946704604672:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997944.022233:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997944.022258:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ab expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.022294:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e3ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1a4 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.022305:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997944.022315:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997944.022336:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.022349:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.022358:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997944.022731:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064abaec6 reply state 0000000082379fc6 transno 4294967742 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997944.022742:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997944.022749:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000100:00100000:2.0:1789997944.022823:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58669:x1876946704604672:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 639us (862us total) trans 4294967742 rc 0/0 00000100:00100000:2.0:1789997944.022830:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1162 00010000:00010000:3.0:1789997944.027806:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.027823:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.027831:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.027838:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997944.027843:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.027851:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.027868:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38d0bdf200) 00010000:00010000:3.0:1789997944.027871:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997944.027875:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.027882:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e3df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997944.187538:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.187823:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704604800 00000100:00100000:2.0:1789997944.187834:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704604800 00000100:00100000:2.0:1789997944.187895:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1163 00000100:00100000:2.0:1789997944.187906:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58681:x1876946704604800:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997944.188017:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58681:x1876946704604800:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 112us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997944.188024:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1163 00000100:00100000:2.0:1789997944.190013:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997944.190123:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704604928 00000100:00100000:1.0:1789997944.190131:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704604928 00000100:00100000:1.0:1789997944.190188:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 623 00000100:00100000:1.0:1789997944.190197:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58681:x1876946704604928:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789997944.190533:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58681:x1876946704604928:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 336us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997944.190541:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 623 00000100:00080000:3.0:1789997944.190752:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997944.192284:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.192360:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704605056 00000100:00100000:2.0:1789997944.192368:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704605056 00000100:00100000:2.0:1789997944.192458:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 624 00000100:00100000:2.0:1789997944.192469:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58681:x1876946704605056:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997944.192833:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58681:x1876946704605056:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 365us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997944.192840:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 624 00000100:00080000:3.0:1789997944.193158:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997944.194122:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.194187:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704605184 00000100:00100000:2.0:1789997944.194193:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704605184 00000100:00100000:2.0:1789997944.194240:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1164 00000100:00100000:2.0:1789997944.194249:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58681:x1876946704605184:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997944.194631:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58681:x1876946704605184:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 382us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997944.194639:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1164 00000100:00100000:1.0:1789997944.197991:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.198064:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704605312 00000100:00100000:2.0:1789997944.198074:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704605312 00000100:00100000:2.0:1789997944.198132:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1165 00000100:00100000:2.0:1789997944.198142:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58681:x1876946704605312:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997944.198246:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58681:x1876946704605312:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997944.198253:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1165 00000100:00100000:1.0:1789997944.201067:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997944.201156:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704605440 00000100:00100000:3.0:1789997944.201166:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704605440 00000100:00100000:3.0:1789997944.201217:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 625 00000100:00100000:3.0:1789997944.201228:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58681:x1876946704605440:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997944.201598:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58681:x1876946704605440:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 371us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997944.201607:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 625 00000100:00100000:0.0:1789997944.203259:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.203349:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704605568 00000100:00100000:2.0:1789997944.203358:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704605568 00000100:00100000:2.0:1789997944.203493:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 626 00000100:00100000:2.0:1789997944.203504:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58681:x1876946704605568:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997944.204233:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58681:x1876946704605568:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 729us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997944.204242:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 626 00000100:00100000:2.0:1789997944.206531:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997944.206602:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704605696 00000100:00100000:0.0:1789997944.206611:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704605696 00000100:00100000:0.0:1789997944.206695:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1166 00000100:00100000:0.0:1789997944.206705:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58681:x1876946704605696:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997944.207121:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58681:x1876946704605696:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 416us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997944.207129:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1166 00000100:00100000:1.0:1789997944.283939:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.284033:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704605824 00000100:00100000:2.0:1789997944.284044:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704605824 00000100:00100000:2.0:1789997944.284099:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1167 00000100:00100000:2.0:1789997944.284108:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:58685:x1876946704605824:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:2.0:1789997944.284129:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997944.284148:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1b2 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.284213:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.284229:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.284239:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.284252:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.284258:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.284273:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287516:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e3fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287539:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287551:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997944.287586:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:3.0:1789997944.287590:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997944.287611:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e3fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287623:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287629:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287639:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287645:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997944.287649:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287673:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287685:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:3.0:1789997944.287687:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997944.287692:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287698:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e3ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287711:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287717:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287723:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287727:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997944.287730:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287739:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287745:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38d0bdff00) 00010000:00010000:3.0:1789997944.287748:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997944.287750:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287756:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e3f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287790:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2400/0x65b43101d592e3e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1b2 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287804:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e3fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1b2 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.287811:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:3.0:1789997944.287813:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997944.287815:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789997944.287895:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58685:x1876946704605824:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 3787us (3970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997944.287904:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1167 00000100:00100000:3.0:1789997944.297380:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997944.297502:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704606080 00000100:00100000:0.0:1789997944.297514:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704606080 00000100:00100000:0.0:1789997944.297577:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1168 00000100:00100000:0.0:1789997944.297588:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58685:x1876946704606080:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997944.297609:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997944.297628:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e402 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1b9 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.297926:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.297942:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.297953:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.297969:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.297976:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.297982:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997944.298708:0:11799:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25:0x0], index 1: 0 00010000:00010000:0.0:1789997944.298947:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e417 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.298960:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.298969:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e417 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299004:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299011:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299016:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299022:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997944.299026:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299033:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299044:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:0.0:1789997944.299047:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997944.299052:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299058:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e409 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997944.299073:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027e79933 reply state 00000000d93bff52 transno 4294967743 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997944.299082:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997944.299112:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e402 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1b9 expref: 11 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299134:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e417 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1b9 expref: 10 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997944.299140:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997944.299142:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997944.299144:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997944.299207:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:58685:x1876946704606080:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 1620us (1837us total) trans 4294967743 rc 0/0 00000100:00100000:0.0:1789997944.299215:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1168 00010000:00010000:3.0:1789997944.300871:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.300886:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.300894:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.300900:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997944.300904:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.300911:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.300927:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38c28e9d00) 00010000:00010000:3.0:1789997944.300930:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997944.300935:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997944.300941:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e410 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997944.305742:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997944.305872:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704606208 00000100:00100000:2.0:1789997944.305882:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704606208 00000100:00100000:2.0:1789997944.305938:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 627 00000100:00100000:2.0:1789997944.305949:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58685:x1876946704606208:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:2.0:1789997944.305967:0:6656:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997944.305988:0:6656:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1c0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789997944.306017:0:6656:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789997944.306038:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=2132s v=(0 0) 00010000:00010000:2.0:1789997944.306043:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789997944.306053:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.306071:0:6656:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 6 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997944.306085:0:6656:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2200, rc 0) 00000100:00100000:2.0:1789997944.306148:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58685:x1876946704606208:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 201us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997944.306155:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 627 00000100:00100000:2.0:1789997944.335937:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997944.336041:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704606336 00000100:00100000:0.0:1789997944.336052:0:6664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704606336 00002000:00100000:0.0:1789997944.336103:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x25:0x0] (0->1048575) req@ffff8a38f94d9500 x1876946704606336/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:165/0 lens 488/0 e 0 to 0 dl 1789997955 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997944.336114:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f94d9500 with x1876946704606336 ext(0->1048575) 00002000:00010000:0.0:1789997944.336120:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38f94d9500 00000100:00100000:0.0:1789997944.336155:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 29 00000100:00100000:0.0:1789997944.336165:0:6664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704606336:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:0.0:1789997944.353396:0:6664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704606336:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 17222us (17458us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789997944.353410:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 29 00002000:00100000:0.0:1789997944.353422:0:6664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x25:0x0] (0->1048575) req@ffff8a38f94d9500 x1876946704606336/t4294967370(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:165/0 lens 488/448 e 0 to 0 dl 1789997955 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997944.353433:0:6664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38f94d9500 with x1876946704606336 ext(0->1048575) 00002000:00010000:0.0:1789997944.353439:0:6664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a38f94d9500 00000100:00100000:1.0:1789997944.357449:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997944.357583:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704606464 00000100:00100000:0.0:1789997944.357593:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704606464 00000100:00100000:0.0:1789997944.357676:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1169 00000100:00100000:0.0:1789997944.357687:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:58685:x1876946704606464:12345-192.168.204.4@tcp:44:dd.60003 00000001:00080000:1.0:1789997944.386382:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967743 is committed 00000100:00100000:2.0:1789997944.386639:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58685:x1876946704606464:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 28948us (29193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997944.386650:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1169 00000100:00100000:1.0:1789997944.389334:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997944.389443:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704606592 00000100:00100000:0.0:1789997944.389454:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704606592 00000100:00100000:0.0:1789997944.389615:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 628 00000100:00100000:0.0:1789997944.389628:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704606592:12345-192.168.204.4@tcp:16:dd.60003 00000001:00080000:3.0:1789997944.443716:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967370 is committed 00000100:00100000:0.0:1789997944.443887:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704606592:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 54256us (54556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997944.443898:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 628 00000100:00100000:1.0:1789997944.446385:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997944.446465:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704606848 00000100:00100000:0.0:1789997944.446475:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704606848 00000100:00100000:0.0:1789997944.446537:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 118 00000100:00100000:0.0:1789997944.446547:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58685:x1876946704606848:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:0.0:1789997944.447039:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58685:x1876946704606848:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 492us (661us total) trans 4294967744 rc 0/0 00000100:00100000:0.0:1789997944.447047:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 118 00010000:00010000:0.0:1789997944.586963:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997945.292527:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713084032:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.292594:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997945.292645:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789997945.292650:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713083648:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.292695:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997945.292717:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713084160:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.292733:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997945.292752:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713083776:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.292774:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997945.292791:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713084288:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.292808:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997945.292823:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789997945.292828:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713083904:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.292846:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997945.292876:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713084032 00000100:00100000:2.0:1789997945.292883:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713084032 00000100:00100000:2.0:1789997945.292932:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713084160 00000100:00100000:2.0:1789997945.292936:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713084160 00000100:00100000:2.0:1789997945.292957:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1789997945.292966:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713084032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293016:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713084032:12345-0@lo:400:kworker.0 Request processed in 52us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997945.293023:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1789997945.293037:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1789997945.293043:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713084160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293071:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713084160:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997945.293076:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1789997945.293096:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713083776 00000100:00100000:2.0:1789997945.293100:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713083776 00000100:00100000:2.0:1789997945.293123:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713084288 00000100:00100000:2.0:1789997945.293125:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713084288 00000100:00100000:2.0:1789997945.293142:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713083904 00000100:00100000:2.0:1789997945.293145:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713083904 00000100:00100000:2.0:1789997945.293164:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1789997945.293170:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713083776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293204:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713083776:12345-0@lo:400:kworker.0 Request processed in 34us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997945.293209:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1789997945.293221:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1789997945.293227:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713084288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293265:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713084288:12345-0@lo:400:kworker.0 Request processed in 39us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997945.293271:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1789997945.293282:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:2.0:1789997945.293289:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713083904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293316:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713083904:12345-0@lo:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997945.293321:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00080000:2.0:1789997945.293339:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997945.293343:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997945.293344:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997945.293377:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713084160:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293389:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713084032:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293423:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713083904:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293431:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713083776:0@lo:400:kworker.0 00000100:00100000:2.0:1789997945.293439:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713084288:0@lo:400:kworker.0 00000100:00100000:1.0:1789997945.293699:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713083648 00000100:00100000:1.0:1789997945.293705:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713083648 00000100:00100000:1.0:1789997945.293736:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1789997945.293743:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713083648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997945.293786:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713083648:12345-0@lo:400:kworker.0 Request processed in 44us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997945.293792:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1789997945.293824:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713083648:0@lo:400:kworker.0 00000001:00080000:1.0:1789997945.594966:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967744 is committed 00010000:00010000:3.0:1789997945.614397:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997946.636764:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789997946.649430:0:99999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2135341773932ns, next at 2131577954303ns, rc = 0 00000004:00080000:1.0:1789997946.649587:0:99999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2135341932291ns, next at 2112319867146ns, rc = 0 00000004:00080000:0.0:1789997946.653877:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 104 committed 00000004:00080000:0.0:1789997946.653903:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00000100:00100000:1.0:1789997947.161622:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997947.161686:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997947.161719:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704607232 00000100:00100000:1.0:1789997947.161719:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997947.161729:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704607232 00000100:00100000:2.0:1789997947.161788:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1080 00000100:00100000:2.0:1789997947.161798:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704607232:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997947.161808:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997947.161871:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704607232:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997947.161879:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1080 00000100:00100000:2.0:1789997947.161894:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704607360 00000100:00100000:2.0:1789997947.161897:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704607360 00000100:00100000:2.0:1789997947.161918:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1081 00000100:00100000:2.0:1789997947.161925:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704607360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997947.161951:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2352:x1876946704607360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 26us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997947.162037:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1081 00000100:00080000:2.0:1789997947.162057:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789997947.162061:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997947.162089:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704607104 00000100:00100000:2.0:1789997947.162093:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704607104 00000100:00100000:2.0:1789997947.162125:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1569 00000100:00100000:2.0:1789997947.162132:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2352:x1876946704607104:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997947.162805:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704606976 00000100:00100000:0.0:1789997947.162812:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704606976 00000100:00100000:0.0:1789997947.162850:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1253 00000100:00100000:0.0:1789997947.162858:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704606976:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997947.167079:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2352:x1876946704607104:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 4921us (5332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997947.167095:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1569 00000100:00080000:2.0:1789997947.167266:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997947.167882:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704606976:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 5019us (6324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997947.167893:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1253 00000100:00100000:2.0:1789997947.340008:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713084416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997947.340081:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997947.340155:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713084416 00000100:00100000:2.0:1789997947.340162:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713084416 00000100:00100000:2.0:1789997947.340229:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1789997947.340238:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713084416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997947.340272:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997947.340318:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713084416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997947.340325:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00080000:2.0:1789997947.340346:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997947.340382:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713084416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997947.340643:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713084544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997947.340687:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997947.340919:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713084544 00000100:00100000:3.0:1789997947.340925:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713084544 00000100:00100000:3.0:1789997947.340959:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1789997947.340966:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713084544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997947.340988:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997947.341149:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713084544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997947.341160:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00080000:3.0:1789997947.341176:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997947.341240:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713084544:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997947.660726:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997947.698742:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00000100:00100000:2.0:1789997947.807387:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997947.807524:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704607488 00000100:00100000:3.0:1789997947.807535:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704607488 00000100:00100000:3.0:1789997947.807599:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1170 00000100:00100000:3.0:1789997947.807611:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58878:x1876946704607488:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997947.807729:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58878:x1876946704607488:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997947.807736:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1170 00000100:00100000:1.0:1789997947.811181:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997947.811278:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704607616 00000100:00100000:3.0:1789997947.811288:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704607616 00000100:00100000:2.0:1789997947.814614:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 629 00000100:00100000:2.0:1789997947.814637:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58878:x1876946704607616:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997947.815043:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58878:x1876946704607616:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 413us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997947.815065:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 629 00000100:00100000:0.0:1789997947.817248:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997947.817334:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704607744 00000100:00100000:2.0:1789997947.817343:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704607744 00000100:00100000:2.0:1789997947.817398:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 630 00000100:00100000:2.0:1789997947.817410:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58878:x1876946704607744:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997947.817824:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58878:x1876946704607744:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 415us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997947.817833:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 630 00000100:00100000:2.0:1789997947.822151:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997947.822234:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704607872 00000100:00100000:1.0:1789997947.822245:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704607872 00000100:00100000:1.0:1789997947.822304:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1171 00000100:00100000:1.0:1789997947.822315:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58878:x1876946704607872:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997947.823338:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58878:x1876946704607872:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 1020us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997947.823348:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1171 00000100:00100000:1.0:1789997947.829186:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997947.829277:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704608000 00000100:00100000:3.0:1789997947.829287:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704608000 00000100:00100000:3.0:1789997947.829339:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1172 00000100:00100000:3.0:1789997947.829349:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58878:x1876946704608000:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997947.829447:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58878:x1876946704608000:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997947.829455:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1172 00000100:00100000:0.0:1789997947.836926:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997947.836994:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704608128 00000100:00100000:3.0:1789997947.837004:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704608128 00000100:00100000:3.0:1789997947.837052:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 631 00000100:00100000:3.0:1789997947.837061:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58878:x1876946704608128:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997947.837396:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:58878:x1876946704608128:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 335us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997947.837403:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 631 00000100:00100000:1.0:1789997947.846932:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997947.847009:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704608256 00000100:00100000:3.0:1789997947.847019:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704608256 00000100:00100000:3.0:1789997947.847071:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 632 00000100:00100000:3.0:1789997947.847082:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58878:x1876946704608256:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789997947.847444:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:58878:x1876946704608256:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 363us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997947.847453:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 632 00000100:00100000:1.0:1789997947.854576:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997947.857945:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704608384 00000100:00100000:3.0:1789997947.857960:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704608384 00000100:00100000:3.0:1789997947.858018:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1173 00000100:00100000:3.0:1789997947.858030:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58878:x1876946704608384:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997947.862540:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58878:x1876946704608384:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 4502us (7962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997947.862554:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1173 00000100:00100000:1.0:1789997947.944454:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997947.949796:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704608640 00000100:00100000:0.0:1789997947.950094:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704608640 00000100:00100000:1.0:1789997947.950247:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1174 00000100:00100000:1.0:1789997947.950259:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:58882:x1876946704608640:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:1.0:1789997947.950310:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997947.950338:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e417 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1b9 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.950362:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:1.0:1789997947.950372:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997947.950394:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.950407:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.950416:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.950507:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.950516:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.950523:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.951546:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.951559:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.951568:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997947.953371:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].37, 64 off10560 00000004:00080000:1.0:1789997947.953386:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2136645731663ns, next at 2137645728169ns, rc = 0 00010000:00010000:1.0:1789997947.953517:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953532:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953543:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953551:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953557:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953563:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953631:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997947.953674:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953681:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953687:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953693:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997947.953697:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953705:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953718:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997947.953721:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997947.953726:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953732:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e43a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953750:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953756:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953762:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953767:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997947.953770:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953776:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953783:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:1.0:1789997947.953786:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997947.953788:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997947.953793:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e42c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997947.953819:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b8ac283 reply state 000000009cf95056 transno 4294967745 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997947.953828:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997947.954250:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:58882:x1876946704608640:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 3990us (9801us total) trans 4294967745 rc 0/0 00000100:00100000:1.0:1789997947.954260:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1174 00010000:00010000:3.0:1789997947.955334:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997947.955345:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.955354:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997947.955358:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.955367:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.955382:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:3.0:1789997947.955385:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997947.955389:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.955399:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e441 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.955503:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997947.955506:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997947.955507:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997947.963135:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.963154:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.963162:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.963169:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997947.963174:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.963181:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.963206:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x7c633847 (ffff8a38e062de00) 00010000:00010000:3.0:1789997947.963209:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997947.963214:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997947.963220:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e433 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997948.682814:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997949.707791:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997949.762145:0:100146:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2138454487968ns, next at 2131577954303ns, rc = 0 00000004:00080000:0.0:1789997949.762262:0:100146:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2138454607055ns, next at 2137645728169ns, rc = 0 00000004:00080000:0.0:1789997949.814045:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 106 committed 00000004:00080000:0.0:1789997949.814114:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 104 committed 00000001:00080000:0.0:1789997949.814140:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967745 is committed 00000004:00080000:0.0:1789997949.814145:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 105 committed 00000100:00100000:2.0:1789997949.814416:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713084672:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997949.814479:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997949.814723:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713084672 00000100:00100000:1.0:1789997949.814731:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713084672 00000100:00100000:1.0:1789997949.814790:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1789997949.814800:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713084672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789997949.814826:0:8169:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:37 count 1 00010000:00010000:1.0:1789997949.814854:0:8169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997949.814875:0:8169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997949.814885:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x25:0x0].0x0 since=6s v=(0 0) 00010000:00010000:1.0:1789997949.814890:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789997949.814896:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997949.814925:0:8169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 5 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997949.814939:0:8169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 5 pid: 6656 timeout: 2238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997949.814954:0:8169:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8169:1876946713084800:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997949.815010:0:8169:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c86c0 going to sleep for 11 seconds 00000100:00080000:2.0:1789997949.815141:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997949.819041:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997949.819188:0:8169:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8169:1876946713084800:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789997949.819215:0:8169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997949.819318:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704608768 00000100:00100000:2.0:1789997949.819326:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704608768 00010000:00010000:2.0:1789997949.819383:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 6 pid: 6656 timeout: 2238 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997949.819430:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 441 00000100:00100000:2.0:1789997949.819441:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704608768:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997949.819455:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997949.819461:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 6 pid: 6656 timeout: 2238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997949.819473:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 6 pid: 6656 timeout: 2238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997949.819498:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d12e78ea/0x65b43101d592e425 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c0 expref: 6 pid: 6656 timeout: 2238 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997949.819514:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997949.819518:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997949.819523:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997949.819533:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997949.819563:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997949.819613:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704608768:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 173us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997949.819620:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 441 00000100:00080000:3.0:1789997949.819888:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789997949.819962:0:8169:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997949.819973:0:8169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997949.819984:0:8169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997949.819993:0:8169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997949.820015:0:8169:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997949.820778:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997949.820787:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997949.820798:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997949.820802:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997949.820812:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997949.820832:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997949.820840:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b67b24e/0x65b43101d592e448 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997949.820861:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997949.820863:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997949.820864:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997949.821981:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713084672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7176us (7494us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789997949.822006:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000004:00080000:2.0:1789997949.822923:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38e0c62300/2, rc 0, transno 4294967371 00000100:00100000:2.0:1789997949.822999:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713084672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997950.413516:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713085056:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.413583:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997950.413635:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713085568:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.413680:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997950.413706:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789997950.413712:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713084928:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.413740:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997950.413761:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713085440:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.413785:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997950.413809:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713085184:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.413831:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997950.413849:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997950.413855:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713085312:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.413876:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997950.413905:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713085056 00000100:00100000:0.0:1789997950.413913:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713085056 00000100:00100000:0.0:1789997950.413955:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713085568 00000100:00100000:0.0:1789997950.413958:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713085568 00000100:00100000:0.0:1789997950.413982:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713085184 00000100:00100000:0.0:1789997950.413984:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713085184 00000100:00100000:0.0:1789997950.414003:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:0.0:1789997950.414011:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713085056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414058:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713085056:12345-0@lo:400:kworker.0 Request processed in 47us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997950.414065:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:0.0:1789997950.414081:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1789997950.414087:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713085568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414109:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713085568:12345-0@lo:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997950.414115:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1789997950.414127:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:0.0:1789997950.414133:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713085184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414179:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c5f11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713085184:12345-0@lo:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997950.414185:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:0.0:1789997950.414204:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713085440 00000100:00100000:0.0:1789997950.414207:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713085440 00000100:00100000:0.0:1789997950.414228:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713085312 00000100:00100000:0.0:1789997950.414231:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713085312 00000100:00100000:0.0:1789997950.414250:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1789997950.414256:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7412c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713085440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414285:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7412c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713085440:12345-0@lo:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997950.414290:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1789997950.414436:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1789997950.414442:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713085312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414470:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713085312:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997950.414475:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1789997950.414516:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:0.0:1789997950.414521:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c571c380, transno 4294967369 00000100:00100000:0.0:1789997950.414531:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713085312:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414542:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713085184:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414570:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713085440:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414580:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713085056:0@lo:400:kworker.0 00000100:00100000:0.0:1789997950.414588:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713085568:0@lo:400:kworker.0 00000100:00080000:3.0:1789997950.415790:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997950.415798:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997950.416426:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713084928 00000100:00100000:1.0:1789997950.416435:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713084928 00000100:00100000:1.0:1789997950.416486:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1789997950.416495:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713084928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997950.416570:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713084928:12345-0@lo:400:kworker.0 Request processed in 77us (2829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997950.416578:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1789997950.416761:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713084928:0@lo:400:kworker.0 00010000:00010000:3.0:1789997950.730979:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997951.758775:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997952.281025:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997952.281074:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997952.281078:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704609024 00000100:00100000:0.0:1789997952.281088:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704609024 00000100:00100000:2.0:1789997952.281126:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997952.281157:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704608896 00000100:00100000:2.0:1789997952.281161:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704609280 00000100:00100000:3.0:1789997952.281164:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704608896 00000100:00100000:2.0:1789997952.281168:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704609280 00000100:00100000:0.0:1789997952.281170:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1573 00000100:00100000:0.0:1789997952.281183:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704609024:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997952.281211:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1255 00000100:00100000:2.0:1789997952.281215:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1084 00000100:00100000:3.0:1789997952.281225:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704608896:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997952.281278:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704608896:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 56us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997952.281286:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1255 00000100:00080000:3.0:1789997952.281317:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997952.281322:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997952.281382:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704609280:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997952.281417:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704609280:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997952.281424:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1084 00000100:00100000:3.0:1789997952.281793:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704609024:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 611us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997952.281802:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1573 00000100:00100000:1.0:1789997952.285522:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997952.286087:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704609152 00000100:00100000:0.0:1789997952.286098:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704609152 00000100:00100000:0.0:1789997952.286180:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1085 00000100:00100000:0.0:1789997952.286191:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704609152:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997952.286261:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704609152:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997952.286268:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1085 00000100:00080000:3.0:1789997952.286370:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997952.460867:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997952.460886:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713085696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997952.460952:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997952.460978:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713085696 00000100:00100000:3.0:1789997952.460986:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713085696 00000100:00100000:0.0:1789997952.461000:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713085824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997952.461019:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789997952.461128:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997952.461153:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713085824 00000100:00100000:3.0:1789997952.461158:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713085824 00000100:00100000:1.0:1789997952.461172:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1789997952.461185:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713085696:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997952.461196:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00002000:00000024:1.0:1789997952.461218:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997952.461261:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713085696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997952.461268:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1789997952.461306:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713085696:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789997952.461348:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997952.461388:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713085824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997952.461411:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1789997952.461459:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713085824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997952.461467:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1789997952.461749:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713085824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997952.778834:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997953.003268:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967371 is committed 00010000:00010000:1.0:1789997953.803761:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997954.828153:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997955.532164:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713085952:0@lo:400:kworker.0 00000100:00100000:2.0:1789997955.532236:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997955.532369:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713086336:0@lo:400:kworker.0 00000100:00100000:3.0:1789997955.532405:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997955.532437:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713086208:0@lo:400:kworker.0 00000100:00100000:3.0:1789997955.532464:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997955.532491:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713086336 00000100:00100000:3.0:1789997955.532499:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713086336 00000100:00100000:3.0:1789997955.532551:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1789997955.532724:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713086080:0@lo:400:kworker.0 00000100:00100000:0.0:1789997955.532755:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997955.532894:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713086336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997955.532948:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713086336:12345-0@lo:400:kworker.0 Request processed in 388us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997955.532955:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1789997955.533006:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713085952 00000100:00100000:3.0:1789997955.533011:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713085952 00000100:00100000:3.0:1789997955.533036:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1789997955.533042:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713085952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997955.533089:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713085952:12345-0@lo:400:kworker.0 Request processed in 47us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997955.533096:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1789997955.533138:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713086208 00000100:00100000:3.0:1789997955.533141:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713086208 00000100:00100000:2.0:1789997955.533225:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713085952:0@lo:400:kworker.0 00000100:00100000:2.0:1789997955.533234:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713086464:0@lo:400:kworker.0 00000100:00100000:2.0:1789997955.533263:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997955.533445:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713086080 00000100:00100000:0.0:1789997955.533450:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713086080 00000100:00100000:3.0:1789997955.533545:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1789997955.533554:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713086208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997955.533608:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713086208:12345-0@lo:400:kworker.0 Request processed in 56us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997955.533616:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:0.0:1789997955.533683:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:0.0:1789997955.533691:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713086080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997955.533748:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713086080:12345-0@lo:400:kworker.0 Request processed in 58us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997955.533755:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00080000:0.0:1789997955.533778:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789997955.533784:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997955.533888:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713086336:0@lo:400:kworker.0 00000100:00100000:1.0:1789997955.533941:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713086208:0@lo:400:kworker.0 00000100:00100000:1.0:1789997955.533978:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713086080:0@lo:400:kworker.0 00000100:00100000:1.0:1789997955.533986:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713086592:0@lo:400:kworker.0 00000100:00100000:1.0:1789997955.534016:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997955.534199:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713086464 00000100:00100000:2.0:1789997955.534205:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713086464 00000100:00100000:2.0:1789997955.534250:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1789997955.534258:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713086464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997955.534304:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713086464:12345-0@lo:400:kworker.0 Request processed in 48us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997955.534310:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1789997955.534340:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:2.0:1789997955.534345:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38e0c62300, transno 4294967371 00000100:00100000:2.0:1789997955.534357:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713086464:0@lo:400:kworker.0 00000100:00100000:2.0:1789997955.534738:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713086592 00000100:00100000:2.0:1789997955.534743:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713086592 00000100:00100000:2.0:1789997955.534772:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:2.0:1789997955.534778:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713086592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997955.534817:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713086592:12345-0@lo:400:kworker.0 Request processed in 39us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997955.534824:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00100000:2.0:1789997955.534855:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713086592:0@lo:400:kworker.0 00000100:00080000:2.0:1789997955.535209:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789997955.535214:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789997955.850833:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997956.876713:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997957.398794:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997957.398836:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997957.398883:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997957.398911:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997957.398938:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704609408 00000100:00100000:3.0:1789997957.398947:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704609408 00000100:00100000:3.0:1789997957.398990:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1257 00000100:00100000:3.0:1789997957.399000:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704609408:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997957.399082:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704609408:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997957.399090:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1257 00000100:00100000:3.0:1789997957.399121:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704609792 00000100:00100000:3.0:1789997957.399124:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704609792 00000100:00100000:3.0:1789997957.399153:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704609664 00000100:00100000:3.0:1789997957.399155:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704609664 00000100:00100000:3.0:1789997957.399170:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1088 00000100:00100000:3.0:1789997957.399176:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704609792:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997957.399213:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704609792:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997957.399219:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1088 00000100:00100000:3.0:1789997957.399229:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1089 00000100:00100000:3.0:1789997957.399235:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704609664:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997957.399265:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704609664:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997957.399272:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1089 00000100:00080000:2.0:1789997957.399387:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789997957.399392:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997957.399464:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704609536 00000100:00100000:0.0:1789997957.399469:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704609536 00000100:00080000:2.0:1789997957.399519:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997957.399520:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1577 00000100:00100000:0.0:1789997957.399535:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704609536:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997957.399578:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704609536:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 45us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997957.399583:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1577 00000100:00100000:0.0:1789997957.579103:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789997957.579128:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713086720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997957.579200:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997957.579313:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713086720 00000100:00100000:2.0:1789997957.579321:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713086720 00000100:00080000:0.0:1789997957.579447:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997957.584529:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:2.0:1789997957.584562:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713086720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997957.584607:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997957.584797:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713086720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 256us (5597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997957.584811:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1789997957.584932:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713086720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997957.585967:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713086848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997957.586032:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997957.586134:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713086848 00000100:00100000:3.0:1789997957.586142:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713086848 00000100:00100000:3.0:1789997957.586193:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1789997957.586201:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713086848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997957.586225:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997957.586269:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713086848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997957.586276:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:1.0:1789997957.587469:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713086848:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789997957.590685:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789997957.900134:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997958.922813:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997959.946810:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997960.654373:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713087360:0@lo:400:kworker.0 00000100:00100000:1.0:1789997960.654448:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997960.654509:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789997960.654516:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713087232:0@lo:400:kworker.0 00000100:00100000:1.0:1789997960.654541:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997960.654572:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713087232 00000100:00100000:1.0:1789997960.654580:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713087232 00000100:00100000:1.0:1789997960.654632:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:1.0:1789997960.654642:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713087232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997960.654717:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713087232:12345-0@lo:400:kworker.0 Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997960.654724:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00080000:1.0:1789997960.654745:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997960.654773:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713087232:0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.654927:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713087104:0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.654972:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997960.655016:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713087616:0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655039:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997960.655061:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789997960.655067:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713086976:0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655105:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997960.655137:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713087488:0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655159:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997960.655189:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713087104 00000100:00100000:3.0:1789997960.655193:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713087104 00000100:00100000:3.0:1789997960.655219:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713087616 00000100:00100000:3.0:1789997960.655222:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713087616 00000100:00100000:3.0:1789997960.655247:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1789997960.655254:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655292:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713087104:12345-0@lo:400:kworker.0 Request processed in 39us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997960.655298:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1789997960.655312:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:3.0:1789997960.655320:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713087616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655346:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713087616:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997960.655352:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00100000:3.0:1789997960.655370:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713086976 00000100:00100000:3.0:1789997960.655374:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713086976 00000100:00100000:3.0:1789997960.655397:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1789997960.655403:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713086976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655434:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713086976:12345-0@lo:400:kworker.0 Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997960.655440:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:3.0:1789997960.655464:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713087360 00000100:00100000:3.0:1789997960.655468:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713087360 00000100:00100000:3.0:1789997960.655489:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713087488 00000100:00100000:3.0:1789997960.655492:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713087488 00000100:00100000:3.0:1789997960.655512:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1789997960.655519:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713087360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655551:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713087360:12345-0@lo:400:kworker.0 Request processed in 33us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997960.655557:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1789997960.655569:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1789997960.655575:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713087488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655601:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713087488:12345-0@lo:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997960.655607:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1789997960.655644:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713086976:0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655682:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713087488:0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655691:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713087104:0@lo:400:kworker.0 00000100:00100000:3.0:1789997960.655699:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713087616:0@lo:400:kworker.0 00000100:00080000:1.0:1789997960.656014:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997960.656018:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997960.656020:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997960.656041:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713087360:0@lo:400:kworker.0 00010000:00010000:3.0:1789997960.970869:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997961.994818:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997962.519893:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997962.519986:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997962.520075:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704610176 00000100:00100000:2.0:1789997962.520086:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704610176 00000100:00100000:3.0:1789997962.520145:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997962.520162:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1092 00000100:00100000:2.0:1789997962.520175:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704610176:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997962.520183:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997962.520249:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704610048 00000100:00100000:2.0:1789997962.520254:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704610176:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 80us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997962.520256:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704610048 00000100:00100000:2.0:1789997962.520266:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1092 00000100:00100000:2.0:1789997962.520284:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704610304 00000100:00100000:2.0:1789997962.520288:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704610304 00000100:00100000:3.0:1789997962.520302:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1581 00000100:00100000:3.0:1789997962.520313:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704610048:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997962.520319:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1093 00000100:00100000:2.0:1789997962.520329:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704610304:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997962.520352:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704610048:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997962.520364:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1581 00000100:00100000:2.0:1789997962.520366:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704610304:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 34us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997962.520376:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1093 00000100:00080000:1.0:1789997962.520500:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997962.520506:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789997962.520508:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997962.520566:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704609920 00000100:00100000:0.0:1789997962.520580:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704609920 00000100:00100000:0.0:1789997962.520612:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1259 00000100:00100000:0.0:1789997962.520618:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704609920:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997962.520680:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704609920:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 62us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997962.520686:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1259 00000100:00100000:3.0:1789997962.701925:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713087744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997962.702005:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997962.702088:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713087744 00000100:00100000:1.0:1789997962.702097:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713087744 00000100:00100000:1.0:1789997962.702178:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789997962.702188:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713087744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997962.702222:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997962.702280:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713087744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997962.702287:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1789997962.702336:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713087744:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789997962.702498:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997962.702550:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997962.702564:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fad06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713087872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997962.702600:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997962.702692:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713087872 00000100:00100000:3.0:1789997962.702700:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713087872 00000100:00100000:3.0:1789997962.702799:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00080000:1.0:1789997962.702799:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997962.702821:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713087872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997962.702842:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997962.702889:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713087872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997962.702895:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1789997962.702951:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fad06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713087872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789997963.019040:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997964.042830:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997965.066837:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997965.771238:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713088256:0@lo:400:kworker.0 00000100:00100000:0.0:1789997965.771308:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997965.771394:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997965.771401:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713088384:0@lo:400:kworker.0 00000100:00100000:0.0:1789997965.771428:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997965.771466:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713088384 00000100:00100000:0.0:1789997965.771474:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713088384 00000100:00100000:0.0:1789997965.771528:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1789997965.771538:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713088384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997965.771589:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713088384:12345-0@lo:400:kworker.0 Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997965.771596:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00080000:0.0:1789997965.771616:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997965.771643:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713088384:0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.771902:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713088128:0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.771939:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997965.771978:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713088640:0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.772001:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997965.772023:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789997965.772029:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fa89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713088000:0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.772056:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997965.772078:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713088512:0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.772099:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997965.772127:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713088256 00000100:00100000:3.0:1789997965.772132:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713088256 00000100:00100000:3.0:1789997965.772161:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713088128 00000100:00100000:3.0:1789997965.772165:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713088128 00000100:00100000:3.0:1789997965.772180:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713088640 00000100:00100000:3.0:1789997965.772183:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713088640 00000100:00100000:3.0:1789997965.772201:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1789997965.772208:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713088256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.772244:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713088256:12345-0@lo:400:kworker.0 Request processed in 37us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997965.772250:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:3.0:1789997965.772262:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:3.0:1789997965.772268:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713088128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.772294:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713088128:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997965.772300:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:3.0:1789997965.772309:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1789997965.772314:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713088640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.772335:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713088640:12345-0@lo:400:kworker.0 Request processed in 21us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997965.772340:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:3.0:1789997965.772356:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713088512 00000100:00080000:0.0:1789997965.772456:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997965.772479:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713088256:0@lo:400:kworker.0 00000100:00100000:0.0:1789997965.772514:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713088000 00000100:00100000:0.0:1789997965.772517:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713088000 00000100:00100000:0.0:1789997965.772542:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1789997965.772547:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713088000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997965.772578:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713088000:12345-0@lo:400:kworker.0 Request processed in 31us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997965.772584:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1789997965.772635:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa89b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713088000:0@lo:400:kworker.0 00000100:00100000:0.0:1789997965.772646:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fa899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713088128:0@lo:400:kworker.0 00000100:00100000:0.0:1789997965.772672:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713088640:0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.772857:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713088512 00000100:00100000:3.0:1789997965.772901:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1789997965.772908:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713088512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997965.772948:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713088512:12345-0@lo:400:kworker.0 Request processed in 42us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997965.772955:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1789997965.772982:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713088512:0@lo:400:kworker.0 00000100:00080000:0.0:1789997965.773160:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789997966.092961:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997966.243156:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997966.243327:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704610432 00000100:00100000:2.0:1789997966.243339:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704610432 00000100:00100000:2.0:1789997966.243428:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1175 00000100:00100000:2.0:1789997966.243440:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59139:x1876946704610432:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997966.243548:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59139:x1876946704610432:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 111us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997966.243555:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1175 00000100:00080000:0.0:1789997966.244236:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997966.249566:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997966.249691:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704610560 00000100:00100000:3.0:1789997966.249702:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704610560 00000100:00100000:3.0:1789997966.249781:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 634 00000100:00100000:3.0:1789997966.249792:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59139:x1876946704610560:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:0.0:1789997966.249846:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997966.250215:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59139:x1876946704610560:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 423us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997966.250223:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 634 00000100:00100000:3.0:1789997966.253756:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997966.254060:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704610688 00000100:00100000:2.0:1789997966.254070:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704610688 00000100:00100000:2.0:1789997966.254138:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 635 00000100:00100000:2.0:1789997966.254148:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59139:x1876946704610688:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997966.254520:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59139:x1876946704610688:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 372us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997966.254527:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 635 00000100:00080000:0.0:1789997966.254720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997966.256391:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997966.256564:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704610816 00000100:00100000:3.0:1789997966.256574:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704610816 00000100:00100000:3.0:1789997966.256635:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1176 00000100:00100000:3.0:1789997966.256647:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59139:x1876946704610816:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789997966.257495:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59139:x1876946704610816:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 847us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997966.257505:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1176 00000100:00100000:1.0:1789997966.267554:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997966.267991:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704610944 00000100:00100000:2.0:1789997966.268002:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704610944 00000100:00100000:2.0:1789997966.268061:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1177 00000100:00100000:2.0:1789997966.268083:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59139:x1876946704610944:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:2.0:1789997966.268193:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59139:x1876946704610944:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 112us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997966.268201:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1177 00000100:00100000:0.0:1789997966.271487:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997966.275870:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704611072 00000100:00100000:2.0:1789997966.275900:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704611072 00000100:00100000:2.0:1789997966.275992:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 636 00000100:00100000:2.0:1789997966.276004:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59139:x1876946704611072:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997966.276423:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59139:x1876946704611072:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 419us (4943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997966.276433:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 636 00000100:00100000:0.0:1789997966.280255:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997966.280556:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704611200 00000100:00100000:2.0:1789997966.280567:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704611200 00000100:00100000:2.0:1789997966.280629:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 637 00000100:00100000:2.0:1789997966.280640:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59139:x1876946704611200:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997966.281602:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59139:x1876946704611200:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 960us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997966.281615:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 637 00000100:00100000:1.0:1789997966.287814:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997966.291006:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704611328 00000100:00100000:0.0:1789997966.291022:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704611328 00000100:00100000:0.0:1789997966.291109:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1178 00000100:00100000:0.0:1789997966.291120:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59139:x1876946704611328:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997966.291555:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59139:x1876946704611328:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 436us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997966.291563:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1178 00000100:00100000:0.0:1789997966.326151:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997966.326254:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704611456 00000100:00100000:2.0:1789997966.326265:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704611456 00000100:00100000:2.0:1789997966.326330:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1179 00000100:00100000:2.0:1789997966.326341:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59140:x1876946704611456:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997966.326362:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997966.326381:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e44f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1c7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997966.326442:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997966.326646:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997966.327040:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997966.327083:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00000004:00200000:2.0:1789997966.327087:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997966.327108:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997966.327134:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e44f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c7 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997966.327154:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c7 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997966.327167:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:2.0:1789997966.327170:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997966.327175:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3800, rc 0) 00000100:00100000:2.0:1789997966.327301:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59140:x1876946704611456:12345-192.168.204.4@tcp:101:rm.0 Request processed in 961us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997966.327309:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1179 00000100:00100000:3.0:1789997966.337316:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997966.339335:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704611712 00000100:00100000:2.0:1789997966.339348:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704611712 00000100:00100000:2.0:1789997966.339422:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1180 00000100:00100000:2.0:1789997966.339434:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59140:x1876946704611712:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:2.0:1789997966.339457:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997966.339478:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e45d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1ce expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997966.339581:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00010000:2.0:1789997966.340315:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e45d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ce expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997966.340331:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:2.0:1789997966.340335:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789997966.340341:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e45d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ce expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997966.340354:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997966.340473:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59140:x1876946704611712:12345-192.168.204.4@tcp:101:rm.0 Request processed in 1041us (3167us total) trans 4294967746 rc 301/301 00000100:00100000:2.0:1789997966.340485:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1180 00000100:00100000:1.0:1789997966.350951:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997966.351222:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704611840 00000100:00100000:0.0:1789997966.351233:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704611840 00000100:00100000:0.0:1789997966.351285:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 119 00000100:00100000:0.0:1789997966.351294:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59140:x1876946704611840:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:3.0:1789997966.363813:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59140:x1876946704611840:12345-192.168.204.4@tcp:37:rm.0 Request processed in 12509us (12861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997966.363826:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 119 00000100:00100000:3.0:1789997966.379404:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997966.379895:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704612096 00000100:00100000:1.0:1789997966.379905:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704612096 00000100:00100000:1.0:1789997966.379955:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 120 00000100:00100000:1.0:1789997966.379965:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59140:x1876946704612096:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:1.0:1789997966.381692:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59140:x1876946704612096:12345-192.168.204.4@tcp:35:rm.0 Request processed in 1722us (2291us total) trans 4294967747 rc 0/0 00000100:00100000:1.0:1789997966.381703:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 120 00000100:00100000:1.0:1789997966.395236:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997966.395315:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704612352 00000100:00100000:0.0:1789997966.395326:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704612352 00000100:00100000:0.0:1789997966.395382:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1181 00000100:00100000:0.0:1789997966.395391:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59140:x1876946704612352:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789997966.395442:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789997966.395468:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1c7 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.395488:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e3fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1b2 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.395501:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38ee49e800) 00010000:00010000:0.0:1789997966.395517:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e107 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf0fc expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.395532:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062d600) 00010000:00010000:0.0:1789997966.395540:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997966.395562:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.395785:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.395797:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.395813:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.395821:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.395827:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.396282:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.396292:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.396299:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997966.398415:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 16384 00010000:00010000:0.0:1789997966.398437:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398881:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398889:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398896:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997966.398901:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398909:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398925:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff8a38c28e9a00) 00010000:00010000:0.0:1789997966.398928:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789997966.398934:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398940:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e479 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398964:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398970:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398976:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398981:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997966.398983:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398989:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.398996:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997966.399011:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997966.399014:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997966.399020:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e46b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997966.399041:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7fefcba reply state 0000000052ae96ae transno 4294967748 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997966.399051:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997966.399150:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59140:x1876946704612352:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3755us (3920us total) trans 4294967748 rc 0/0 00000100:00100000:0.0:1789997966.399159:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1181 00010000:00010000:3.0:1789997966.413073:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997966.413092:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997966.413100:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997966.413106:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997966.413111:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997966.413119:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997966.413135:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38c28e9700) 00010000:00010000:3.0:1789997966.413138:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997966.413143:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997966.413150:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e472 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997967.115150:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997967.644120:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997967.644150:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997967.644183:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997967.644213:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997967.644239:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704612480 00000100:00100000:1.0:1789997967.644249:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704612480 00000100:00100000:1.0:1789997967.644294:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1261 00000100:00100000:1.0:1789997967.644302:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704612480:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997967.644363:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704612480:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997967.644370:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1261 00000100:00100000:2.0:1789997967.644493:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704612864 00000100:00100000:2.0:1789997967.644498:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704612864 00000100:00100000:2.0:1789997967.644537:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704612736 00000100:00100000:2.0:1789997967.644540:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704612736 00000100:00100000:2.0:1789997967.644558:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1096 00000100:00100000:2.0:1789997967.644565:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704612864:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997967.644594:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704612864:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997967.644601:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1096 00000100:00100000:2.0:1789997967.644612:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1097 00000100:00100000:2.0:1789997967.644618:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704612736:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997967.644639:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704612736:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 21us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997967.644645:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1097 00000100:00100000:3.0:1789997967.647756:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704612608 00000100:00100000:3.0:1789997967.647769:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704612608 00000100:00100000:3.0:1789997967.647841:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1585 00000100:00100000:3.0:1789997967.647852:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704612608:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997967.647926:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2354:x1876946704612608:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (3814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997967.647934:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1585 00000100:00100000:3.0:1789997967.820030:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997967.820053:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713088768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997967.820123:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997967.820364:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713088768 00000100:00100000:1.0:1789997967.820387:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713088768 00000100:00100000:1.0:1789997967.820456:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:1.0:1789997967.820476:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713088768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997967.820514:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997967.821194:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713088768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 728us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997967.821203:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00080000:1.0:1789997967.821342:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997967.821579:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713088768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997967.822888:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713088896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997967.822948:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997967.823040:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713088896 00000100:00100000:3.0:1789997967.823047:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713088896 00000100:00080000:1.0:1789997967.823173:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997967.823263:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:3.0:1789997967.823274:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713088896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997967.823304:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997967.823362:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713088896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997967.823369:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:1.0:1789997967.823437:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713088896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789997968.143126:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789997968.650407:0:100509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcde1b0e80 20000000:00000080:0.0:1789997968.650425:0:100509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e8a800 uarg=0000000000000000 10000000:01000000:0.0:1789997968.651092:0:100509:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997968.651114:0:100509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997968.651130:0:100509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997968.651143:0:100509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997968.651183:0:100509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997968.651195:0:100509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 18 pid: 7594 timeout: 2257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997968.651208:0:100509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6067b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100509:1876946713089024:0@lo:104: 00000100:00100000:0.0:1789997968.651272:0:100509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997968.651370:0:100509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997968.651415:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713089024 00000100:00100000:2.0:1789997968.651424:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713089024 00000100:00100000:2.0:1789997968.651643:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789997968.651847:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:100509:x1876946713089024:12345-0@lo:104: 00010000:00010000:2.0:1789997968.651862:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997968.651988:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789997968.651996:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:100509:x1876946713089024:12345-0@lo:104: Request processed in 345us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997968.652004:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789997968.652070:0:100509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6067b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100509:1876946713089024:0@lo:104: 00010000:00010000:1.0:1789997968.652094:0:100509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652143:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997968.652150:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652163:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997968.652167:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652174:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997968.652181:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997968.652186:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997968.652223:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652230:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997968.652252:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652260:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2000/0x65b43101d592e0f2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e0f9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652276:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997968.652277:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997968.652279:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997968.652291:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713089152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997968.652325:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997968.652366:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713089152 00000100:00100000:2.0:1789997968.652371:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713089152 00010000:00010000:2.0:1789997968.652393:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 19 pid: 7594 timeout: 2257 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997968.652416:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1789997968.652423:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713089152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997968.652432:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997968.652437:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 19 pid: 7594 timeout: 2257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652446:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 19 pid: 7594 timeout: 2257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652475:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592e0f9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e0f2 expref: 19 pid: 7594 timeout: 2257 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652486:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652493:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652507:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652513:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652519:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652524:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652533:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997968.652536:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652543:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652553:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997968.652562:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997968.652684:0:100509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997968.652703:0:100509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997968.652713:0:100509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592e480 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997968.653506:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713089152:12345-0@lo:103:ldlm_bl.0 Request processed in 1080us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997968.653516:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1789997968.654315:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713089152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997969.163262:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789997969.328898:0:100557:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4deb7cb0 20000000:00000080:1.0:1789997969.328915:0:100557:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fabb6800 uarg=0000000000000000 10000000:01000000:1.0:1789997969.328961:0:100557:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789997969.328981:0:100557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.328996:0:100557:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329006:0:100557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329013:0:100557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329020:0:100557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329027:0:100557:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329033:0:100557:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997969.329037:0:100557:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329057:0:100557:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329076:0:100557:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329083:0:100557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997969.329089:0:100557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e487 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789997970.059775:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789997970.059783:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789997970.059787:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789997970.059830:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997970.059842:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997970.059853:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997970.059878:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713089280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789997970.059941:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997970.059993:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5caa000 going to sleep for 11 seconds 00000100:00100000:0.0:1789997970.060748:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713089280 00000100:00100000:0.0:1789997970.060758:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713089280 00000100:00100000:0.0:1789997970.060829:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1789997970.060841:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713089280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997970.060855:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997970.060869:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e48e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997970.060893:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e48e expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997970.060904:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e48e expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997970.060913:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997970.060981:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713089280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997970.060989:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1789997970.061152:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713089280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997970.061172:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997970.061182:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997970.061208:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997970.061213:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997970.061222:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997970.187019:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789997970.429727:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967748 is committed 00000100:00100000:3.0:1789997970.895570:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713089408:0@lo:400:kworker.0 00000100:00100000:2.0:1789997970.895613:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713089664:0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.895963:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713089792:0@lo:400:kworker.0 00000100:00100000:3.0:1789997970.897199:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997970.897272:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713089920:0@lo:400:kworker.0 00000100:00100000:3.0:1789997970.897311:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997970.897343:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713089920 00000100:00100000:3.0:1789997970.897360:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713089920 00000100:00100000:3.0:1789997970.897408:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1789997970.897415:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713089920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997970.897458:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713089920:12345-0@lo:400:kworker.0 Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997970.897465:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00080000:3.0:1789997970.897483:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997970.897510:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713089920:0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.897694:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997970.897730:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713089536:0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.897770:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997970.897791:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713090048:0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.897809:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997970.897898:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713089536 00000100:00100000:1.0:1789997970.897902:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713089536 00000100:00100000:1.0:1789997970.897928:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713090048 00000100:00100000:1.0:1789997970.897930:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713090048 00000100:00100000:1.0:1789997970.897954:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1789997970.897960:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713089536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.897995:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713089536:12345-0@lo:400:kworker.0 Request processed in 35us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997970.898002:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:1.0:1789997970.898014:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1789997970.898021:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713090048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.898053:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713090048:12345-0@lo:400:kworker.0 Request processed in 33us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997970.898059:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:2.0:1789997970.898064:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997970.898072:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713089664 00000100:00100000:1.0:1789997970.898075:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713089664 00000100:00100000:1.0:1789997970.898094:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:0.0:1789997970.898150:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713089408 00000100:00100000:0.0:1789997970.898154:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713089408 00000100:00100000:0.0:1789997970.898182:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1789997970.898188:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713089408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997970.898227:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713089408:12345-0@lo:400:kworker.0 Request processed in 39us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997970.898233:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1789997970.898316:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713089408:0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.898420:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713089664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.898472:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713089664:12345-0@lo:400:kworker.0 Request processed in 372us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997970.898478:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713089792 00000100:00100000:1.0:1789997970.898478:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00100000:3.0:1789997970.898482:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713089792 00000100:00100000:3.0:1789997970.898506:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1789997970.898513:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.898513:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713089536:0@lo:400:kworker.0 00000100:00100000:1.0:1789997970.898522:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713090048:0@lo:400:kworker.0 00000100:00100000:3.0:1789997970.898710:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713089792:12345-0@lo:400:kworker.0 Request processed in 197us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997970.898720:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00080000:3.0:1789997970.898740:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997970.898755:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997970.898774:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713089792:0@lo:400:kworker.0 00000100:00100000:2.0:1789997970.899210:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713089664:0@lo:400:kworker.0 00010000:00010000:2.0:1789997971.210821:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997971.399860:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997971.399897:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704612992 00000100:00100000:3.0:1789997971.399906:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704612992 00000100:00100000:3.0:1789997971.399959:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1182 00000100:00100000:3.0:1789997971.399968:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59253:x1876946704612992:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997971.399986:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997971.400005:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e49c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1d5 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.400063:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e4a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.400076:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.400089:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997971.400121:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997971.400125:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997971.400142:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.400162:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e49c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1d5 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.400183:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1d5 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.400191:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997971.400194:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997971.400198:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997971.400251:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59253:x1876946704612992:12345-192.168.204.4@tcp:101:rm.0 Request processed in 284us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997971.400258:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1182 00000100:00080000:3.0:1789997971.400295:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997971.402620:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997971.402667:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704613120 00000100:00100000:3.0:1789997971.402675:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704613120 00000100:00100000:3.0:1789997971.402717:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1183 00000100:00100000:3.0:1789997971.402726:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59253:x1876946704613120:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997971.402755:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997971.402773:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1dc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.402824:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.402837:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.402853:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.402871:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.402877:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.402883:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403050:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403058:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403065:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403071:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997971.403076:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403083:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403093:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997971.403096:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997971.403100:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403107:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e4b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403118:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403124:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403129:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403135:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997971.403138:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403143:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403150:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997971.403152:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997971.403155:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403161:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e4b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403190:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1dc expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403200:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:3.0:1789997971.403202:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997971.403207:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1dc expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.403216:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997971.403269:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59253:x1876946704613120:12345-192.168.204.4@tcp:101:rm.0 Request processed in 543us (657us total) trans 0 rc 301/301 00000100:00100000:3.0:1789997971.403276:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1183 00000100:00100000:3.0:1789997971.438552:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997971.438618:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704613504 00000100:00100000:1.0:1789997971.438630:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704613504 00000100:00100000:1.0:1789997971.438718:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1184 00000100:00100000:1.0:1789997971.438728:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59257:x1876946704613504:12345-192.168.204.4@tcp:36:mkdir.0 00010000:00010000:1.0:1789997971.438792:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997971.438819:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e4a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1d5 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.438839:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e000) 00010000:00010000:1.0:1789997971.438864:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997971.439081:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.439095:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.439106:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.439117:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.439124:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.439131:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997971.441188:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997971.441259:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704613248 00000100:00100000:2.0:1789997971.441268:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704613248 00000100:00100000:2.0:1789997971.441318:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1185 00000100:00100000:2.0:1789997971.441328:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704613248:12345-192.168.204.4@tcp:41:mkdir.0 00000004:00000024:2.0:1789997971.441363:0:12471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789997971.441439:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704613248:12345-192.168.204.4@tcp:41:mkdir.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997971.441446:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1185 00000004:00200000:0.0:1789997971.441638:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00010000:0.0:1789997971.441667:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.441677:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.441685:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.441691:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997971.441696:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.441704:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.441718:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997971.441722:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997971.441726:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.441732:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e4bf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997971.441764:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cea432d reply state 000000009aaf4872 transno 4294967749 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997971.441772:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789997971.441816:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59257:x1876946704613504:12345-192.168.204.4@tcp:36:mkdir.0 Request processed in 3090us (3272us total) trans 4294967749 rc 0/0 00000100:00100000:0.0:1789997971.441822:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1184 00010000:00010000:0.0:1789997971.444830:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.445768:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.445785:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.445791:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997971.445796:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.445803:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.445816:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38e062de00) 00010000:00010000:0.0:1789997971.445818:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997971.445821:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.445826:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e4c6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997971.487917:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997971.488542:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704613632 00000100:00100000:3.0:1789997971.488553:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704613632 00000100:00100000:3.0:1789997971.488706:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1186 00000100:00100000:3.0:1789997971.488719:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59261:x1876946704613632:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:3.0:1789997971.488754:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997971.488778:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592e4cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1e3 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.488840:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.488854:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.488867:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997971.488904:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997971.488908:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997971.488928:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.488958:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592e4cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1e3 expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.488991:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1e3 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997971.489000:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997971.489003:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997971.489007:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997971.489075:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59261:x1876946704613632:12345-192.168.204.4@tcp:101:chown.0 Request processed in 359us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997971.489081:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1186 00000100:00100000:3.0:1789997971.492148:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997971.492246:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704613760 00000100:00100000:0.0:1789997971.492254:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704613760 00000100:00100000:0.0:1789997971.492303:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1187 00000100:00100000:0.0:1789997971.492311:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59261:x1876946704613760:12345-192.168.204.4@tcp:101:chown.0 00010000:00010000:0.0:1789997971.492326:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997971.492342:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e4db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1ea expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492391:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492409:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492419:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492433:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492440:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492447:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492536:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e4f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492544:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492551:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997971.492579:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789997971.492583:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997971.492600:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e4f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492780:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492794:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492801:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492808:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997971.492812:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492821:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492833:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:0.0:1789997971.492835:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997971.492840:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492846:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0200/0x65b43101d592e4e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492879:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492886:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492892:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492897:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997971.492900:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492905:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492912:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38c28e9700) 00010000:00010000:0.0:1789997971.492914:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997971.492917:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492923:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e4e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492954:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e4db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ea expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492969:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ea expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.492976:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9600) 00010000:00010000:0.0:1789997971.492979:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997971.492981:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997971.493048:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59261:x1876946704613760:12345-192.168.204.4@tcp:101:chown.0 Request processed in 737us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997971.493055:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1187 00000100:00100000:0.0:1789997971.497424:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997971.497494:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704614016 00000100:00100000:1.0:1789997971.497505:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704614016 00000100:00100000:1.0:1789997971.497609:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1188 00000100:00100000:1.0:1789997971.497621:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59261:x1876946704614016:12345-192.168.204.4@tcp:36:chown.0 00010000:00010000:1.0:1789997971.497704:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997971.497730:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e4f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ea expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.497770:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9600) 00010000:00010000:1.0:1789997971.497782:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997971.497809:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.497822:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997971.497833:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997971.518084:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009969220c reply state 000000003cb490e3 transno 4294967750 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997971.518103:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997971.518119:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:1.0:1789997971.518227:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59261:x1876946704614016:12345-192.168.204.4@tcp:36:chown.0 Request processed in 20604us (20808us total) trans 4294967750 rc 0/0 00000100:00100000:1.0:1789997971.518236:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1188 00000001:00080000:2.0:1789997971.518521:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967750 is committed 00010000:00010000:0.0:1789997971.518774:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.518789:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.518798:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.518803:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997971.518807:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.518815:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.518831:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:0.0:1789997971.518834:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997971.518839:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997971.518846:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e4f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789997972.096197:0:100756:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff33300490 20000000:00000080:0.0:1789997972.096215:0:100756:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e8a800 uarg=0000000000000000 10000000:01000000:0.0:1789997972.096262:0:100756:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789997972.096280:0:100756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997972.096298:0:100756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e48e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997972.096306:0:100756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997972.096345:0:100756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e48e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997972.096360:0:100756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e48e expref: 18 pid: 5804 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997972.096373:0:100756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6dee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100756:1876946713090176:0@lo:104: 00000100:00100000:0.0:1789997972.096436:0:100756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997972.096497:0:100756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c29ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1789997972.096500:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713090176 00000100:00100000:2.0:1789997972.096508:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713090176 00000100:00100000:2.0:1789997972.096556:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789997972.096565:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:100756:x1876946713090176:12345-0@lo:104: 00010000:00010000:2.0:1789997972.096577:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.096646:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789997972.096677:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:100756:x1876946713090176:12345-0@lo:104: Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997972.096686:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00010000:00010000:2.0:1789997972.096707:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997972.096712:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.096719:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789997972.096733:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.096802:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789997972.096809:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789997972.096814:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789997972.096843:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.096848:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789997972.096869:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.096875:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb2600/0x65b43101d592e48e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e495 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.096889:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997972.096956:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997972.096958:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997972.096978:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713090304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789997972.097026:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997972.097065:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713090304 00000100:00100000:2.0:1789997972.097069:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713090304 00010000:00010000:2.0:1789997972.097087:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e48e expref: 19 pid: 5804 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997972.097110:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1789997972.097116:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713090304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789997972.097125:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997972.097130:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e48e expref: 19 pid: 5804 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097140:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e48e expref: 19 pid: 5804 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097156:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097162:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097191:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097198:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097204:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097211:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097216:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997972.097220:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097226:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097235:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997972.097243:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997972.097271:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713090304:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997972.097277:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1789997972.097344:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713090304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789997972.097648:0:100756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e495 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e48e expref: 18 pid: 5804 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997972.097689:0:100756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6dee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100756:1876946713090176:0@lo:104: 00010000:00010000:3.0:1789997972.097704:0:100756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.097713:0:100756:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.097719:0:100756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.097818:0:100756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592e4fe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.235836:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789997972.676206:0:100804:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3fb78e10 20000000:00000080:3.0:1789997972.676224:0:100804:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c27400 uarg=0000000000000000 10000000:01000000:3.0:1789997972.676272:0:100804:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789997972.676295:0:100804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676310:0:100804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676322:0:100804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676330:0:100804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676338:0:100804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676345:0:100804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676351:0:100804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997972.676357:0:100804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676365:0:100804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676448:0:100804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676526:0:100804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997972.676533:0:100804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b600/0x65b43101d592e505 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997972.763334:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997972.763366:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997972.763388:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997972.763406:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997972.763433:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704614400 00000100:00100000:0.0:1789997972.763442:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704614400 00000100:00100000:0.0:1789997972.763494:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704614528 00000100:00100000:0.0:1789997972.763497:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704614528 00000100:00100000:0.0:1789997972.763518:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1100 00000100:00100000:0.0:1789997972.763527:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704614400:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997972.763594:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704614400:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997972.763601:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1100 00000100:00100000:0.0:1789997972.763616:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1101 00000100:00100000:0.0:1789997972.763622:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704614528:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997972.763644:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704614528:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 23us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997972.763668:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1101 00000100:00080000:0.0:1789997972.763687:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997972.763691:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997972.764046:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704614144 00000100:00100000:1.0:1789997972.764051:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704614144 00000100:00100000:1.0:1789997972.764081:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1264 00000100:00100000:1.0:1789997972.764087:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704614144:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997972.764123:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704614144:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 35us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997972.764129:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1264 00000100:00100000:1.0:1789997972.764158:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704614272 00000100:00100000:1.0:1789997972.764161:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704614272 00000100:00100000:1.0:1789997972.764204:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1589 00000100:00100000:1.0:1789997972.764211:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704614272:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997972.764264:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704614272:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 54us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997972.764271:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1589 00000100:00100000:3.0:1789997972.938890:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713090432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997972.938957:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997972.939034:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789997972.939045:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713090560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997972.939071:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997972.939721:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713090432 00000100:00100000:1.0:1789997972.939730:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713090432 00000100:00100000:1.0:1789997972.939789:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713090560 00000100:00100000:1.0:1789997972.939793:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713090560 00000100:00080000:3.0:1789997972.939799:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997972.939805:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997972.939817:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1789997972.939828:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713090432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997972.939837:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1789997972.939848:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713090560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997972.939863:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00002000:00000024:3.0:1789997972.939874:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997972.939929:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713090432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997972.939936:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:3.0:1789997972.940552:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713090560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 704us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997972.940561:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:1.0:1789997972.941529:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713090560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997972.941550:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713090432:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997973.259798:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789997973.835024:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789997973.835032:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789997973.835037:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789997973.835085:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997973.835098:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997973.835110:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997973.835137:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713090688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789997973.835220:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997973.835284:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5caad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789997973.835340:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713090688 00000100:00100000:0.0:1789997973.835348:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713090688 00000100:00100000:0.0:1789997973.835411:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1789997973.835424:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713090688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997973.835437:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997973.835453:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e50c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997973.835490:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e50c expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997973.835502:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e50c expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997973.835511:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789997973.835561:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713090688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997973.835568:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1789997973.835633:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713090688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789997973.835648:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997973.835705:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789997973.835725:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789997973.835730:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997973.835737:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997974.282892:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997974.668633:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997974.668823:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704614656 00000100:00100000:3.0:1789997974.668833:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704614656 00000100:00100000:3.0:1789997974.669037:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00100000:3.0:1789997974.669049:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:5579:x1876946704614656:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997974.669065:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997974.669092:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e4d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1e3 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997974.669115:0:8409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e500) 00010000:00010000:3.0:1789997974.669128:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997974.669176:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:5579:x1876946704614656:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 130us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997974.669183:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 18 00000100:00080000:0.0:1789997974.669460:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997975.279379:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997975.279425:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704614784 00000100:00100000:3.0:1789997975.279435:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704614784 00000100:00100000:3.0:1789997975.279491:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1189 00000100:00100000:3.0:1789997975.279500:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59367:x1876946704614784:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997975.279519:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997975.279543:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e51a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1f1 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.279599:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e521 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.279615:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.279626:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997975.279699:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789997975.279703:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997975.279722:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.279747:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e51a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1f1 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.279761:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1f1 expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.279767:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997975.279770:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997975.279772:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b600, rc 0) 00000100:00100000:3.0:1789997975.280143:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59367:x1876946704614784:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 643us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997975.280151:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1189 00000100:00100000:0.0:1789997975.283116:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997975.283193:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704614912 00000100:00100000:3.0:1789997975.283202:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704614912 00000100:00100000:3.0:1789997975.283251:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1190 00000100:00100000:3.0:1789997975.283263:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59367:x1876946704614912:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997975.283359:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997975.283381:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592e528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1f8 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283438:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283452:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283464:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283480:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283488:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283495:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283836:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e53d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283852:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.283861:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997975.284379:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:3.0:1789997975.284385:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997975.284408:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e53d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284421:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284427:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284433:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284439:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997975.284443:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284450:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284462:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997975.284465:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997975.284470:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284475:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e52f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284487:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284493:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284499:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284503:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997975.284505:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284511:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284516:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38ee49e300) 00010000:00010000:3.0:1789997975.284519:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997975.284521:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284531:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e536 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284564:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592e528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1f8 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284578:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e53d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1f8 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.284586:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997975.284588:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997975.284591:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789997975.284697:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59367:x1876946704614912:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 1435us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997975.284705:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1190 00000100:00100000:0.0:1789997975.288409:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997975.288856:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704615168 00000100:00100000:1.0:1789997975.288871:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704615168 00000100:00100000:1.0:1789997975.288961:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1191 00000100:00100000:1.0:1789997975.288973:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59367:x1876946704615168:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997975.289022:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997975.289047:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052aa00/0x65b43101d592e53d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1f8 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.289063:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:1.0:1789997975.289072:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997975.289093:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.289102:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.289110:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.312716:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789997975.333213:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006dc353c0 reply state 000000005850f3c1 transno 4294967751 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997975.333232:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997975.333248:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:0.0:1789997975.333352:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59367:x1876946704615168:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 44378us (44947us total) trans 4294967751 rc 0/0 00000100:00100000:0.0:1789997975.333362:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1191 00000001:00080000:0.0:1789997975.333407:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967751 is committed 00010000:00010000:0.0:1789997975.333705:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.333714:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.333721:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.333731:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997975.333736:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.333744:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.333759:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:0.0:1789997975.333762:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997975.333767:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.333773:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e544 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997975.372814:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997975.372892:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704615296 00000100:00100000:2.0:1789997975.372902:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704615296 00000100:00100000:2.0:1789997975.372962:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1192 00000100:00100000:2.0:1789997975.372974:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59371:x1876946704615296:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997975.372998:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997975.373017:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e54b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf1ff expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373085:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373099:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373110:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373127:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373133:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373138:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373516:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373525:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373532:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997975.373560:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:2.0:1789997975.373564:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997975.373583:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373594:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373600:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373606:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373614:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997975.373618:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373625:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373636:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:2.0:1789997975.373639:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997975.373644:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373694:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373706:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373712:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373718:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373724:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997975.373727:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373733:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373744:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38d0bdf100) 00010000:00010000:2.0:1789997975.373746:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997975.373749:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373754:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e559 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373784:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e54b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ff expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373798:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ff expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.373804:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997975.373807:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997975.373809:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2c00, rc 0) 00000100:00100000:2.0:1789997975.373880:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59371:x1876946704615296:12345-192.168.204.4@tcp:101:touch.0 Request processed in 908us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997975.373888:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1192 00000100:00100000:3.0:1789997975.379999:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997975.380099:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704615552 00000100:00100000:0.0:1789997975.380109:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704615552 00000100:00100000:0.0:1789997975.380167:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1193 00000100:00100000:0.0:1789997975.380177:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59371:x1876946704615552:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997975.380338:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997975.380361:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e567 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf206 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.380570:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.380583:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.380595:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.380649:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.380743:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.380751:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997975.381846:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25:0x0], index 0: 0 00010000:00010000:0.0:1789997975.382441:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e57c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382457:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e57c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382469:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e57c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382504:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382513:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382521:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382527:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997975.382533:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382541:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382554:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997975.382557:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997975.382562:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382569:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e56e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997975.382591:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ef7b69a reply state 00000000422027c4 transno 4294967752 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997975.382600:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997975.382635:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e567 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf206 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382725:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e57c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf206 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.382735:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997975.382738:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997975.382740:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997975.382813:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59371:x1876946704615552:12345-192.168.204.4@tcp:101:touch.0 Request processed in 2636us (2822us total) trans 4294967752 rc 0/0 00000100:00100000:0.0:1789997975.382823:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1193 00010000:00010000:0.0:1789997975.385092:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.385111:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.385120:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.385126:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997975.385131:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.385140:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.385155:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997975.385159:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997975.385164:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.385171:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e575 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997975.387087:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997975.389088:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704615808 00000100:00100000:1.0:1789997975.389101:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704615808 00000100:00100000:1.0:1789997975.389168:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1194 00000100:00100000:1.0:1789997975.389179:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59371:x1876946704615808:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:1.0:1789997975.389237:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997975.389265:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e57c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf206 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.389287:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff8a38c28e9b00) 00010000:00010000:1.0:1789997975.389298:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997975.389341:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.389359:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.389369:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997975.389506:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c5bda6c reply state 0000000024d8d66f transno 4294967753 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997975.389514:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997975.389612:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59371:x1876946704615808:12345-192.168.204.4@tcp:36:touch.0 Request processed in 434us (2534us total) trans 4294967753 rc 0/0 00000100:00100000:1.0:1789997975.389619:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1194 00010000:00010000:0.0:1789997975.394464:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.394483:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.394492:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.394502:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997975.394507:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.394514:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.394530:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff8a38e062dd00) 00010000:00010000:0.0:1789997975.394533:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997975.394538:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.394544:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2000/0x65b43101d592e58a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997975.395815:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997975.396803:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704615936 00000100:00100000:2.0:1789997975.396819:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704615936 00000100:00100000:2.0:1789997975.396889:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1195 00000100:00100000:2.0:1789997975.396902:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59371:x1876946704615936:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997975.396928:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997975.397031:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf20d expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.397101:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf20d expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.397117:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf20d expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.397138:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:2.0:1789997975.397141:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997975.397145:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3800, rc 0) 00000100:00100000:2.0:1789997975.397224:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59371:x1876946704615936:12345-192.168.204.4@tcp:101:touch.0 Request processed in 325us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997975.397231:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1195 00000100:00100000:3.0:1789997975.402353:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997975.402478:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704616064 00000100:00100000:0.0:1789997975.402490:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704616064 00000100:00100000:0.0:1789997975.402711:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 638 00000100:00100000:0.0:1789997975.402722:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704616064:12345-192.168.204.4@tcp:2:touch.0 00000100:00100000:0.0:1789997975.403129:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704616064:12345-192.168.204.4@tcp:2:touch.0 Request processed in 407us (787us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789997975.403136:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 638 00000100:00080000:3.0:1789997975.403676:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997975.409172:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997975.411638:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704616320 00000100:00100000:1.0:1789997975.411682:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704616320 00000100:00100000:3.0:1789997975.412039:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 121 00000100:00100000:3.0:1789997975.412054:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59371:x1876946704616320:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:3.0:1789997975.412408:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59371:x1876946704616320:12345-192.168.204.4@tcp:35:touch.0 Request processed in 358us (3244us total) trans 4294967754 rc 0/0 00000100:00100000:3.0:1789997975.412420:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 121 00000100:00100000:0.0:1789997975.444012:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997975.446577:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704616448 00000100:00100000:3.0:1789997975.446592:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704616448 00000100:00100000:3.0:1789997975.446751:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1196 00000100:00100000:3.0:1789997975.446763:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59375:x1876946704616448:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997975.446789:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997975.446810:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592e598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf214 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.446882:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.446896:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.446906:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.446919:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.446926:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.446932:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447017:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e5ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447028:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447035:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997975.447067:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x62:0x0]: returning size 0 00000004:00200000:3.0:1789997975.447071:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997975.447089:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447100:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e5ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447108:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447115:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447122:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447128:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997975.447132:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447139:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447151:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:3.0:1789997975.447155:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997975.447160:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447167:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e59f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447313:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447320:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447326:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447332:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997975.447335:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447341:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447350:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38ee49e300) 00010000:00010000:3.0:1789997975.447353:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997975.447356:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447361:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e5a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447393:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a600/0x65b43101d592e598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf214 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447408:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e5ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf214 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.447415:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:3.0:1789997975.447417:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997975.447420:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789997975.447592:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59375:x1876946704616448:12345-192.168.204.4@tcp:101:rm.0 Request processed in 830us (3587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997975.447599:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1196 00000100:00100000:0.0:1789997975.457005:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997975.457170:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704616576 00000100:00100000:3.0:1789997975.457181:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704616576 00000100:00100000:3.0:1789997975.457240:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 639 00000100:00100000:3.0:1789997975.457250:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704616576:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997975.457270:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997975.457293:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf21b expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997975.457321:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x6ab13397, atime: 0x6ab13397, ctime: 0x6ab13397, blocks: 0x1 00010000:00010000:3.0:1789997975.457341:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=2164s v=(0 0) 00010000:00010000:3.0:1789997975.457347:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997975.457357:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.457377:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997975.457396:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997975.457463:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704616576:12345-192.168.204.4@tcp:101:rm.0 Request processed in 214us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997975.457471:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 639 00000100:00100000:2.0:1789997975.462611:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997975.462844:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704616832 00000100:00100000:1.0:1789997975.462853:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704616832 00000100:00100000:1.0:1789997975.463083:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1197 00000100:00100000:1.0:1789997975.463096:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59375:x1876946704616832:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:1.0:1789997975.463144:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997975.463169:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a400/0x65b43101d592e5ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf214 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463194:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf20d expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463205:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff8a38d0bdf100) 00010000:00010000:1.0:1789997975.463215:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997975.463237:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463252:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463262:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463276:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463283:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463290:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463383:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463393:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.463400:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997975.464096:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].37, 64 off10560 00000004:00080000:1.0:1789997975.464106:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2164156452092ns, next at 2165156450028ns, rc = 0 00010000:00010000:1.0:1789997975.464158:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464169:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464178:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464186:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464192:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464199:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464227:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997975.464247:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464254:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464260:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464267:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997975.464271:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464279:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464288:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:1.0:1789997975.464292:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997975.464296:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464303:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e5c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464320:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464327:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464333:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464339:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997975.464342:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464349:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464356:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:1.0:1789997975.464358:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997975.464361:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997975.464367:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e5bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997975.464376:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002aac3062 reply state 0000000052b38177 transno 4294967755 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997975.464389:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997975.464482:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59375:x1876946704616832:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1386us (1878us total) trans 4294967755 rc 0/0 00000100:00100000:1.0:1789997975.464490:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1197 00010000:00010000:2.0:1789997975.464565:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997975.464572:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.464580:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789997975.464583:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.464590:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.464598:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff8a38e062d100) 00010000:00010000:2.0:1789997975.464601:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997975.464604:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.464613:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e5d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997975.464626:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997975.464628:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997975.464629:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997975.468937:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.468961:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.468971:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.468977:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997975.468981:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.468989:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.469005:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38e062d800) 00010000:00010000:0.0:1789997975.469009:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997975.469014:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997975.469021:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e5c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997976.011122:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713090944:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011209:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997976.011261:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713091456:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011285:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997976.011311:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789997976.011317:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713090816:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011349:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997976.011381:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fd86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713091328:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011405:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997976.011431:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713091072:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011457:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997976.011477:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789997976.011483:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fab28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713091200:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011506:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997976.011539:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713090944 00000100:00100000:0.0:1789997976.011547:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713090944 00000100:00100000:0.0:1789997976.011591:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713091456 00000100:00100000:0.0:1789997976.011594:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713091456 00000100:00100000:0.0:1789997976.011622:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713091072 00000100:00100000:0.0:1789997976.011625:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713091072 00000100:00100000:0.0:1789997976.011683:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1789997976.011693:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713090944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011750:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713090944:12345-0@lo:400:kworker.0 Request processed in 58us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.011757:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1789997976.011773:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1789997976.011780:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713091456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011806:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713091456:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.011811:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:0.0:1789997976.011822:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:0.0:1789997976.011828:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713091072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011860:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713091072:12345-0@lo:400:kworker.0 Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.011865:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:0.0:1789997976.011890:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713090816 00000100:00100000:0.0:1789997976.011894:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713090816 00000100:00100000:0.0:1789997976.011918:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1789997976.011925:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713090816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.011968:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713090816:12345-0@lo:400:kworker.0 Request processed in 44us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.011975:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1789997976.012001:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713091328 00000100:00100000:0.0:1789997976.012004:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713091328 00000100:00100000:0.0:1789997976.012031:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713091200 00000100:00100000:0.0:1789997976.012035:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713091200 00000100:00100000:0.0:1789997976.012056:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1789997976.012062:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713091328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.012099:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713091328:12345-0@lo:400:kworker.0 Request processed in 36us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.012105:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1789997976.012119:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1789997976.012125:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713091200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.012155:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713091200:12345-0@lo:400:kworker.0 Request processed in 31us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.012160:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:0.0:1789997976.012186:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997976.012190:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997976.012193:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997976.012237:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fab28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713091200:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.012249:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713091072:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.012276:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713090816:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.012293:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fd86f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713091328:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.012302:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713090944:0@lo:400:kworker.0 00000100:00100000:0.0:1789997976.012310:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713091456:0@lo:400:kworker.0 00000100:00100000:2.0:1789997976.085935:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997976.085979:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704616960 00000100:00100000:0.0:1789997976.085990:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704616960 00000100:00100000:0.0:1789997976.086065:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1198 00000100:00100000:0.0:1789997976.086076:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59390:x1876946704616960:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:0.0:1789997976.086097:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997976.086118:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e5d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf222 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.086181:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e5de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.086194:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e5de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.086206:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e5de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997976.086240:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789997976.086244:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997976.086261:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e5de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.086284:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e5d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf222 expref: 13 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.086314:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e5de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf222 expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.086321:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997976.086324:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789997976.086328:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1600, rc 0) 00000100:00100000:0.0:1789997976.086381:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59390:x1876946704616960:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 307us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.086388:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1198 00000100:00080000:3.0:1789997976.086485:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789997976.090004:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997976.090097:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704617216 00000100:00100000:2.0:1789997976.090106:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704617216 00000100:00100000:2.0:1789997976.090198:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1199 00000100:00100000:2.0:1789997976.090209:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59390:x1876946704617216:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:2.0:1789997976.090256:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997976.090282:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e5de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf222 expref: 12 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.090304:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1ff expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.090316:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997976.090326:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997976.090351:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.090365:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.090374:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997976.132952:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967752 is committed 00000001:00080000:0.0:1789997976.132972:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967755 is committed 00000004:00080000:0.0:1789997976.132976:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 105 committed 00000001:00080000:0.0:1789997976.132991:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967756 is committed 00000100:00100000:0.0:1789997976.133122:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713091584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997976.133186:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997976.133255:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713091584 00000100:00100000:0.0:1789997976.133262:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713091584 00000100:00100000:0.0:1789997976.133303:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1789997976.133314:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713091584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789997976.133338:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:37 count 1 00010000:00010000:0.0:1789997976.133362:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.133383:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.133397:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997976.133401:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997976.133405:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 4/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.133432:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.133446:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 6 pid: 6659 timeout: 2264 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997976.133457:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946713091712:192.168.204.4@tcp:104: 00000100:00100000:0.0:1789997976.133522:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5c540 going to sleep for 11 seconds 00000004:00010000:2.0:1789997976.134037:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e34d454 reply state 000000002fbb68e6 transno 4294967756 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997976.134048:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997976.134061:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00080000:2.0:1789997976.134185:0:5812:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789997976.134198:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59390:x1876946704617216:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 43991us (44203us total) trans 4294967756 rc 0/0 00000100:00100000:2.0:1789997976.134206:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1199 00010000:00010000:0.0:1789997976.134424:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.134434:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.134440:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.134445:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997976.134449:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.134456:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.134472:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdfb00) 00010000:00010000:0.0:1789997976.134476:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997976.134534:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.134543:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3200/0x65b43101d592e5e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997976.141451:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946713091712:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997976.141482:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997976.145617:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997976.146629:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704617344 00000100:00100000:3.0:1789997976.146640:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704617344 00010000:00010000:3.0:1789997976.146727:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 7 pid: 6659 timeout: 2264 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997976.146767:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 444 00000100:00100000:3.0:1789997976.146778:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704617344:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789997976.147594:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789997976.147605:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 7 pid: 6659 timeout: 2264 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.147620:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 7 pid: 6659 timeout: 2264 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.147698:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d715c7/0x65b43101d592e5b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf21b expref: 7 pid: 6659 timeout: 2264 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.147714:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997976.147718:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997976.147724:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.147732:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.147761:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789997976.147832:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704617344:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 1055us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997976.147841:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 444 00010000:00010000:0.0:1789997976.148228:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.148240:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.148251:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.148259:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.148286:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789997976.148326:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997976.148334:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.148342:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997976.148346:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.148356:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.148369:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.148377:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013230132/0x65b43101d592e5ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.148408:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997976.148410:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997976.148412:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997976.148929:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713091584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15615us (15741us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789997976.148939:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000004:00080000:0.0:1789997976.149323:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c6ecc000/2, rc 0, transno 4294967371 00000100:00100000:0.0:1789997976.149331:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713091584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789997976.185261:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997976.185373:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704617472 00000100:00100000:2.0:1789997976.185384:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704617472 00000100:00100000:2.0:1789997976.185471:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1200 00000100:00100000:2.0:1789997976.185481:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59394:x1876946704617472:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:2.0:1789997976.185503:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997976.185522:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e5f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf229 expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.185795:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.185809:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.185821:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.185835:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.185848:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.185854:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186196:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186206:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186213:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997976.186240:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:2.0:1789997976.186244:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997976.186263:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186276:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186282:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186289:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186296:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997976.186300:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186309:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186320:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:2.0:1789997976.186323:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997976.186328:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186334:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e5fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186346:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186352:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186358:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186363:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997976.186366:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186372:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186379:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38d0bdfa00) 00010000:00010000:2.0:1789997976.186382:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997976.186385:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186395:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e601 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186427:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e5f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf229 expref: 8 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186442:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf229 expref: 7 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.186449:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997976.186451:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789997976.186453:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2000, rc 0) 00000100:00100000:2.0:1789997976.186519:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59394:x1876946704617472:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1040us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997976.186524:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1200 00000100:00100000:1.0:1789997976.190896:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997976.190941:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704617728 00000100:00100000:0.0:1789997976.190952:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704617728 00000100:00100000:0.0:1789997976.191109:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1201 00000100:00100000:0.0:1789997976.191121:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59394:x1876946704617728:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997976.191143:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997976.191162:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e60f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf230 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.191436:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.191452:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.191463:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.191478:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.191486:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.191493:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789997976.192205:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26:0x0], index 1: 0 00010000:00010000:0.0:1789997976.192511:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192525:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192533:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192568:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192575:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192582:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192588:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997976.192592:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192599:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192610:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997976.192613:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997976.192617:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192623:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e616 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997976.192639:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008de7932e reply state 00000000e4ba25ff transno 4294967757 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997976.192694:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789997976.192728:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e60f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf230 expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192750:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf230 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.192759:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997976.192761:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997976.192763:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789997976.192822:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59394:x1876946704617728:12345-192.168.204.4@tcp:101:touch.0 Request processed in 1705us (1936us total) trans 4294967757 rc 0/0 00000100:00100000:0.0:1789997976.192829:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1201 00000100:00100000:0.0:1789997976.197923:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00010000:00010000:3.0:1789997976.197981:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.197995:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.198044:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.198052:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997976.198056:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.198064:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.198080:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38c28e9400) 00010000:00010000:3.0:1789997976.198084:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997976.198089:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.198096:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e61d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997976.198300:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704617984 00000100:00100000:1.0:1789997976.198310:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704617984 00000100:00100000:1.0:1789997976.198369:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1202 00000100:00100000:1.0:1789997976.198379:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59394:x1876946704617984:12345-192.168.204.4@tcp:36:touch.0 00010000:00010000:1.0:1789997976.198431:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997976.198450:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf230 expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997976.198464:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:1.0:1789997976.198471:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997976.198509:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997976.198523:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997976.198534:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997976.198700:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b512fe5c reply state 00000000f5f78d6f transno 4294967758 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997976.198710:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997976.198798:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59394:x1876946704617984:12345-192.168.204.4@tcp:36:touch.0 Request processed in 420us (883us total) trans 4294967758 rc 0/0 00000100:00100000:1.0:1789997976.198805:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1202 00010000:00010000:0.0:1789997976.200711:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.200727:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.200735:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.200742:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997976.200746:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.200755:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.200771:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff8a38e062d700) 00010000:00010000:0.0:1789997976.200775:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997976.200780:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.200787:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e632 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997976.200937:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997976.201075:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704618112 00000100:00100000:0.0:1789997976.201084:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704618112 00000100:00100000:0.0:1789997976.201167:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1203 00000100:00100000:0.0:1789997976.201178:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59394:x1876946704618112:12345-192.168.204.4@tcp:101:touch.0 00010000:00010000:0.0:1789997976.201212:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997976.201231:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e639 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf237 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.201294:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf237 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.201308:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e639 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf237 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.201326:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997976.201329:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789997976.201331:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997976.201389:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59394:x1876946704618112:12345-192.168.204.4@tcp:101:touch.0 Request processed in 212us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.201400:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1203 00000100:00100000:1.0:1789997976.204164:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997976.204369:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704618240 00000100:00100000:0.0:1789997976.204378:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704618240 00000100:00080000:3.0:1789997976.204481:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789997976.204520:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 641 00000100:00100000:0.0:1789997976.204532:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704618240:12345-192.168.204.4@tcp:2:touch.0 00000100:00100000:0.0:1789997976.204922:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704618240:12345-192.168.204.4@tcp:2:touch.0 Request processed in 391us (766us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789997976.204930:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 641 00000100:00100000:1.0:1789997976.209711:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997976.209792:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704618496 00000100:00100000:0.0:1789997976.209803:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704618496 00000100:00100000:0.0:1789997976.209869:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 122 00000100:00100000:0.0:1789997976.209879:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59394:x1876946704618496:12345-192.168.204.4@tcp:35:touch.0 00000100:00100000:0.0:1789997976.210227:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59394:x1876946704618496:12345-192.168.204.4@tcp:35:touch.0 Request processed in 345us (521us total) trans 4294967759 rc 0/0 00000100:00100000:0.0:1789997976.210236:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 122 00000100:00100000:2.0:1789997976.251450:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997976.251610:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704618624 00000100:00100000:0.0:1789997976.251621:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704618624 00000100:00100000:0.0:1789997976.251737:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1204 00000100:00100000:0.0:1789997976.251748:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59398:x1876946704618624:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:0.0:1789997976.251773:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997976.251795:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e640 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf23e expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.251859:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252208:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252222:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252238:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252245:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252394:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252486:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e655 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252496:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252503:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997976.252537:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x63:0x0]: returning size 0 00000004:00200000:0.0:1789997976.252541:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997976.252563:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252576:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252588:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252594:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252601:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252607:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997976.252611:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.252620:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254066:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997976.254075:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997976.254082:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254091:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e647 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254111:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254117:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254123:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254129:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997976.254132:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254138:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254148:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38c28e9500) 00010000:00010000:0.0:1789997976.254151:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997976.254154:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254159:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e64e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254207:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e640 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf23e expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254231:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf23e expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.254239:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:0.0:1789997976.254242:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789997976.254580:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789997976.255318:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59398:x1876946704618624:12345-192.168.204.4@tcp:101:rm.0 Request processed in 3565us (3872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997976.255329:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1204 00000100:00100000:1.0:1789997976.260025:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997976.260100:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704618752 00000100:00100000:3.0:1789997976.260109:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704618752 00000100:00100000:3.0:1789997976.260164:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 642 00000100:00100000:3.0:1789997976.260173:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704618752:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789997976.260189:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997976.260208:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf245 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789997976.260233:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x6ab13398, atime: 0x6ab13398, ctime: 0x6ab13398, blocks: 0x1 00010000:00010000:3.0:1789997976.260253:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=2164s v=(0 0) 00010000:00010000:3.0:1789997976.260257:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789997976.260266:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.260285:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.260297:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789997976.260356:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704618752:12345-192.168.204.4@tcp:101:rm.0 Request processed in 184us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997976.260363:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 642 00000100:00100000:1.0:1789997976.264040:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997976.265986:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704619008 00000100:00100000:2.0:1789997976.265999:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704619008 00000100:00100000:2.0:1789997976.266073:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1205 00000100:00100000:2.0:1789997976.266085:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59398:x1876946704619008:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997976.266134:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789997976.266160:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0a00/0x65b43101d592e655 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf23e expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266193:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e639 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x63:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf237 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266206:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff8a38c28e9f00) 00010000:00010000:2.0:1789997976.266217:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997976.266240:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266255:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266265:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266279:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266287:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266293:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266383:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266390:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.266397:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997976.268905:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].38, 64 off10624 00000004:00080000:2.0:1789997976.268920:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2164961265612ns, next at 2165961262693ns, rc = 0 00010000:00010000:2.0:1789997976.268986:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269002:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269014:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269023:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269029:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269036:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269062:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997976.269083:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269090:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269096:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269102:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997976.269107:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269115:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269126:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:2.0:1789997976.269129:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997976.269134:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269141:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e671 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269158:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269164:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269170:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269175:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997976.269177:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.269181:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789997976.269183:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.269190:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269193:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997976.269199:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997976.269202:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.269204:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997976.269211:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.269214:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2600/0x65b43101d592e663 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997976.269228:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd00beee reply state 00000000dab874b4 transno 4294967760 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.269244:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997976.269245:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997976.269331:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff8a38d0bdf800) 00010000:00010000:3.0:1789997976.269334:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997976.269340:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997976.269341:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59398:x1876946704619008:12345-192.168.204.4@tcp:36:rm.0 Request processed in 3252us (5303us total) trans 4294967760 rc 0/0 00010000:00010000:3.0:1789997976.269353:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e678 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997976.269359:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1205 00010000:00010000:3.0:1789997976.269378:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997976.269380:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997976.269381:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997976.273595:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.273612:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.273620:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.273626:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997976.273630:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.273637:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.273688:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38d0bdfa00) 00010000:00010000:3.0:1789997976.273692:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997976.273697:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.273704:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e66a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.330853:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997976.911910:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997976.914046:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704619136 00000100:00100000:2.0:1789997976.914060:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704619136 00000100:00100000:2.0:1789997976.914118:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1206 00000100:00100000:2.0:1789997976.914129:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59412:x1876946704619136:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:2.0:1789997976.914153:0:11799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997976.914176:0:11799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e67f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf24c expref: -99 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.914243:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592e686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.914256:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592e686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.914267:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592e686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789997976.914303:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:2.0:1789997976.914307:0:11799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789997976.914325:0:11799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592e686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.914350:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e67f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf24c expref: 13 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.914366:0:11799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592e686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf24c expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997976.914374:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:2.0:1789997976.914376:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789997976.914380:0:11799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789997976.914468:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59412:x1876946704619136:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 340us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997976.914475:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1206 00000100:00100000:2.0:1789997976.922648:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997976.923112:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704619392 00000100:00100000:0.0:1789997976.923123:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704619392 00000100:00100000:0.0:1789997976.923212:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1207 00000100:00100000:0.0:1789997976.923223:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59412:x1876946704619392:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:0.0:1789997976.923274:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789997976.923301:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3600/0x65b43101d592e686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf24c expref: 12 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.923324:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2000/0x65b43101d592e608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf229 expref: 11 pid: 11799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.923334:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38d0bdf900) 00010000:00010000:0.0:1789997976.923345:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789997976.923370:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.923383:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997976.923393:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789997976.926740:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca77618a reply state 00000000be548677 transno 4294967761 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997976.926755:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789997976.926766:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:0.0:1789997976.926864:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59412:x1876946704619392:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 3639us (4232us total) trans 4294967761 rc 0/0 00000100:00100000:0.0:1789997976.926873:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1207 00010000:00010000:3.0:1789997976.933283:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.933304:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.933312:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.933320:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997976.933325:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.933333:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.933352:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9500) 00010000:00010000:3.0:1789997976.933355:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997976.933361:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997976.933367:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e68d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997977.033869:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997977.034399:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704619520 00000100:00100000:1.0:1789997977.034542:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704619520 00000100:00100000:1.0:1789997977.034609:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1208 00000100:00100000:1.0:1789997977.034620:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59424:x1876946704619520:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997977.034831:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59424:x1876946704619520:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 212us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997977.034839:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1208 00000100:00100000:2.0:1789997977.039476:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997977.039572:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704619648 00000100:00100000:1.0:1789997977.039583:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704619648 00000100:00100000:1.0:1789997977.039711:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 643 00000100:00100000:1.0:1789997977.039722:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59424:x1876946704619648:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997977.040099:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59424:x1876946704619648:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 378us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997977.040108:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 643 00000100:00080000:3.0:1789997977.040309:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789997977.046982:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997977.047101:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704619776 00000100:00100000:0.0:1789997977.047112:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704619776 00000100:00100000:0.0:1789997977.047212:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 644 00000100:00100000:0.0:1789997977.047223:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59424:x1876946704619776:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997977.047647:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59424:x1876946704619776:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 424us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.047684:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 644 00000100:00100000:2.0:1789997977.054069:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997977.054167:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704619904 00000100:00100000:0.0:1789997977.054177:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704619904 00000100:00100000:0.0:1789997977.054276:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1209 00000100:00100000:0.0:1789997977.054289:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59424:x1876946704619904:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997977.054791:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59424:x1876946704619904:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 504us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.054799:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1209 00000100:00100000:2.0:1789997977.059133:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997977.059220:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704620032 00000100:00100000:0.0:1789997977.059229:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704620032 00000100:00100000:0.0:1789997977.059455:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1210 00000100:00100000:0.0:1789997977.059467:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59424:x1876946704620032:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997977.059577:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59424:x1876946704620032:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 112us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.059584:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1210 00000100:00100000:0.0:1789997977.064176:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997977.064346:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704620160 00000100:00100000:1.0:1789997977.064356:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704620160 00000100:00100000:1.0:1789997977.064456:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 645 00000100:00100000:1.0:1789997977.064466:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59424:x1876946704620160:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997977.065751:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59424:x1876946704620160:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1281us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997977.065763:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 645 00000100:00100000:1.0:1789997977.072483:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997977.072579:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704620288 00000100:00100000:0.0:1789997977.072590:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704620288 00000100:00100000:0.0:1789997977.072697:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 646 00000100:00100000:0.0:1789997977.072707:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59424:x1876946704620288:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997977.073082:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59424:x1876946704620288:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 375us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.073091:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 646 00000100:00100000:2.0:1789997977.076305:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997977.076420:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704620416 00000100:00100000:3.0:1789997977.076430:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704620416 00000100:00100000:3.0:1789997977.076616:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1211 00000100:00100000:3.0:1789997977.076810:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59424:x1876946704620416:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997977.077439:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59424:x1876946704620416:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 814us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997977.077519:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1211 00000100:00100000:1.0:1789997977.128024:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997977.128241:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704620544 00000100:00100000:0.0:1789997977.128250:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704620544 00000100:00100000:0.0:1789997977.128377:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1212 00000100:00100000:0.0:1789997977.128389:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59428:x1876946704620544:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997977.128410:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997977.128430:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf253 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.128491:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.128507:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.128518:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.128533:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.130363:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.130385:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.130926:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e6a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.130941:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.130949:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997977.130981:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789997977.130985:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997977.131005:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131018:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131025:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131032:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131157:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997977.131163:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131171:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131183:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:0.0:1789997977.131186:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997977.131191:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131201:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e69b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131215:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131222:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131227:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131232:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997977.131234:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131299:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131307:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38c28e9400) 00010000:00010000:0.0:1789997977.131309:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997977.131312:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131317:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e6a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131359:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf253 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131372:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf253 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.131379:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789997977.131381:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997977.131383:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789997977.131507:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59428:x1876946704620544:12345-192.168.204.4@tcp:101:dd.0 Request processed in 3120us (3490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.131515:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1212 00000100:00100000:1.0:1789997977.138119:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997977.138281:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704620800 00000100:00100000:2.0:1789997977.138292:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704620800 00000100:00100000:2.0:1789997977.138350:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1213 00000100:00100000:2.0:1789997977.138362:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59428:x1876946704620800:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:2.0:1789997977.138382:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997977.138403:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592e6b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf25a expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.138526:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.138542:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.138554:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.138569:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.138576:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.138583:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789997977.139605:0:12471:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26:0x0], index 0: 0 00010000:00010000:2.0:1789997977.140046:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e6c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140060:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140070:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140333:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140346:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140353:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140359:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997977.140363:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140371:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140385:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997977.140389:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997977.140394:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140401:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2800/0x65b43101d592e6b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997977.140415:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000faa5acd8 reply state 0000000020dc9180 transno 4294967762 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997977.140423:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789997977.140457:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3000/0x65b43101d592e6b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf25a expref: 15 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140472:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf25a expref: 14 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997977.140485:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997977.140487:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789997977.140490:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3c00, rc 0) 00000100:00100000:2.0:1789997977.140637:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+15:59428:x1876946704620800:12345-192.168.204.4@tcp:101:dd.0 Request processed in 2276us (2526us total) trans 4294967762 rc 0/0 00000100:00100000:2.0:1789997977.140646:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1213 00010000:00010000:3.0:1789997977.142645:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997977.142761:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997977.142769:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997977.142775:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997977.142780:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997977.142787:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997977.142802:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38d0bdf200) 00010000:00010000:3.0:1789997977.142805:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997977.142810:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997977.142817:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2a00/0x65b43101d592e6be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997977.149471:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997977.149528:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704620928 00000100:00100000:0.0:1789997977.149540:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704620928 00000100:00100000:0.0:1789997977.149601:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 647 00000100:00100000:0.0:1789997977.149613:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59428:x1876946704620928:12345-192.168.204.4@tcp:101:dd.0 00010000:00010000:0.0:1789997977.149644:0:99743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997977.149694:0:99743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf261 expref: -99 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997977.149728:0:99743:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789997977.149749:0:99743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=2165s v=(0 0) 00010000:00010000:0.0:1789997977.149754:0:99743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997977.149763:0:99743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 7 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.149781:0:99743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 7 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.149795:0:99743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789997977.149866:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59428:x1876946704620928:12345-192.168.204.4@tcp:101:dd.0 Request processed in 255us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.149873:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 647 00000100:00100000:2.0:1789997977.176481:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997977.177243:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704621056 00000100:00100000:3.0:1789997977.177255:0:6662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704621056 00002000:00100000:2.0:1789997977.178774:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x26:0x0] (0->1048575) req@ffff8a38fadf0a80 x1876946704621056/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:198/0 lens 488/0 e 0 to 0 dl 1789997988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997977.178789:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fadf0a80 with x1876946704621056 ext(0->1048575) 00002000:00010000:2.0:1789997977.178795:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fadf0a80 00000100:00100000:2.0:1789997977.178834:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 30 00000100:00100000:2.0:1789997977.178846:0:6662:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704621056:12345-192.168.204.4@tcp:4:dd.0 00000100:00100000:2.0:1789997977.204942:0:6662:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:2354:x1876946704621056:12345-192.168.204.4@tcp:4:dd.0 Request processed in 26086us (28458us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789997977.204957:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 30 00002000:00100000:2.0:1789997977.204970:0:6662:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x26:0x0] (0->1048575) req@ffff8a38fadf0a80 x1876946704621056/t4294967372(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:198/0 lens 488/448 e 0 to 0 dl 1789997988 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789997977.204980:0:6662:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38fadf0a80 with x1876946704621056 ext(0->1048575) 00002000:00010000:2.0:1789997977.204987:0:6662:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38fadf0a80 00000100:00100000:2.0:1789997977.208956:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997977.209077:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704621184 00000100:00100000:1.0:1789997977.209088:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704621184 00000100:00100000:1.0:1789997977.209261:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1214 00000100:00100000:1.0:1789997977.209288:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:59428:x1876946704621184:12345-192.168.204.4@tcp:44:dd.0 00000100:00100000:1.0:1789997977.256239:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+14:59428:x1876946704621184:12345-192.168.204.4@tcp:44:dd.0 Request processed in 46951us (47283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997977.256251:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1214 00000001:00080000:3.0:1789997977.256314:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967761 is committed 00000001:00080000:3.0:1789997977.256332:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967762 is committed 00000004:00080000:3.0:1789997977.256338:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 107 committed 00000100:00100000:3.0:1789997977.256514:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713091840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789997977.256575:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997977.256686:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713091840 00000100:00100000:1.0:1789997977.256693:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713091840 00000100:00100000:1.0:1789997977.256732:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1789997977.256740:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713091840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789997977.256763:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:38 count 1 00010000:00010000:1.0:1789997977.256787:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997977.256806:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997977.256820:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789997977.256825:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997977.256829:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997977.256871:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 6 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997977.256885:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 6 pid: 6659 timeout: 2265 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997977.256897:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946713091968:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997977.256937:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c532c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789997977.260093:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946713091968:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997977.260124:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997977.260861:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997977.260944:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997977.261013:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704621440 00000100:00100000:3.0:1789997977.261021:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704621440 00000100:00100000:3.0:1789997977.261070:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 649 00000100:00100000:3.0:1789997977.261081:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:2355:x1876946704621440:12345-192.168.204.4@tcp:16:dd.0 00000100:00100000:0.0:1789997977.262568:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704621312 00000100:00100000:0.0:1789997977.262578:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704621312 00010000:00010000:0.0:1789997977.262614:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 7 pid: 6659 timeout: 2265 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997977.262678:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 445 00000100:00100000:0.0:1789997977.262688:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704621312:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789997977.262700:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997977.262706:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 7 pid: 6659 timeout: 2265 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.262720:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 7 pid: 6659 timeout: 2265 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.262743:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1d715c7/0x65b43101d592e65c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf245 expref: 7 pid: 6659 timeout: 2265 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.262759:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997977.262763:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997977.262769:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.262780:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.262808:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997977.262865:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704621312:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 178us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.262872:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 445 00010000:00010000:0.0:1789997977.262981:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.262991:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.263002:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.263011:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.263028:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997977.263472:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1876946713091840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6731us (6896us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789997977.263480:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00010000:00010000:0.0:1789997977.263501:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997977.263508:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.263517:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997977.263521:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.263529:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.263549:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.263557:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc9312c0/0x65b43101d592e6da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997977.263574:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997977.263575:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997977.263577:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997977.263609:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3aca80/2, rc 0, transno 4294967373 00000100:00100000:0.0:1789997977.263616:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713091840:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789997977.304599:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00000001:00080000:2.0:1789997977.304612:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00000001:00080000:2.0:1789997977.304629:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00000100:00100000:0.0:1789997977.308416:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704621440:12345-192.168.204.4@tcp:16:dd.0 Request processed in 47326us (47461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.308429:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 649 00000100:00100000:2.0:1789997977.312093:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997977.312197:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704621696 00000100:00100000:3.0:1789997977.312207:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704621696 00000100:00100000:3.0:1789997977.312299:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 123 00000100:00100000:3.0:1789997977.312311:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de231c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59428:x1876946704621696:12345-192.168.204.4@tcp:35:dd.0 00000100:00100000:0.0:1789997977.315250:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de231c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59428:x1876946704621696:12345-192.168.204.4@tcp:35:dd.0 Request processed in 2933us (3158us total) trans 4294967763 rc 0/0 00000100:00100000:0.0:1789997977.315262:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 123 00010000:00010000:3.0:1789997977.354808:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997977.883515:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997977.883593:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704621824 00000100:00100000:0.0:1789997977.883604:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704621824 00000100:00100000:0.0:1789997977.883736:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1267 00000100:00100000:0.0:1789997977.883747:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704621824:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997977.883825:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704621824:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997977.883832:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1267 00000100:00100000:2.0:1789997978.062541:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789997978.062561:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713092096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997978.062641:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997978.062854:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713092096 00000100:00100000:1.0:1789997978.062862:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713092096 00000100:00100000:1.0:1789997978.062920:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:1.0:1789997978.062930:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713092096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789997978.062954:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789997978.062999:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713092096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997978.063006:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00080000:1.0:1789997978.063024:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997978.063050:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:1.0:1789997978.063055:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c6ecc000, transno 4294967371 00000100:00100000:1.0:1789997978.063070:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713092096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789997978.064151:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789997978.064166:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713092224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789997978.064211:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997978.064467:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713092224 00000100:00100000:3.0:1789997978.064473:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713092224 00000100:00100000:3.0:1789997978.064562:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:3.0:1789997978.064572:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713092224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789997978.064599:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789997978.064684:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713092224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997978.064691:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00080000:0.0:1789997978.064745:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997978.064984:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c3533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713092224:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1789997978.294333:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967763 is committed 00010000:00010000:2.0:1789997978.380685:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789997978.629791:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967373 is committed 00000001:00080000:0.0:1789997978.629808:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967372 is committed 00000004:00080000:0.0:1789997979.312419:0:101197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2168004762303ns, next at 2165156450028ns, rc = 0 00000004:00080000:0.0:1789997979.313269:0:101197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2168005613575ns, next at 2165961262693ns, rc = 0 00000004:00080000:3.0:1789997979.320380:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 108 committed 00000004:00080000:3.0:1789997979.320405:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 106 committed 00010000:00010000:1.0:1789997979.407081:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997980.302158:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997980.302230:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704621952 00000100:00100000:1.0:1789997980.302240:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704621952 00000100:00100000:1.0:1789997980.302313:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1215 00000100:00100000:1.0:1789997980.302324:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59620:x1876946704621952:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:1.0:1789997980.302534:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59620:x1876946704621952:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 211us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997980.302543:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1215 00000100:00080000:0.0:1789997980.303020:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997980.304980:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997980.310941:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704622080 00000100:00100000:0.0:1789997980.310955:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704622080 00000100:00100000:0.0:1789997980.311025:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 650 00000100:00100000:0.0:1789997980.311037:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59620:x1876946704622080:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997980.311545:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59620:x1876946704622080:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 510us (6571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997980.311553:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 650 00000100:00080000:0.0:1789997980.311592:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997980.319489:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997980.319589:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704622208 00000100:00100000:3.0:1789997980.319600:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704622208 00000100:00080000:0.0:1789997980.319675:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789997980.319691:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 651 00000100:00100000:3.0:1789997980.319704:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59620:x1876946704622208:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997980.320167:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59620:x1876946704622208:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 464us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997980.320177:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 651 00000100:00100000:3.0:1789997980.328100:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997980.328454:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704622336 00000100:00100000:0.0:1789997980.328465:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704622336 00000100:00100000:0.0:1789997980.328555:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1216 00000100:00100000:0.0:1789997980.328577:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59620:x1876946704622336:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997980.329308:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59620:x1876946704622336:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 742us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997980.329318:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1216 00000100:00100000:3.0:1789997980.338744:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997980.338786:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704622464 00000100:00100000:3.0:1789997980.338796:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704622464 00000100:00100000:3.0:1789997980.338848:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1217 00000100:00100000:3.0:1789997980.338859:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59620:x1876946704622464:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:3.0:1789997980.338952:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59620:x1876946704622464:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997980.338962:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1217 00000100:00100000:3.0:1789997980.343103:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997980.343180:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704622592 00000100:00100000:0.0:1789997980.343190:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704622592 00000100:00100000:0.0:1789997980.343262:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 652 00000100:00100000:0.0:1789997980.343276:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59620:x1876946704622592:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997980.343726:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59620:x1876946704622592:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 452us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997980.343735:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 652 00000100:00100000:0.0:1789997980.360230:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997980.362792:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704622720 00000100:00100000:3.0:1789997980.362805:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704622720 00000100:00100000:3.0:1789997980.362864:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 653 00000100:00100000:3.0:1789997980.362875:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59620:x1876946704622720:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:3.0:1789997980.363494:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59620:x1876946704622720:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 619us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997980.363503:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 653 00000100:00100000:3.0:1789997980.365512:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997980.365717:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704622848 00000100:00100000:0.0:1789997980.365726:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704622848 00000100:00100000:0.0:1789997980.365774:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1218 00000100:00100000:0.0:1789997980.365783:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59620:x1876946704622848:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997980.366207:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59620:x1876946704622848:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 423us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997980.366214:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1218 00000100:00100000:0.0:1789997980.419123:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997980.419223:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704623104 00000100:00100000:2.0:1789997980.419233:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704623104 00000100:00100000:2.0:1789997980.419288:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1219 00000100:00100000:2.0:1789997980.419298:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59624:x1876946704623104:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:2.0:1789997980.419352:0:12471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997980.419381:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3c00/0x65b43101d592e6c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf25a expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419401:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff8a38d0bdf000) 00010000:00010000:2.0:1789997980.419410:0:12471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789997980.419431:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419444:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419456:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419468:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419474:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419481:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419851:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419860:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.419867:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789997980.420741:0:12471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].38, 64 off10624 00000004:00080000:2.0:1789997980.420753:0:12471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2169113098477ns, next at 2170113095164ns, rc = 0 00010000:00010000:2.0:1789997980.420848:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420860:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420870:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420881:0:12471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420886:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420892:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420905:0:12471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789997980.420927:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420933:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420939:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420945:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997980.420950:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420957:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420968:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:2.0:1789997980.420971:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789997980.420976:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.420986:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3e00/0x65b43101d592e6ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.421004:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.421010:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.421016:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.421021:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997980.421024:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.421029:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.421036:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:2.0:1789997980.421037:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997980.421041:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.421045:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2c00/0x65b43101d592e6e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789997980.421055:0:12471:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e1d9ad8 reply state 000000001e188079 transno 4294967764 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997980.421063:0:12471:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789997980.421146:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59624:x1876946704623104:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1846us (2028us total) trans 4294967764 rc 0/0 00000100:00100000:2.0:1789997980.421154:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1219 00010000:00010000:3.0:1789997980.421326:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789997980.421335:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997980.421340:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789997980.421344:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997980.421350:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997980.421358:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff8a38d0bdff00) 00010000:00010000:3.0:1789997980.421360:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789997980.421363:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997980.421368:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3400/0x65b43101d592e6f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997980.421381:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997980.421383:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789997980.421385:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789997980.423828:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997980.423844:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997980.423851:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997980.423857:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997980.423860:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997980.423868:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997980.423882:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38d0bdf600) 00010000:00010000:1.0:1789997980.423885:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997980.423891:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997980.423897:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b3800/0x65b43101d592e6e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997980.427914:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997981.136515:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713092480:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.136594:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997981.136640:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713092992:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.136684:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997981.136714:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789997981.136720:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713092352:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.136752:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997981.136841:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713092864:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.136868:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997981.136895:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713092608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.136915:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997981.136933:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997981.136939:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713092736:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.136956:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997981.136983:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713092480 00000100:00100000:1.0:1789997981.136991:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713092480 00000100:00100000:1.0:1789997981.137028:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713092992 00000100:00100000:1.0:1789997981.137031:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713092992 00000100:00100000:1.0:1789997981.137053:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713092608 00000100:00100000:1.0:1789997981.137055:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713092608 00000100:00100000:1.0:1789997981.137073:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:1.0:1789997981.137080:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713092480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137124:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713092480:12345-0@lo:400:kworker.0 Request processed in 45us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997981.137131:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:1.0:1789997981.137147:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:1.0:1789997981.137231:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713092992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137261:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713092992:12345-0@lo:400:kworker.0 Request processed in 109us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997981.137268:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:1.0:1789997981.137281:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:1.0:1789997981.137286:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713092608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137315:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713092608:12345-0@lo:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997981.137321:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:1.0:1789997981.137342:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713092352 00000100:00100000:1.0:1789997981.137345:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713092352 00000100:00100000:1.0:1789997981.137370:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1789997981.137376:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713092352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137402:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713092352:12345-0@lo:400:kworker.0 Request processed in 27us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997981.137408:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1789997981.137433:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713092864 00000100:00100000:1.0:1789997981.137436:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713092864 00000100:00100000:1.0:1789997981.137461:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713092736 00000100:00100000:1.0:1789997981.137464:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713092736 00000100:00100000:1.0:1789997981.137481:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1789997981.137487:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713092864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137518:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713092864:12345-0@lo:400:kworker.0 Request processed in 31us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997981.137523:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1789997981.137534:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:1.0:1789997981.137539:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713092736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137575:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713092736:12345-0@lo:400:kworker.0 Request processed in 36us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997981.137580:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00080000:1.0:1789997981.137607:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789997981.137610:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997981.137612:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789997981.137676:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713092736:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137688:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713092608:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137721:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713092352:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137730:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:1.0:1789997981.137735:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3aca80, transno 4294967373 00000100:00100000:1.0:1789997981.137747:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713092864:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137758:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713092480:0@lo:400:kworker.0 00000100:00100000:1.0:1789997981.137767:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713092992:0@lo:400:kworker.0 00010000:00010000:1.0:1789997981.451390:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997981.982292:0:101341:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2170674635053ns, next at 2170113095164ns, rc = 0 00000004:00080000:3.0:1789997982.017785:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 108 committed 00000001:00080000:3.0:1789997982.017817:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967764 is committed 00000004:00080000:3.0:1789997982.017822:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 107 committed 00000100:00100000:3.0:1789997982.018023:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789997982.018043:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713093120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789997982.018108:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997982.018502:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713093120 00000100:00100000:2.0:1789997982.018509:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713093120 00000100:00100000:2.0:1789997982.018561:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1789997982.018572:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713093120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789997982.018688:0:6658:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:38 count 1 00010000:00010000:2.0:1789997982.018719:0:6658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.018740:0:6658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 5 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.018749:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x26:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1789997982.018754:0:6658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997982.018759:0:6658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.018788:0:6658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 5 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.018802:0:6658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 5 pid: 99743 timeout: 2270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997982.018815:0:6658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946713093248:192.168.204.4@tcp:104: 00000100:00100000:2.0:1789997982.018882:0:6658:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789997982.024572:0:6658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6658:1876946713093248:192.168.204.4@tcp:104: 00010000:00010000:2.0:1789997982.024609:0:6658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997982.025325:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997982.025430:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704623232 00000100:00100000:2.0:1789997982.025438:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704623232 00010000:00010000:2.0:1789997982.025493:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 6 pid: 99743 timeout: 2270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789997982.025591:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997982.025636:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 446 00000100:00100000:2.0:1789997982.025647:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704623232:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789997982.025705:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789997982.025712:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 6 pid: 99743 timeout: 2270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.025724:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 6 pid: 99743 timeout: 2270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.025749:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f7abbd/0x65b43101d592e6d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf261 expref: 6 pid: 99743 timeout: 2270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.025783:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997982.025788:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789997982.025793:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.025808:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997982.025840:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789997982.025904:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704623232:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 258us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997982.025911:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 446 00010000:00010000:1.0:1789997982.025972:0:6658:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997982.025986:0:6658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997982.025996:0:6658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997982.026004:0:6658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997982.026028:0:6658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789997982.026444:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997982.026452:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997982.026461:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997982.026466:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997982.026476:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997982.026490:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997982.026497:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000200d8645/0x65b43101d592e6fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997982.026516:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997982.026518:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997982.026519:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997982.026710:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713093120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8139us (8600us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789997982.026719:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000004:00080000:3.0:1789997982.026903:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c7331500/2, rc 0, transno 4294967373 00000100:00100000:3.0:1789997982.026986:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713093120:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1789997982.028092:0:101341:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2170720436729ns, next at 2165961262693ns, rc = 0 00000004:00080000:1.0:1789997982.036680:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 109 committed 00010000:00010000:2.0:1789997982.475399:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997982.998760:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997982.998806:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997982.998836:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997982.998872:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704623360 00000100:00100000:2.0:1789997982.998883:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704623360 00000100:00100000:3.0:1789997982.998911:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997982.998946:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1269 00000100:00100000:1.0:1789997982.998946:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704623488 00000100:00100000:1.0:1789997982.998954:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704623488 00000100:00100000:2.0:1789997982.998962:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704623360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997982.999005:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1596 00000100:00100000:1.0:1789997982.999014:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704623488:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997982.999020:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704623744 00000100:00100000:2.0:1789997982.999025:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704623744 00000100:00100000:2.0:1789997982.999058:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704623616 00000100:00100000:2.0:1789997982.999061:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704623616 00000100:00100000:2.0:1789997982.999082:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1106 00000100:00100000:2.0:1789997982.999090:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704623744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997982.999109:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1107 00000100:00100000:0.0:1789997982.999288:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704623616:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997982.999391:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704623360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 432us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997982.999399:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1269 00000100:00100000:1.0:1789997983.002597:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704623488:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3572us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997983.002611:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1596 00000100:00100000:2.0:1789997983.002633:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704623744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3539us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997983.002668:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704623616:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 3527us (3735us total) trans 0 rc 0/0 00000100:00080000:1.0:1789997983.002674:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997983.002681:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997983.002791:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1106 00000100:00100000:0.0:1789997983.003282:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1107 00000100:00100000:0.0:1789997983.178937:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713093376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997983.179005:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997983.179023:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713093504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997983.179070:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997983.179112:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713093376 00000100:00100000:3.0:1789997983.179119:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713093376 00000100:00100000:3.0:1789997983.179165:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713093504 00000100:00100000:3.0:1789997983.179168:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713093504 00000100:00100000:3.0:1789997983.179185:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:3.0:1789997983.179194:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713093376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789997983.179226:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789997983.179313:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:2.0:1789997983.179326:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713093504:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789997983.179334:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789997983.179340:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789997983.179349:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997983.179400:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713093504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997983.179407:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1789997983.179998:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713093504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997983.180902:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713093376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1705us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997983.180903:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713093376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997983.180917:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00010000:00010000:0.0:1789997983.500159:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997984.523384:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789997985.296108:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00010000:00010000:2.0:1789997985.546944:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997986.250908:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713093632:0@lo:400:kworker.0 00000100:00100000:1.0:1789997986.250919:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713093760:0@lo:400:kworker.0 00000100:00100000:0.0:1789997986.251043:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713094016:0@lo:400:kworker.0 00000100:00100000:1.0:1789997986.251263:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997986.251291:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997986.251405:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713094272:0@lo:400:kworker.0 00000100:00100000:3.0:1789997986.251416:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713094144:0@lo:400:kworker.0 00000100:00100000:1.0:1789997986.251438:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997986.251469:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997986.251484:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997986.251493:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713093888:0@lo:400:kworker.0 00000100:00100000:1.0:1789997986.251521:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997986.251555:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713093760 00000100:00100000:3.0:1789997986.251563:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713093760 00000100:00100000:1.0:1789997986.251564:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713093632 00000100:00100000:1.0:1789997986.251570:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713093632 00000100:00100000:1.0:1789997986.251613:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1789997986.251623:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713093632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997986.251625:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713094272 00000100:00100000:3.0:1789997986.251632:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713094272 00000100:00100000:2.0:1789997986.251676:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713093888 00000100:00100000:2.0:1789997986.251682:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713093888 00000100:00100000:3.0:1789997986.251694:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1789997986.251704:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997986.251722:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:2.0:1789997986.251732:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713094272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789997986.251752:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713093760:12345-0@lo:400:kworker.0 Request processed in 50us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997986.251760:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:2.0:1789997986.251781:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713094272:12345-0@lo:400:kworker.0 Request processed in 49us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997986.251782:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:2.0:1789997986.251793:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1789997986.251795:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713093888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997986.251827:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713093632:12345-0@lo:400:kworker.0 Request processed in 204us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997986.251837:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00080000:2.0:1789997986.251857:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789997986.251859:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713093888:12345-0@lo:400:kworker.0 Request processed in 67us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997986.251867:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:2.0:1789997986.251882:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713094144 00000100:00100000:2.0:1789997986.251887:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713094144 00000100:00100000:1.0:1789997986.251896:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713093888:0@lo:400:kworker.0 00000100:00100000:3.0:1789997986.251912:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713093632:0@lo:400:kworker.0 00000100:00100000:1.0:1789997986.251917:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713093760:0@lo:400:kworker.0 00000100:00100000:2.0:1789997986.251934:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1789997986.251937:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713094272:0@lo:400:kworker.0 00000100:00080000:3.0:1789997986.251945:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997986.251948:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713094144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997986.252002:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713094144:12345-0@lo:400:kworker.0 Request processed in 59us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997986.252008:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1789997986.252087:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997986.252179:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713094016 00000100:00100000:1.0:1789997986.252183:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713094016 00000100:00100000:3.0:1789997986.252232:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713094144:0@lo:400:kworker.0 00000100:00100000:1.0:1789997986.252266:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1789997986.252273:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713094016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997986.252323:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713094016:12345-0@lo:400:kworker.0 Request processed in 42us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997986.252330:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1789997986.252586:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:0.0:1789997986.252592:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c7331500, transno 4294967373 00000100:00100000:0.0:1789997986.252612:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713094016:0@lo:400:kworker.0 00000100:00080000:2.0:1789997986.253087:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789997986.573293:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997987.595513:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997988.119458:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997988.119511:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997988.119552:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997988.119580:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997988.119607:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704623872 00000100:00100000:2.0:1789997988.119617:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704623872 00000100:00100000:2.0:1789997988.119692:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1271 00000100:00100000:2.0:1789997988.119703:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704623872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997988.119747:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704624256 00000100:00100000:3.0:1789997988.119754:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704624256 00000100:00100000:2.0:1789997988.119774:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704623872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997988.119784:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1271 00000100:00100000:3.0:1789997988.119799:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704624128 00000100:00100000:3.0:1789997988.119804:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704624128 00000100:00100000:3.0:1789997988.119831:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1110 00000100:00100000:2.0:1789997988.119840:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1111 00000100:00100000:3.0:1789997988.119842:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704624256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997988.119854:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704624128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997988.119882:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704624256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 42us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997988.119890:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704624128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 40us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997988.119892:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1110 00000100:00100000:2.0:1789997988.119903:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1111 00000100:00080000:3.0:1789997988.120334:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997988.120338:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997988.120589:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704624000 00000100:00100000:1.0:1789997988.120595:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704624000 00000100:00100000:1.0:1789997988.120676:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1600 00000100:00100000:1.0:1789997988.120686:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704624000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997988.120737:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704624000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 53us (1289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997988.120744:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1600 00000100:00080000:3.0:1789997988.122210:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997988.299070:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713094400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997988.299160:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997988.299162:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997988.299178:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713094528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789997988.299214:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997988.299249:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713094400 00000100:00100000:2.0:1789997988.299258:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713094400 00000100:00100000:1.0:1789997988.299304:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713094528 00000100:00100000:1.0:1789997988.299310:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713094528 00000100:00100000:2.0:1789997988.299324:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:2.0:1789997988.299336:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713094400:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997988.299343:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1789997988.299353:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713094528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789997988.299371:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00002000:00000024:1.0:1789997988.299377:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789997988.299469:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997988.299474:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997988.301493:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713094400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2153us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997988.301508:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1789997988.301718:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713094400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997988.304944:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713094528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5583us (5720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997988.304959:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:2.0:1789997988.305072:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713094528:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789997988.618915:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997989.643640:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997990.666976:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997991.370985:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713094784:0@lo:400:kworker.0 00000100:00100000:0.0:1789997991.371049:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997991.371105:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713095296:0@lo:400:kworker.0 00000100:00100000:0.0:1789997991.371124:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997991.371156:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789997991.371163:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713094912:0@lo:400:kworker.0 00000100:00100000:2.0:1789997991.371260:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713094656:0@lo:400:kworker.0 00000100:00100000:2.0:1789997991.371298:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997991.371320:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c774ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713095168:0@lo:400:kworker.0 00000100:00100000:2.0:1789997991.371342:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997991.371369:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789997991.371375:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713095040:0@lo:400:kworker.0 00000100:00100000:2.0:1789997991.371393:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997991.371430:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713094784 00000100:00100000:2.0:1789997991.371438:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713094784 00000100:00100000:2.0:1789997991.371473:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713095296 00000100:00100000:2.0:1789997991.371476:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713095296 00000100:00100000:2.0:1789997991.371500:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:2.0:1789997991.371508:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713094784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997991.371549:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fd86f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713094784:12345-0@lo:400:kworker.0 Request processed in 42us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997991.371556:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00100000:2.0:1789997991.371583:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:2.0:1789997991.371589:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713095296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789997991.371615:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713095296:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997991.371620:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00100000:1.0:1789997991.371938:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713094656 00000100:00100000:1.0:1789997991.371943:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713094656 00000100:00100000:1.0:1789997991.371980:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1789997991.371987:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713094656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997991.372027:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713094656:12345-0@lo:400:kworker.0 Request processed in 40us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997991.372033:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1789997991.372059:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713095168 00000100:00100000:1.0:1789997991.372062:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713095168 00000100:00100000:1.0:1789997991.372084:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713095040 00000100:00100000:1.0:1789997991.372087:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713095040 00000100:00100000:1.0:1789997991.372105:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1789997991.372111:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713095168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997991.372140:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713095168:12345-0@lo:400:kworker.0 Request processed in 29us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997991.372145:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1789997991.372157:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1789997991.372162:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713095040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997991.372203:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713095040:12345-0@lo:400:kworker.0 Request processed in 41us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997991.372208:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1789997991.372252:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713095040:0@lo:400:kworker.0 00000100:00100000:1.0:1789997991.372262:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713094656:0@lo:400:kworker.0 00000100:00100000:1.0:1789997991.372271:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713095168:0@lo:400:kworker.0 00000100:00100000:0.0:1789997991.373780:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997991.373892:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713094784:0@lo:400:kworker.0 00000100:00100000:0.0:1789997991.373905:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c774c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713095296:0@lo:400:kworker.0 00000100:00100000:1.0:1789997991.373977:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713094912 00000100:00100000:1.0:1789997991.373983:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713094912 00000100:00100000:1.0:1789997991.374060:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:1.0:1789997991.374069:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713094912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997991.374133:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713094912:12345-0@lo:400:kworker.0 Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997991.374139:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00100000:0.0:1789997991.374608:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713094912:0@lo:400:kworker.0 00000100:00080000:3.0:1789997991.375970:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789997991.375976:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789997991.375978:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789997991.691476:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997992.720167:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997993.246061:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997993.246113:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997993.246209:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704624512 00000100:00100000:0.0:1789997993.246218:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704624512 00000100:00100000:0.0:1789997993.246290:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1604 00000100:00100000:0.0:1789997993.246299:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704624512:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997993.246382:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2355:x1876946704624512:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 83us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997993.246389:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1604 00000100:00080000:1.0:1789997993.246941:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997993.247261:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997993.247298:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997993.247349:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704624384 00000100:00100000:0.0:1789997993.247355:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704624384 00000100:00100000:0.0:1789997993.247397:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1273 00000100:00100000:0.0:1789997993.247406:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704624384:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997993.247466:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704624384:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997993.247472:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1273 00000100:00100000:3.0:1789997993.256957:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704624768 00000100:00100000:1.0:1789997993.256957:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704624640 00000100:00100000:3.0:1789997993.256987:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704624768 00000100:00100000:1.0:1789997993.257039:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704624640 00000100:00100000:3.0:1789997993.257294:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1114 00000100:00100000:3.0:1789997993.257306:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704624768:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789997993.257400:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704624768:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 97us (11285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997993.257407:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1114 00000100:00100000:1.0:1789997993.257427:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1115 00000100:00100000:1.0:1789997993.257438:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704624640:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997993.257471:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704624640:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (10173us total) trans 0 rc 0/0 00000100:00080000:0.0:1789997993.257860:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789997993.257865:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997993.260941:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1115 00000100:00100000:0.0:1789997993.419019:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789997993.419022:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713095552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997993.419089:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997993.419852:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713095552 00000100:00100000:2.0:1789997993.419860:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713095552 00000100:00100000:2.0:1789997993.419930:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:2.0:1789997993.419939:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713095552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789997993.419971:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789997993.420022:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713095552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997993.420032:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00080000:1.0:1789997993.420132:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997993.420169:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713095552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789997993.420250:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713095424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789997993.420283:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997993.420372:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713095424 00000100:00100000:1.0:1789997993.420377:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713095424 00000100:00080000:0.0:1789997993.420459:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997993.421479:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1789997993.421491:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713095424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997993.421517:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997993.421577:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713095424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997993.421584:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:0.0:1789997993.421683:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713095424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789997993.738857:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997994.763580:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997995.787588:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997996.490953:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713095936:0@lo:400:kworker.0 00000100:00100000:2.0:1789997996.491052:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997996.491113:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789997996.491119:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713095808:0@lo:400:kworker.0 00000100:00100000:2.0:1789997996.491144:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789997996.491161:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713096320:0@lo:400:kworker.0 00000100:00100000:2.0:1789997996.491181:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997996.491746:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713095936 00000100:00100000:0.0:1789997996.491755:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713095936 00000100:00100000:0.0:1789997996.491816:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713095808 00000100:00100000:0.0:1789997996.491820:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713095808 00000100:00100000:0.0:1789997996.491837:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713096320 00000100:00100000:0.0:1789997996.491839:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713096320 00000100:00100000:0.0:1789997996.491858:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:0.0:1789997996.491867:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713095936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997996.491934:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713095936:12345-0@lo:400:kworker.0 Request processed in 67us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.491944:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:0.0:1789997996.491961:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:0.0:1789997996.491967:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713095808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997996.491994:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713095808:12345-0@lo:400:kworker.0 Request processed in 27us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.491999:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:0.0:1789997996.492010:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:0.0:1789997996.492016:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713096320:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789997996.492104:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997996.492165:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713095808:0@lo:400:kworker.0 00000100:00100000:2.0:1789997996.492177:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713095936:0@lo:400:kworker.0 00000100:00100000:0.0:1789997996.492410:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713096320:12345-0@lo:400:kworker.0 Request processed in 393us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.492417:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:3.0:1789997996.492984:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713096064:0@lo:400:kworker.0 00000100:00100000:3.0:1789997996.493051:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997996.493096:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789997996.493103:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713095680:0@lo:400:kworker.0 00000100:00100000:3.0:1789997996.493129:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789997996.493151:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713096192:0@lo:400:kworker.0 00000100:00100000:3.0:1789997996.493173:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997996.493286:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713096064 00000100:00100000:0.0:1789997996.493292:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713096064 00000100:00100000:0.0:1789997996.493334:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713096192 00000100:00100000:0.0:1789997996.493337:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713096192 00000100:00100000:0.0:1789997996.493359:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1789997996.493368:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7413c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713096064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997996.493411:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7413c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713096064:12345-0@lo:400:kworker.0 Request processed in 45us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.493417:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1789997996.493593:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1789997996.493600:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713096192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789997996.493629:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713096192:12345-0@lo:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.493634:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00080000:0.0:1789997996.493672:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789997996.493676:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789997996.493721:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713096192:0@lo:400:kworker.0 00000100:00100000:0.0:1789997996.493733:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713096064:0@lo:400:kworker.0 00000100:00100000:1.0:1789997996.494048:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713095680 00000100:00100000:1.0:1789997996.494054:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713095680 00000100:00100000:1.0:1789997996.494085:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1789997996.494093:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713095680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789997996.494147:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713095680:12345-0@lo:400:kworker.0 Request processed in 55us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997996.494155:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1789997996.494193:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713095680:0@lo:400:kworker.0 00000100:00100000:2.0:1789997996.496517:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713096320:0@lo:400:kworker.0 00000100:00100000:1.0:1789997996.511871:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997996.512084:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704624896 00000100:00100000:2.0:1789997996.512095:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704624896 00000100:00100000:2.0:1789997996.512231:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1220 00000100:00100000:2.0:1789997996.512242:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59842:x1876946704624896:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997996.512355:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59842:x1876946704624896:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 114us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997996.512363:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1220 00000100:00080000:0.0:1789997996.515676:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997996.518157:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997996.518254:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704625024 00000100:00100000:1.0:1789997996.518266:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704625024 00000100:00100000:1.0:1789997996.518346:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 655 00000100:00100000:1.0:1789997996.518357:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59842:x1876946704625024:12345-192.168.204.4@tcp:19:lfs.0 00000100:00080000:0.0:1789997996.518873:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997996.519778:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59842:x1876946704625024:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 1418us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997996.519788:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 655 00000100:00100000:1.0:1789997996.523012:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997996.523144:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704625152 00000100:00100000:0.0:1789997996.523153:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704625152 00000100:00100000:0.0:1789997996.523227:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 656 00000100:00100000:0.0:1789997996.523237:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59842:x1876946704625152:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997996.523646:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59842:x1876946704625152:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 408us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.523680:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 656 00000100:00080000:2.0:1789997996.525241:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789997996.527111:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997996.527208:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704625280 00000100:00100000:0.0:1789997996.527217:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704625280 00000100:00100000:0.0:1789997996.527286:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1221 00000100:00100000:0.0:1789997996.527296:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59842:x1876946704625280:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997996.528471:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59842:x1876946704625280:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 1172us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.528481:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1221 00000100:00100000:3.0:1789997996.533968:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997996.534099:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704625408 00000100:00100000:0.0:1789997996.534109:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704625408 00000100:00100000:0.0:1789997996.534171:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1222 00000100:00100000:0.0:1789997996.534182:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59842:x1876946704625408:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:0.0:1789997996.534291:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59842:x1876946704625408:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 110us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.534302:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1222 00000100:00100000:1.0:1789997996.536731:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997996.536798:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704625536 00000100:00100000:0.0:1789997996.536805:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704625536 00000100:00100000:0.0:1789997996.536899:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 657 00000100:00100000:0.0:1789997996.536907:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59842:x1876946704625536:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:0.0:1789997996.537173:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59842:x1876946704625536:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 266us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997996.537178:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 657 00000100:00100000:2.0:1789997996.539330:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997996.539439:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704625664 00000100:00100000:1.0:1789997996.539447:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704625664 00000100:00100000:1.0:1789997996.539498:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 658 00000100:00100000:1.0:1789997996.539507:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59842:x1876946704625664:12345-192.168.204.4@tcp:19:lfs.0 00000100:00100000:1.0:1789997996.539886:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59842:x1876946704625664:12345-192.168.204.4@tcp:19:lfs.0 Request processed in 379us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997996.539894:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 658 00000100:00100000:3.0:1789997996.543745:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997996.543803:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704625792 00000100:00100000:2.0:1789997996.543813:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704625792 00000100:00100000:2.0:1789997996.543888:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1223 00000100:00100000:2.0:1789997996.543899:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59842:x1876946704625792:12345-192.168.204.4@tcp:48:lfs.0 00000100:00100000:2.0:1789997996.544288:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59842:x1876946704625792:12345-192.168.204.4@tcp:48:lfs.0 Request processed in 389us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997996.544296:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1223 00010000:00010000:3.0:1789997996.810902:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789997997.547421:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997997.547479:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704625920 00000100:00100000:3.0:1789997997.547490:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704625920 00000100:00100000:3.0:1789997997.547556:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1224 00000100:00100000:3.0:1789997997.547568:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59856:x1876946704625920:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:3.0:1789997997.547588:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997997.547608:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf268 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.547701:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e70b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.547715:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.547730:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997997.547766:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:3.0:1789997997.547771:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997997.547791:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.547823:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf268 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.547842:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e70b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf268 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.547850:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:3.0:1789997997.547853:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789997997.547856:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789997997.548004:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59856:x1876946704625920:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 439us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997997.548011:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1224 00000100:00100000:1.0:1789997997.554208:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997997.554294:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704626176 00000100:00100000:3.0:1789997997.554306:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704626176 00000100:00100000:3.0:1789997997.554405:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1225 00000100:00100000:3.0:1789997997.554417:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59856:x1876946704626176:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:3.0:1789997997.554468:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789997997.554494:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e70b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf268 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.554516:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e6a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf253 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.554537:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:3.0:1789997997.554547:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789997997.554572:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.554586:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.554596:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789997997.591123:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967765 is committed 00000004:00010000:2.0:1789997997.591763:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1b578ba reply state 000000006f77f41b transno 4294967765 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997997.591778:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789997997.591794:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00080000:2.0:1789997997.591982:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789997997.592009:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59856:x1876946704626176:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 37590us (37804us total) trans 4294967765 rc 0/0 00000100:00100000:2.0:1789997997.592017:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1225 00010000:00010000:0.0:1789997997.592124:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.592134:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.592141:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.592147:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997997.592152:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.592159:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.592172:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49e300) 00010000:00010000:0.0:1789997997.592175:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997997.592179:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.592189:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ac00/0x65b43101d592e712 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997997.622154:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997997.622186:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704626304 00000100:00100000:3.0:1789997997.622195:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704626304 00000100:00100000:3.0:1789997997.622309:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1226 00000100:00100000:3.0:1789997997.622319:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59860:x1876946704626304:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997997.622341:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997997.622358:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf26f expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622418:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622432:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622443:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622456:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622462:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622469:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622756:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e72e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622765:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622771:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789997997.622790:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:3.0:1789997997.622793:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789997997.622809:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e72e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622825:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622837:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622844:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622850:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997997.622854:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622861:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622871:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789997997.622874:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997997.622878:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622885:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b800/0x65b43101d592e720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622896:0:12471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622902:0:12471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622908:0:12471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622913:0:12471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997997.622916:0:12471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622922:0:12471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622928:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38ee49e100) 00010000:00010000:3.0:1789997997.622930:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997997.622933:0:12471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622938:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052a200/0x65b43101d592e727 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622962:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf26f expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622974:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e72e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf26f expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.622981:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997997.622983:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789997997.622985:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052bc00, rc 0) 00000100:00100000:3.0:1789997997.623037:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59860:x1876946704626304:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 720us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789997997.623044:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1226 00000100:00100000:3.0:1789997997.628812:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997997.628848:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704626560 00000100:00100000:3.0:1789997997.628858:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704626560 00000100:00100000:3.0:1789997997.628905:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1227 00000100:00100000:3.0:1789997997.628915:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59860:x1876946704626560:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:3.0:1789997997.628934:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789997997.628952:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf276 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.629187:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.629201:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.629211:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.629237:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.629245:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.629251:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789997997.629955:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27:0x0], index 1: 0 00010000:00010000:3.0:1789997997.630202:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e74a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630214:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e74a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630236:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e74a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630271:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630277:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630283:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630289:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997997.630293:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630300:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630312:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:3.0:1789997997.630314:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789997997.630320:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630326:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e73c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789997997.630338:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000ec18e53 reply state 00000000d88ad610 transno 4294967766 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997997.630346:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789997997.630374:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf276 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630387:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e74a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf276 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997997.630394:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:3.0:1789997997.630396:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789997997.630399:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b200, rc 0) 00000100:00100000:3.0:1789997997.630461:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59860:x1876946704626560:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 1547us (1658us total) trans 4294967766 rc 0/0 00000100:00100000:3.0:1789997997.630469:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1227 00000100:00100000:1.0:1789997997.641866:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997997.641901:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704626816 00000100:00100000:1.0:1789997997.641909:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704626816 00000100:00100000:1.0:1789997997.641955:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1228 00000100:00100000:1.0:1789997997.641965:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59860:x1876946704626816:12345-192.168.204.4@tcp:36:touch.60003 00010000:00010000:1.0:1789997997.642015:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789997997.642040:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b200/0x65b43101d592e74a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf276 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.642058:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff8a38ee49ec00) 00010000:00010000:1.0:1789997997.642069:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997997.642108:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.642121:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.642131:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997997.642272:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093098ee8 reply state 00000000ce040784 transno 4294967767 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997997.642281:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997997.642361:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59860:x1876946704626816:12345-192.168.204.4@tcp:36:touch.60003 Request processed in 397us (501us total) trans 4294967767 rc 0/0 00000100:00100000:1.0:1789997997.642368:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1228 00010000:00010000:0.0:1789997997.645548:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.645564:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.645572:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.645578:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ba00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997997.645583:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.645592:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.645607:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38ee49e500) 00010000:00010000:0.0:1789997997.645610:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997997.645614:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.645621:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052ba00/0x65b43101d592e743 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650196:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650212:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650220:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650237:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789997997.650242:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650254:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650270:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:2.0:1789997997.650273:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997997.650277:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650284:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e758 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997997.650340:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997997.650391:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704626944 00000100:00100000:2.0:1789997997.650400:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704626944 00000100:00100000:2.0:1789997997.650520:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1229 00000100:00100000:2.0:1789997997.650532:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59860:x1876946704626944:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:2.0:1789997997.650553:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789997997.650568:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e75f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf27d expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650615:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e75f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf27d expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650626:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e75f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf27d expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.650641:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:2.0:1789997997.650644:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789997997.650647:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2e00, rc 0) 00000100:00100000:2.0:1789997997.650728:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59860:x1876946704626944:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 197us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997997.654135:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1229 00000100:00100000:0.0:1789997997.656076:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997997.656795:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704627072 00000100:00100000:1.0:1789997997.656805:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704627072 00000100:00100000:1.0:1789997997.656861:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 659 00000100:00100000:1.0:1789997997.656872:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704627072:12345-192.168.204.4@tcp:2:touch.60003 00000100:00100000:1.0:1789997997.657170:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704627072:12345-192.168.204.4@tcp:2:touch.60003 Request processed in 300us (1102us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789997997.657178:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 659 00000100:00100000:3.0:1789997997.667421:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997997.667517:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704627328 00000100:00100000:2.0:1789997997.667526:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704627328 00000100:00100000:3.0:1789997997.667689:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 124 00000100:00100000:3.0:1789997997.667700:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59860:x1876946704627328:12345-192.168.204.4@tcp:35:touch.60003 00000100:00100000:3.0:1789997997.668011:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59860:x1876946704627328:12345-192.168.204.4@tcp:35:touch.60003 Request processed in 312us (599us total) trans 4294967768 rc 0/0 00000100:00100000:3.0:1789997997.668019:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 124 00000100:00100000:3.0:1789997997.700969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997997.701065:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704627456 00000100:00100000:1.0:1789997997.701074:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704627456 00000100:00100000:1.0:1789997997.701124:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1230 00000100:00100000:1.0:1789997997.701132:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59864:x1876946704627456:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:1.0:1789997997.701155:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997997.701172:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e766 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf284 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701246:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701267:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701279:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701297:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701304:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701311:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701406:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e77b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701416:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e77b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701422:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e77b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997997.701453:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x65:0x0]: returning size 0 00000004:00200000:1.0:1789997997.701457:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997997.701475:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e77b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701486:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e77b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701495:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701501:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701508:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701514:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997997.701518:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701526:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701537:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:1.0:1789997997.701540:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997997.701544:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701551:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e76d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701563:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701573:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701578:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701582:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997997.701585:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701591:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701597:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38e062d400) 00010000:00010000:1.0:1789997997.701599:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997997.701602:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701607:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e774 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701634:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e766 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf284 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701648:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e77b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf284 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.701709:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:1.0:1789997997.701711:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997997.701714:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997997.701773:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59864:x1876946704627456:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 641us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997997.701780:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1230 00000100:00100000:1.0:1789997997.706819:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997997.706945:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704627584 00000100:00100000:0.0:1789997997.706956:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704627584 00000100:00100000:0.0:1789997997.707012:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 660 00000100:00100000:0.0:1789997997.707023:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2354:x1876946704627584:12345-192.168.204.4@tcp:101:rm.60003 00010000:00010000:0.0:1789997997.707043:0:8169:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997997.707064:0:8169:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf28b expref: -99 pid: 8169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789997997.707091:0:8169:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x6ab133ad, atime: 0x6ab133ad, ctime: 0x6ab133ad, blocks: 0x1 00010000:00010000:0.0:1789997997.707110:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=2186s v=(0 0) 00010000:00010000:0.0:1789997997.707114:0:8169:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997997.707123:0:8169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.707142:0:8169:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 7 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.707154:0:8169:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789997997.707294:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704627584:12345-192.168.204.4@tcp:101:rm.60003 Request processed in 272us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997997.707301:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 660 00000100:00100000:2.0:1789997997.715136:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997997.715296:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704627840 00000100:00100000:1.0:1789997997.715309:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704627840 00000100:00100000:1.0:1789997997.715369:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1231 00000100:00100000:1.0:1789997997.715380:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59864:x1876946704627840:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:1.0:1789997997.715432:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997997.715460:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e77b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf284 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715484:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38fb4b2e00/0x65b43101d592e75f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x65:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf27d expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715495:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff8a38d0bdf400) 00010000:00010000:1.0:1789997997.715506:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997997.715527:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715541:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715551:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715564:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715575:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715581:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715720:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715729:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.715735:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789997997.718750:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].39, 64 off10688 00000004:00080000:1.0:1789997997.718773:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2186411118527ns, next at 2187411114312ns, rc = 0 00010000:00010000:1.0:1789997997.718865:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718881:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718892:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718901:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718908:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718918:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718945:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789997997.718969:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718983:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718993:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.718999:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997997.719007:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.719014:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789997997.719015:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.719024:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719031:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:1.0:1789997997.719038:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789997997.719120:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719128:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e797 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.719146:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789997997.719150:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.719152:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719160:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719178:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.719186:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719186:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997997.719189:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719203:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.719206:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff8a38e062da00) 00010000:00010000:2.0:1789997997.719211:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789997997.719216:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719216:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:1.0:1789997997.719234:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789997997.719242:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e79e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719242:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997997.719258:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e789 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.719270:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1789997997.719272:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d348d881 reply state 00000000d899b3d0 transno 4294967769 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789997997.719273:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789997997.719276:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789997997.719288:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789997997.719381:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59864:x1876946704627840:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 3999us (4259us total) trans 4294967769 rc 0/0 00000100:00100000:1.0:1789997997.719390:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1231 00010000:00010000:0.0:1789997997.721333:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.721348:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.721355:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.721364:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997997.721368:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.721375:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.721389:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38e062d400) 00010000:00010000:0.0:1789997997.721392:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997997.721396:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.721402:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e790 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997997.835276:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789997998.359423:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997998.359484:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997998.359545:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704628224 00000100:00100000:0.0:1789997998.359566:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704628224 00000100:00100000:0.0:1789997998.359649:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1118 00000100:00100000:0.0:1789997998.359683:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704628224:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789997998.359756:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704628224:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997998.359764:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1118 00000100:00100000:1.0:1789997998.359957:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704627968 00000100:00100000:1.0:1789997998.359962:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704627968 00000100:00100000:1.0:1789997998.359999:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1275 00000100:00100000:1.0:1789997998.360006:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704627968:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997998.360043:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704627968:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997998.360049:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1275 00000100:00080000:3.0:1789997998.360217:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789997998.368155:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997998.368200:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997998.368243:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704628352 00000100:00100000:2.0:1789997998.368253:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704628352 00000100:00100000:2.0:1789997998.368315:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1119 00000100:00100000:2.0:1789997998.368325:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704628352:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789997998.368395:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704628352:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997998.368404:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1119 00000100:00080000:2.0:1789997998.368532:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789997998.368590:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704628096 00000100:00100000:1.0:1789997998.368595:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704628096 00000100:00100000:1.0:1789997998.368641:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1608 00000100:00100000:1.0:1789997998.368650:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:2352:x1876946704628096:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789997998.368723:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:2352:x1876946704628096:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 75us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997998.368730:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1608 00000100:00080000:2.0:1789997998.369277:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789997998.487866:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997998.491849:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704628480 00000100:00100000:1.0:1789997998.491867:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704628480 00000100:00100000:1.0:1789997998.491974:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1232 00000100:00100000:1.0:1789997998.491986:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59879:x1876946704628480:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997998.492006:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997998.492025:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e7a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf292 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.492089:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e7ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.492104:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.492118:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997998.492154:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:1.0:1789997998.492158:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997998.492177:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.492201:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e7a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf292 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.492227:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf292 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.492235:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:1.0:1789997998.492238:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997998.492241:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789997998.492314:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59879:x1876946704628480:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 330us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997998.492321:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1232 00000100:00100000:1.0:1789997998.501131:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997998.501170:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704628736 00000100:00100000:1.0:1789997998.501179:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704628736 00000100:00100000:1.0:1789997998.501245:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1233 00000100:00100000:1.0:1789997998.501257:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+12:59879:x1876946704628736:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997998.501308:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997998.501335:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3e00/0x65b43101d592e7ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf292 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.501359:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052bc00/0x65b43101d592e72e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf26f expref: 11 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.501378:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38ee49e600) 00010000:00010000:1.0:1789997998.501389:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997998.501413:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.501427:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.501501:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789997998.537988:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967770 is committed 00000004:00080000:0.0:1789997998.538005:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 110 committed 00000100:00100000:0.0:1789997998.538134:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713096448:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789997998.538198:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1789997998.538381:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016f22a3a reply state 00000000e84e6424 transno 4294967770 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997998.538394:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997998.538407:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00080000:1.0:1789997998.538502:0:11799:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789997998.538523:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59879:x1876946704628736:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 37267us (37400us total) trans 4294967770 rc 0/0 00000100:00100000:1.0:1789997998.538532:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1233 00000100:00100000:1.0:1789997998.538561:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713096448 00000100:00100000:1.0:1789997998.538568:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713096448 00000100:00100000:1.0:1789997998.538610:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1789997998.538620:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713096448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789997998.538643:0:6656:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:39 count 1 00010000:00010000:1.0:1789997998.538685:0:6656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.538703:0:6656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.538712:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789997998.538716:0:6656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997998.538720:0:6656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.538748:0:6656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 6 pid: 8169 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.538762:0:6656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 6 pid: 8169 timeout: 2287 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997998.538773:0:6656:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946713096576:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789997998.538810:0:6656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3581300 going to sleep for 11 seconds 00000100:00080000:1.0:1789997998.538822:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789997998.539294:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.539304:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.539311:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.539317:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997998.539321:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.539328:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.539344:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:0.0:1789997998.539347:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789997998.539352:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.539358:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e7b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997998.539902:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713096704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997998.539941:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789997998.539976:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713096704 00000100:00100000:1.0:1789997998.539981:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713096704 00000100:00100000:1.0:1789997998.540009:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1789997998.540016:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713096704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789997998.540040:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789997998.540073:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1876946713096704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997998.540080:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:1.0:1789997998.540114:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713096704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789997998.540268:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713096832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789997998.540292:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789997998.540347:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713096832 00000100:00100000:0.0:1789997998.540351:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713096832 00000100:00100000:0.0:1789997998.540383:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1789997998.540389:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713096832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789997998.540407:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789997998.540446:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c774ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713096832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997998.540452:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00080000:1.0:1789997998.540536:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789997998.540556:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713096832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789997998.551338:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997998.551454:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704628864 00000100:00100000:0.0:1789997998.551493:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704628864 00010000:00010000:0.0:1789997998.551585:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 7 pid: 8169 timeout: 2287 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997998.551628:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 447 00000100:00100000:0.0:1789997998.551639:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704628864:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789997998.551671:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789997998.551678:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 7 pid: 8169 timeout: 2287 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.551691:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 7 pid: 8169 timeout: 2287 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.551722:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997998.551726:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789997998.551731:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.551741:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.551761:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789997998.551864:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704628864:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 227us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997998.551885:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 447 00010000:00010000:0.0:1789997998.552020:0:6656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000884bcb53/0x65b43101d592e782 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf28b expref: 6 pid: 8169 timeout: 2287 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789997998.552051:0:6656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6656:1876946713096576:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789997998.552087:0:6656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.552112:0:6656:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.552140:0:6656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.552165:0:6656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.552174:0:6656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.552239:0:6656:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789997998.552935:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1876946713096448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14299us (14719us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789997998.552959:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00010000:00010000:0.0:1789997998.553014:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789997998.553020:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.553046:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789997998.553050:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.553061:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.553089:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.553096:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a83402/0x65b43101d592e7ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997998.553127:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997998.553129:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789997998.553130:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789997998.553235:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a38fb3bc700/2, rc 0, transno 4294967375 00000100:00100000:0.0:1789997998.553243:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713096448:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789997998.604725:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997998.605157:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704628992 00000100:00100000:1.0:1789997998.605169:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704628992 00000100:00100000:1.0:1789997998.605237:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1234 00000100:00100000:1.0:1789997998.605248:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59883:x1876946704628992:12345-192.168.204.4@tcp:101:touch.60003 00010000:00010000:1.0:1789997998.605272:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997998.605292:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e7c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf299 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605352:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605368:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605392:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605406:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605413:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605420:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605762:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e7d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605773:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605782:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997998.605805:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:1.0:1789997998.605809:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997998.605828:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e7d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605839:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605846:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605853:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605859:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997998.605863:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605870:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605882:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:1.0:1789997998.605886:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997998.605891:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605897:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605907:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605913:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605919:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605924:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997998.605927:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605933:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605939:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38e062d900) 00010000:00010000:1.0:1789997998.605942:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997998.605945:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605950:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e7cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605977:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2600/0x65b43101d592e7c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf299 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.605995:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e7d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf299 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997998.606003:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997998.606005:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789997998.606007:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3c00, rc 0) 00000100:00100000:1.0:1789997998.606074:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59883:x1876946704628992:12345-192.168.204.4@tcp:101:touch.60003 Request processed in 828us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997998.606082:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1234 00010000:00010000:2.0:1789997998.858901:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789997999.355036:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997999.355111:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704629120 00000100:00100000:1.0:1789997999.355122:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704629120 00000100:00100000:1.0:1789997999.355178:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1235 00000100:00100000:1.0:1789997999.355199:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59897:x1876946704629120:12345-192.168.204.4@tcp:101:chmod.0 00010000:00010000:1.0:1789997999.355219:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997999.355238:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2a0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.355296:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e7e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.355309:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.355321:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789997999.355353:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:1.0:1789997999.355358:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789997999.355375:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.355398:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e7dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2a0 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.355415:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2a0 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.355424:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997999.355427:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789997999.355431:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789997999.355490:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59897:x1876946704629120:12345-192.168.204.4@tcp:101:chmod.0 Request processed in 303us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997999.355497:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1235 00000100:00100000:2.0:1789997999.362070:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997999.362138:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704629376 00000100:00100000:1.0:1789997999.362149:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704629376 00000100:00100000:1.0:1789997999.362215:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1236 00000100:00100000:1.0:1789997999.362226:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59897:x1876946704629376:12345-192.168.204.4@tcp:36:chmod.0 00010000:00010000:1.0:1789997999.362277:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789997999.362302:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e7e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2a0 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.362322:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e7d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf299 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.362334:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789997999.362345:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789997999.362368:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.362381:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.362390:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997999.362768:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d1191b7 reply state 00000000a9fc8b5d transno 4294967771 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997999.362778:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789997999.362787:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000100:00100000:1.0:1789997999.362872:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59897:x1876946704629376:12345-192.168.204.4@tcp:36:chmod.0 Request processed in 647us (810us total) trans 4294967771 rc 0/0 00000100:00100000:1.0:1789997999.362879:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1236 00010000:00010000:3.0:1789997999.371538:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997999.371556:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997999.371568:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997999.371574:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2800 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:3.0:1789997999.371579:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997999.371586:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997999.371601:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38e062d900) 00010000:00010000:3.0:1789997999.371605:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789997999.371610:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789997999.371615:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2800/0x65b43101d592e7eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789997999.472234:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997999.472346:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704629504 00000100:00100000:1.0:1789997999.472357:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704629504 00000100:00100000:1.0:1789997999.472428:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1237 00000100:00100000:1.0:1789997999.472439:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59909:x1876946704629504:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997999.472546:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59909:x1876946704629504:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 107us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997999.472554:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1237 00000100:00100000:2.0:1789997999.474370:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997999.474576:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704629632 00000100:00100000:0.0:1789997999.474584:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704629632 00000100:00100000:0.0:1789997999.474773:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 662 00000100:00100000:0.0:1789997999.474784:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59909:x1876946704629632:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997999.475172:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59909:x1876946704629632:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 389us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997999.475183:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 662 00000100:00100000:3.0:1789997999.477866:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997999.477973:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704629760 00000100:00100000:2.0:1789997999.477982:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704629760 00000100:00100000:2.0:1789997999.478049:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 663 00000100:00100000:2.0:1789997999.478059:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59909:x1876946704629760:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789997999.478443:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59909:x1876946704629760:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 384us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997999.478451:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 663 00000100:00100000:3.0:1789997999.481858:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997999.481969:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704629888 00000100:00100000:1.0:1789997999.481979:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704629888 00000100:00100000:1.0:1789997999.482042:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1238 00000100:00100000:1.0:1789997999.482052:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59909:x1876946704629888:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997999.482896:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59909:x1876946704629888:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 843us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997999.482905:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1238 00000100:00100000:3.0:1789997999.486860:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997999.487048:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704630016 00000100:00100000:1.0:1789997999.487059:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704630016 00000100:00100000:1.0:1789997999.487118:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1239 00000100:00100000:1.0:1789997999.487129:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59909:x1876946704630016:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789997999.487280:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59909:x1876946704630016:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 152us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997999.487288:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1239 00000100:00100000:3.0:1789997999.492753:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997999.493160:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704630144 00000100:00100000:0.0:1789997999.493171:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704630144 00000100:00100000:0.0:1789997999.493243:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 664 00000100:00100000:0.0:1789997999.493255:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59909:x1876946704630144:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997999.493649:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fad04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59909:x1876946704630144:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 396us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997999.493693:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 664 00000100:00100000:3.0:1789997999.495707:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997999.495770:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704630272 00000100:00100000:0.0:1789997999.495779:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704630272 00000100:00100000:0.0:1789997999.495847:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 665 00000100:00100000:0.0:1789997999.495857:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59909:x1876946704630272:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:0.0:1789997999.496204:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59909:x1876946704630272:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 349us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997999.496211:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 665 00000100:00100000:3.0:1789997999.497925:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997999.499083:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704630400 00000100:00100000:0.0:1789997999.499097:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704630400 00000100:00100000:0.0:1789997999.499251:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1240 00000100:00100000:0.0:1789997999.499263:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59909:x1876946704630400:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:0.0:1789997999.499729:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59909:x1876946704630400:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 466us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997999.499738:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1240 00000100:00100000:3.0:1789997999.543763:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789997999.543953:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704630528 00000100:00100000:0.0:1789997999.543964:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704630528 00000100:00100000:0.0:1789997999.544072:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1241 00000100:00100000:0.0:1789997999.544084:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:59913:x1876946704630528:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:0.0:1789997999.544108:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789997999.544130:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e7f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2a7 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544216:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544239:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544251:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544266:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544273:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544280:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544578:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544588:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544595:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789997999.544619:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:0.0:1789997999.544624:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789997999.544643:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544683:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544690:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544698:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544704:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997999.544708:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.544715:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545639:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:0.0:1789997999.545643:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997999.545650:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545697:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e7f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545903:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545915:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545921:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545925:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997999.545929:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545935:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545943:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38c28e9b00) 00010000:00010000:0.0:1789997999.545946:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997999.545949:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545955:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1600/0x65b43101d592e800 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.545994:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0c00/0x65b43101d592e7f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2a7 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.546012:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2a7 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.546019:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789997999.546022:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789997999.546025:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789997999.546160:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa89b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59913:x1876946704630528:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 2077us (2406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997999.546175:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1241 00000100:00100000:3.0:1789997999.550083:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997999.550319:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704630784 00000100:00100000:1.0:1789997999.550329:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704630784 00000100:00100000:1.0:1789997999.550391:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1242 00000100:00100000:1.0:1789997999.550991:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59913:x1876946704630784:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789997999.551013:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997999.551034:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e80e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2ae expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.551303:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.551318:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.551329:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.551343:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.551349:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.551355:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789997999.553237:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27:0x0], index 0: 0 00010000:00010000:1.0:1789997999.553563:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e823 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553579:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553590:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553623:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553630:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553636:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553642:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789997999.553647:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553866:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553883:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:1.0:1789997999.553885:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789997999.553890:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553896:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e815 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789997999.553910:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4bc784d reply state 0000000084cf9e00 transno 4294967772 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789997999.553918:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789997999.553951:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e80e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2ae expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553965:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2ae expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.553972:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789997999.553974:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789997999.553976:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3800, rc 0) 00000100:00100000:1.0:1789997999.554119:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fa898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+11:59913:x1876946704630784:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 3718us (4044us total) trans 4294967772 rc 0/0 00000100:00100000:1.0:1789997999.554128:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1242 00010000:00010000:0.0:1789997999.559094:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.559111:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.559119:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.559126:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789997999.559130:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.559137:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.559153:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38e062dc00) 00010000:00010000:0.0:1789997999.559157:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789997999.559161:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789997999.559168:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e81c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789997999.559580:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789997999.559649:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704630912 00000100:00100000:1.0:1789997999.559680:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704630912 00000100:00100000:1.0:1789997999.559730:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 666 00000100:00100000:1.0:1789997999.559739:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:59913:x1876946704630912:12345-192.168.204.4@tcp:101:dd.60003 00010000:00010000:1.0:1789997999.559756:0:99743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789997999.559773:0:99743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2b5 expref: -99 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789997999.559808:0:99743:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789997999.559829:0:99743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=2188s v=(0 0) 00010000:00010000:1.0:1789997999.559833:0:99743:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789997999.559845:0:99743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 6 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.559862:0:99743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 6 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789997999.559873:0:99743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2800, rc 0) 00000100:00100000:1.0:1789997999.559933:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:59913:x1876946704630912:12345-192.168.204.4@tcp:101:dd.60003 Request processed in 195us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789997999.559940:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 666 00000100:00100000:2.0:1789997999.578900:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997999.578990:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704631040 00000100:00100000:3.0:1789997999.579002:0:6663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704631040 00002000:00100000:3.0:1789997999.579052:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x27:0x0] (0->1048575) req@ffff8a38ffdcbb80 x1876946704631040/t0(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:220/0 lens 488/0 e 0 to 0 dl 1789998010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1789997999.579063:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38ffdcbb80 with x1876946704631040 ext(0->1048575) 00002000:00010000:3.0:1789997999.579069:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38ffdcbb80 00000100:00100000:3.0:1789997999.579104:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 31 00000100:00100000:3.0:1789997999.579113:0:6663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2353:x1876946704631040:12345-192.168.204.4@tcp:4:dd.60003 00000100:00100000:0.0:1789997999.597384:0:6663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2353:x1876946704631040:12345-192.168.204.4@tcp:4:dd.60003 Request processed in 18259us (18481us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789997999.597397:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 31 00002000:00100000:0.0:1789997999.597412:0:6663:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x27:0x0] (0->1048575) req@ffff8a38ffdcbb80 x1876946704631040/t4294967374(0) o4->dca90b7a-8ebc-4a6c-9659-0ee79e2da878@192.168.204.4@tcp:220/0 lens 488/448 e 0 to 0 dl 1789998010 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1789997999.597422:0:6663:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a38ffdcbb80 with x1876946704631040 ext(0->1048575) 00002000:00010000:0.0:1789997999.597428:0:6663:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8a38ffdcbb80 00000100:00100000:3.0:1789997999.600642:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997999.600961:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704631168 00000100:00100000:2.0:1789997999.600971:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704631168 00000100:00100000:2.0:1789997999.601073:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1243 00000100:00100000:2.0:1789997999.601085:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:59913:x1876946704631168:12345-192.168.204.4@tcp:44:dd.60003 00000001:00080000:2.0:1789997999.642503:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967772 is committed 00000100:00100000:0.0:1789997999.642759:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59913:x1876946704631168:12345-192.168.204.4@tcp:44:dd.60003 Request processed in 41671us (42124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789997999.642772:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1243 00000100:00100000:0.0:1789997999.644787:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789997999.644924:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704631296 00000100:00100000:2.0:1789997999.644934:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704631296 00000100:00100000:2.0:1789997999.644986:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 667 00000100:00100000:2.0:1789997999.644996:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2352:x1876946704631296:12345-192.168.204.4@tcp:16:dd.60003 00000100:00100000:2.0:1789997999.689645:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2352:x1876946704631296:12345-192.168.204.4@tcp:16:dd.60003 Request processed in 44638us (44855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789997999.689680:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 667 00000001:00080000:3.0:1789997999.689824:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00000100:00100000:2.0:1789997999.694811:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789997999.694970:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704631552 00000100:00100000:3.0:1789997999.694981:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704631552 00000100:00100000:3.0:1789997999.695043:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 125 00000100:00100000:3.0:1789997999.695053:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:59913:x1876946704631552:12345-192.168.204.4@tcp:35:dd.60003 00000100:00100000:3.0:1789997999.695526:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:59913:x1876946704631552:12345-192.168.204.4@tcp:35:dd.60003 Request processed in 473us (725us total) trans 4294967773 rc 0/0 00000100:00100000:3.0:1789997999.695535:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 125 00010000:00010000:0.0:1789997999.885035:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789998000.614077:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967773 is committed 00000001:00080000:0.0:1789998000.619069:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967375 is committed 00000001:00080000:0.0:1789998000.619088:0:7614:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967374 is committed 00010000:00010000:0.0:1789998000.906949:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789998001.583889:0:101756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2190276232343ns, next at 2170113095164ns, rc = 0 00000004:00080000:2.0:1789998001.584132:0:101756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2190276477653ns, next at 2187411114312ns, rc = 0 00000004:00080000:3.0:1789998001.589758:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 109 committed 00000004:00080000:3.0:1789998001.592210:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 111 committed 00000100:00100000:2.0:1789998001.611187:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713096960:0@lo:400:kworker.0 00000100:00100000:2.0:1789998001.611273:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998001.611333:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713097472:0@lo:400:kworker.0 00000100:00100000:2.0:1789998001.611362:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998001.611392:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789998001.611399:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713097088:0@lo:400:kworker.0 00000100:00100000:2.0:1789998001.611424:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998001.611441:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713097600:0@lo:400:kworker.0 00000100:00100000:2.0:1789998001.611462:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998001.611490:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713097472 00000100:00100000:2.0:1789998001.611498:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713097472 00000100:00100000:0.0:1789998001.611540:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713096960 00000100:00100000:0.0:1789998001.611546:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713096960 00000100:00100000:2.0:1789998001.611551:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1789998001.611563:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713097472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998001.611584:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1789998001.611593:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713096960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998001.611620:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713097472:12345-0@lo:400:kworker.0 Request processed in 59us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998001.611632:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1789998001.611641:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713096960:12345-0@lo:400:kworker.0 Request processed in 50us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998001.611649:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1789998001.611700:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000100:00100000:0.0:1789998001.611704:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713097088 00000004:00080000:2.0:1789998001.611706:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a38fb3bc700, transno 4294967375 00000100:00100000:0.0:1789998001.611710:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713097088 00000100:00100000:2.0:1789998001.611723:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713097472:0@lo:400:kworker.0 00000100:00100000:2.0:1789998001.611737:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713096960:0@lo:400:kworker.0 00000100:00100000:0.0:1789998001.611744:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713097600 00000100:00100000:0.0:1789998001.611748:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713097600 00000100:00100000:0.0:1789998001.611779:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1789998001.611787:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713097088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998001.611791:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:2.0:1789998001.611803:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713097600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998001.611845:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713097600:12345-0@lo:400:kworker.0 Request processed in 46us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998001.611852:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:0.0:1789998001.611907:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713097088:12345-0@lo:400:kworker.0 Request processed in 46us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998001.611918:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:3.0:1789998001.612032:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713097216:0@lo:400:kworker.0 00000100:00100000:3.0:1789998001.612066:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998001.612106:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789998001.612112:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713097344:0@lo:400:kworker.0 00000100:00100000:3.0:1789998001.612137:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998001.612333:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fadf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713097088:0@lo:400:kworker.0 00000100:00100000:0.0:1789998001.612335:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713097344 00000100:00100000:0.0:1789998001.612342:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713097344 00000100:00100000:3.0:1789998001.612346:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713097600:0@lo:400:kworker.0 00000100:00100000:0.0:1789998001.612376:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:0.0:1789998001.612385:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713097344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998001.612451:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713097216 00000100:00100000:1.0:1789998001.612456:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713097216 00000100:00100000:1.0:1789998001.612484:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:1.0:1789998001.612492:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713097216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998001.613578:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713097344:12345-0@lo:400:kworker.0 Request processed in 1190us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998001.613587:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1789998001.618338:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713097216:12345-0@lo:400:kworker.0 Request processed in 5837us (6262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998001.618353:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00080000:1.0:1789998001.618398:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789998001.618404:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789998001.618407:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789998001.618694:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713097344:0@lo:400:kworker.0 00000100:00100000:3.0:1789998001.618709:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713097216:0@lo:400:kworker.0 00010000:00010000:2.0:1789998001.930947:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998002.589594:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998002.589826:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704631680 00000100:00100000:3.0:1789998002.589837:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704631680 00000100:00100000:3.0:1789998002.589908:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1244 00000100:00100000:3.0:1789998002.589921:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60106:x1876946704631680:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789998002.590016:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60106:x1876946704631680:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 99us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998002.590023:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1244 00000100:00080000:1.0:1789998002.590187:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998002.600312:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998002.607396:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704631808 00000100:00100000:3.0:1789998002.607411:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704631808 00000100:00100000:3.0:1789998002.607504:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 668 00000100:00100000:3.0:1789998002.607517:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:60106:x1876946704631808:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789998002.607885:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:60106:x1876946704631808:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 370us (7582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998002.607893:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 668 00000100:00080000:1.0:1789998002.608081:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998002.612565:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998002.612631:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704631936 00000100:00100000:3.0:1789998002.612641:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704631936 00000100:00100000:3.0:1789998002.612736:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 669 00000100:00100000:3.0:1789998002.612747:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60106:x1876946704631936:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:3.0:1789998002.613099:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60106:x1876946704631936:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 352us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998002.613107:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 669 00000100:00080000:3.0:1789998002.613182:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789998002.617631:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998002.626592:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704632064 00000100:00100000:1.0:1789998002.626607:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704632064 00000100:00100000:1.0:1789998002.627330:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1245 00000100:00100000:1.0:1789998002.627341:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60106:x1876946704632064:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789998002.627705:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60106:x1876946704632064:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 365us (10081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998002.627715:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1245 00000100:00100000:0.0:1789998002.634084:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998002.634522:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704632192 00000100:00100000:1.0:1789998002.634532:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704632192 00000100:00100000:1.0:1789998002.634591:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1246 00000100:00100000:1.0:1789998002.634601:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60106:x1876946704632192:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789998002.634728:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60106:x1876946704632192:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 128us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998002.634811:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1246 00000100:00100000:1.0:1789998002.636171:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998002.636200:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704632320 00000100:00100000:1.0:1789998002.636207:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704632320 00000100:00100000:1.0:1789998002.636257:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 670 00000100:00100000:1.0:1789998002.636267:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:60106:x1876946704632320:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789998002.637488:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:60106:x1876946704632320:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 1220us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998002.637498:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 670 00000100:00100000:0.0:1789998002.641617:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998002.641959:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704632448 00000100:00100000:1.0:1789998002.641969:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704632448 00000100:00100000:1.0:1789998002.642015:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 671 00000100:00100000:1.0:1789998002.642026:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60106:x1876946704632448:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789998002.642579:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60106:x1876946704632448:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 552us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998002.642585:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 671 00000100:00100000:0.0:1789998002.645005:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998002.645614:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704632576 00000100:00100000:3.0:1789998002.645623:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704632576 00000100:00100000:3.0:1789998002.645697:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1247 00000100:00100000:3.0:1789998002.645708:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60106:x1876946704632576:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789998002.646762:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60106:x1876946704632576:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 1052us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998002.646772:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1247 00000100:00100000:0.0:1789998002.708406:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998002.708506:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704632832 00000100:00100000:1.0:1789998002.708516:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704632832 00000100:00100000:1.0:1789998002.708605:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1248 00000100:00100000:1.0:1789998002.708616:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60110:x1876946704632832:12345-192.168.204.4@tcp:36:rm.60003 00010000:00010000:1.0:1789998002.708702:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998002.708730:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3800/0x65b43101d592e823 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x66:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2ae expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.708752:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff8a38e062d300) 00010000:00010000:1.0:1789998002.708762:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789998002.708782:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.708795:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.708811:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.708825:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.708837:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.708844:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.709160:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.709169:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.709176:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789998002.710574:0:11799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].39, 64 off10688 00000004:00080000:1.0:1789998002.710586:0:11799:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2191402930888ns, next at 2192402928580ns, rc = 0 00010000:00010000:1.0:1789998002.710798:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710812:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710822:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710831:0:11799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710837:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710848:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710872:0:11799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789998002.710893:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710899:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710905:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710911:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789998002.710915:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710922:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710932:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:1.0:1789998002.710935:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789998002.710940:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710947:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592e846 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x66:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710963:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710973:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710978:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.710983:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:2.0:1789998002.711061:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998002.711068:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998002.711074:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998002.711078:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998002.711085:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998002.711094:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x66:0x0].0x0 (ffff8a38e062de00) 00010000:00010000:2.0:1789998002.711096:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789998002.711099:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998002.711109:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3a00/0x65b43101d592e84d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x66:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998002.711136:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998002.711138:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998002.711139:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998002.711159:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.711167:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.711175:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:1.0:1789998002.711177:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789998002.711180:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.711250:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3400/0x65b43101d592e838 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789998002.711262:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af413d14 reply state 00000000029f51a8 transno 4294967774 ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998002.711270:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789998002.711396:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:60110:x1876946704632832:12345-192.168.204.4@tcp:36:rm.60003 Request processed in 2779us (2996us total) trans 4294967774 rc 0/0 00000100:00100000:1.0:1789998002.711405:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1248 00010000:00010000:1.0:1789998002.713913:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.713932:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.713939:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.713945:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789998002.713949:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.713956:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.713969:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x7c633847 (ffff8a38e062d900) 00010000:00010000:1.0:1789998002.713972:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789998002.713976:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998002.713982:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3c00/0x65b43101d592e83f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998002.959809:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998003.482876:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998003.482923:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998003.482959:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998003.482992:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998003.483026:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704633216 00000100:00100000:1.0:1789998003.483031:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704632960 00000100:00100000:0.0:1789998003.483036:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704633216 00000100:00100000:1.0:1789998003.483039:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704632960 00000100:00100000:0.0:1789998003.483092:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704633344 00000100:00100000:0.0:1789998003.483097:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704633344 00000100:00100000:1.0:1789998003.483099:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1277 00000100:00100000:1.0:1789998003.483125:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704632960:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998003.483140:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1122 00000100:00100000:0.0:1789998003.483150:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704633216:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998003.483209:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2355:x1876946704632960:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998003.483216:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1277 00000100:00100000:1.0:1789998003.483253:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1123 00000100:00100000:1.0:1789998003.483262:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704633344:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998003.483859:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704633216:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 708us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998003.483867:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1122 00000100:00100000:0.0:1789998003.483891:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704633088 00000100:00100000:0.0:1789998003.483896:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704633088 00000100:00100000:0.0:1789998003.483977:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1612 00000100:00100000:0.0:1789998003.483984:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704633088:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998003.484021:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704633088:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 38us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998003.484028:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1612 00000100:00100000:1.0:1789998003.484280:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704633344:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1018us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998003.484287:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1123 00000100:00100000:0.0:1789998003.662613:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789998003.662645:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713097728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998003.662729:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998003.663138:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789998003.663148:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713097856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789998003.663177:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998003.663336:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713097728 00000100:00100000:0.0:1789998003.663344:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713097728 00000100:00100000:0.0:1789998003.663390:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713097856 00000100:00100000:0.0:1789998003.663392:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713097856 00000100:00100000:0.0:1789998003.663407:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1789998003.663414:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713097728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998003.663444:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1789998003.663493:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9b46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713097728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998003.663500:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:0.0:1789998003.663516:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1789998003.663522:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713097856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998003.663539:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998003.663566:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713097856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998003.663571:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00100000:0.0:1789998003.663615:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6067b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713097728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789998003.663763:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789998003.663768:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998003.667157:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713097856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789998003.978868:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789998004.241467:0:101901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2192933809823ns, next at 2192402928580ns, rc = 0 00000001:00080000:1.0:1789998004.303757:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967774 is committed 00000004:00080000:1.0:1789998004.303770:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 110 committed 00000100:00100000:1.0:1789998004.303898:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713097984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789998004.303979:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789998004.307626:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 111 committed 00000100:00100000:1.0:1789998004.307780:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713097984 00000100:00100000:1.0:1789998004.307791:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713097984 00000100:00100000:1.0:1789998004.307894:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1789998004.307917:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713097984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789998004.307949:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:39 count 1 00010000:00010000:1.0:1789998004.307974:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998004.307994:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 5 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998004.309857:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x27:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1789998004.309862:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789998004.309869:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998004.309938:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 5 pid: 99743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998004.309955:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 5 pid: 99743 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998004.309972:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1876946713098112:192.168.204.4@tcp:104: 00000100:00100000:1.0:1789998004.310763:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789998004.317650:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6659:1876946713098112:192.168.204.4@tcp:104: 00010000:00010000:1.0:1789998004.317721:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998004.319197:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998004.319466:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704633472 00000100:00100000:3.0:1789998004.319475:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704633472 00010000:00010000:3.0:1789998004.319536:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 6 pid: 99743 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998004.319577:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 448 00000100:00100000:3.0:1789998004.319587:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2355:x1876946704633472:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789998004.319600:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998004.319607:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 6 pid: 99743 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998004.319620:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 6 pid: 99743 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998004.319645:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011946b2a/0x65b43101d592e831 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2b5 expref: 6 pid: 99743 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998004.319688:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789998004.319692:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789998004.319698:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998004.319708:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998004.319743:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998004.319789:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704633472:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 203us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998004.319797:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 448 00000100:00080000:1.0:1789998004.320444:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789998004.320502:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998004.320513:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998004.320523:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998004.320531:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998004.320555:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789998004.321857:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713097984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13948us (17873us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789998004.321866:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00010000:00010000:2.0:1789998004.322012:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998004.322020:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998004.322030:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998004.322035:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998004.322045:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998004.322063:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998004.322071:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9312c0/0x65b43101d592e854 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998004.322089:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998004.322111:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998004.322114:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789998004.322377:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a37c6ecdf80/2, rc 0, transno 4294967375 00000100:00100000:1.0:1789998004.322395:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713097984:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789998004.322608:0:101901:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2193014952986ns, next at 2187411114312ns, rc = 0 00000004:00080000:2.0:1789998004.329691:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 112 committed 00010000:00010000:0.0:1789998005.002767:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998006.026874:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998006.731028:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713098496:0@lo:400:kworker.0 00000100:00100000:1.0:1789998006.731066:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713098368:0@lo:400:kworker.0 00000100:00100000:1.0:1789998006.731142:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998006.731183:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713098624:0@lo:400:kworker.0 00000100:00100000:1.0:1789998006.731221:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38d00f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713098880:0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.731224:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998006.731254:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998006.731259:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789998006.731268:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713098240:0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.731297:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998006.731337:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713098752:0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.731356:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998006.731384:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713098624 00000100:00100000:2.0:1789998006.731391:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713098624 00000100:00100000:2.0:1789998006.731445:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713098752 00000100:00100000:2.0:1789998006.731449:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713098752 00000100:00100000:1.0:1789998006.731458:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713098240 00000100:00100000:1.0:1789998006.731472:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713098240 00000100:00100000:2.0:1789998006.731477:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1789998006.731490:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713098624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998006.731508:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1789998006.731517:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713098240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998006.731647:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713098368 00000100:00100000:3.0:1789998006.731679:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713098368 00000100:00100000:3.0:1789998006.731704:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713098880 00000100:00100000:3.0:1789998006.731707:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713098880 00000100:00100000:3.0:1789998006.731729:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:3.0:1789998006.731735:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713098368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998006.731833:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:0.0:1789998006.731841:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713098880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.732945:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3284:x1876946713098624:12345-0@lo:400:kworker.0 Request processed in 1454us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998006.732956:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1789998006.732986:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1789998006.732999:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713098752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998006.732999:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713098240:12345-0@lo:400:kworker.0 Request processed in 1481us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998006.733014:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1789998006.733067:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713098752:12345-0@lo:400:kworker.0 Request processed in 74us (1709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998006.733074:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00080000:2.0:1789998006.733104:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789998006.733109:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789998006.733112:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998006.733149:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713098240:0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.733163:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713098752:0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.733175:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713098624:0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.733242:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998006.733303:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713098496 00000100:00100000:2.0:1789998006.733309:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713098496 00000100:00100000:2.0:1789998006.733999:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:2.0:1789998006.734007:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713098496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.734067:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713098496:12345-0@lo:400:kworker.0 Request processed in 61us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998006.734073:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00080000:2.0:1789998006.734182:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998006.734207:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713098496:0@lo:400:kworker.0 00000100:00100000:2.0:1789998006.734539:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713098368:0@lo:400:kworker.0 00000100:00100000:3.0:1789998006.734578:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713098368:12345-0@lo:400:kworker.0 Request processed in 2588us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998006.734589:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:0.0:1789998006.734882:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713098880:12345-0@lo:400:kworker.0 Request processed in 3041us (3627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998006.734890:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00100000:2.0:1789998006.734954:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38d00f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713098880:0@lo:400:kworker.0 00010000:00010000:2.0:1789998007.052289:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789998007.804233:0:6684:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00010000:00010000:0.0:1789998008.075429:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998008.599957:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998008.600115:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704633600 00000100:00100000:1.0:1789998008.600126:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704633600 00000100:00100000:1.0:1789998008.600175:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1279 00000100:00100000:1.0:1789998008.600184:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704633600:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998008.600264:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704633600:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998008.600271:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1279 00000100:00100000:3.0:1789998008.600854:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998008.601041:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704633728 00000100:00100000:1.0:1789998008.601046:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704633728 00000100:00100000:1.0:1789998008.601091:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1616 00000100:00100000:1.0:1789998008.601099:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704633728:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998008.601141:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2354:x1876946704633728:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998008.601148:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1616 00000100:00080000:3.0:1789998008.601348:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998008.603993:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998008.604091:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998008.604206:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704633984 00000100:00100000:1.0:1789998008.604215:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704633984 00000100:00100000:2.0:1789998008.604218:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704633856 00000100:00100000:2.0:1789998008.604237:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704633856 00000100:00080000:0.0:1789998008.604298:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789998008.604303:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998008.604336:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1126 00000100:00100000:1.0:1789998008.604347:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704633984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998008.604354:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1127 00000100:00100000:2.0:1789998008.604366:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704633856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998008.604853:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704633984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 507us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998008.604862:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1126 00000100:00100000:2.0:1789998008.604925:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fab28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704633856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 561us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998008.604933:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1127 00000100:00100000:3.0:1789998008.779130:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713099008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789998008.779220:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998008.779354:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713099008 00000100:00100000:2.0:1789998008.779362:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713099008 00000100:00100000:2.0:1789998008.779422:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:2.0:1789998008.779431:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713099008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789998008.779465:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998008.779519:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713099008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998008.779528:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:0.0:1789998008.779548:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:0.0:1789998008.779555:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a37c6ecdf80, transno 4294967375 00000100:00100000:0.0:1789998008.779570:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713099008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789998008.779873:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789998008.779933:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789998008.779943:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713099136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789998008.779972:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998008.780074:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713099136 00000100:00100000:1.0:1789998008.780080:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713099136 00000100:00100000:1.0:1789998008.780125:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1789998008.780133:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713099136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789998008.780153:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998008.780190:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713099136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998008.780195:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1789998008.780225:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713099136:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789998008.780413:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789998009.099165:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998010.122919:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998011.147104:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998011.852465:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713099392:0@lo:400:kworker.0 00000100:00100000:1.0:1789998011.852569:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998011.852638:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713099904:0@lo:400:kworker.0 00000100:00100000:1.0:1789998011.852680:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998011.852710:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789998011.852716:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713099520:0@lo:400:kworker.0 00000100:00100000:1.0:1789998011.852739:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998011.852769:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713099392 00000100:00100000:1.0:1789998011.852776:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713099392 00000100:00100000:1.0:1789998011.852813:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713099904 00000100:00100000:1.0:1789998011.852815:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713099904 00000100:00100000:1.0:1789998011.852839:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713099520 00000100:00100000:1.0:1789998011.852842:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713099520 00000100:00100000:1.0:1789998011.852864:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:1.0:1789998011.852873:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713099392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998011.852924:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713099392:12345-0@lo:400:kworker.0 Request processed in 52us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998011.852931:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00100000:1.0:1789998011.852963:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:1.0:1789998011.852971:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713099904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998011.852998:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713099904:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998011.853004:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:1.0:1789998011.853015:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:1.0:1789998011.853022:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713099520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998011.853051:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713099520:12345-0@lo:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998011.853056:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:1.0:1789998011.853098:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713099520:0@lo:400:kworker.0 00000100:00100000:1.0:1789998011.853109:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713099392:0@lo:400:kworker.0 00000100:00100000:0.0:1789998011.853291:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713099648:0@lo:400:kworker.0 00000100:00100000:0.0:1789998011.853339:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998011.853366:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789998011.853372:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713099264:0@lo:400:kworker.0 00000100:00100000:0.0:1789998011.853401:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998011.853425:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713099776:0@lo:400:kworker.0 00000100:00100000:0.0:1789998011.853447:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998011.853496:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713099264 00000100:00100000:0.0:1789998011.853501:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713099264 00000100:00100000:0.0:1789998011.853530:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1789998011.853537:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713099264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998011.853573:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713099264:12345-0@lo:400:kworker.0 Request processed in 37us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998011.853580:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1789998011.853615:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713099264:0@lo:400:kworker.0 00000100:00100000:2.0:1789998011.853739:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713099648 00000100:00100000:2.0:1789998011.853744:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713099648 00000100:00100000:2.0:1789998011.853779:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713099776 00000100:00100000:2.0:1789998011.853782:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713099776 00000100:00100000:2.0:1789998011.853802:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1789998011.853808:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713099648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998011.853844:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713099648:12345-0@lo:400:kworker.0 Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998011.853849:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1789998011.853860:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1789998011.853866:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713099776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998011.853893:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713099776:12345-0@lo:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998011.853898:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1789998011.853943:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713099776:0@lo:400:kworker.0 00000100:00100000:2.0:1789998011.853966:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713099648:0@lo:400:kworker.0 00000100:00080000:3.0:1789998011.854100:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789998011.854106:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789998011.854108:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998011.854283:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713099904:0@lo:400:kworker.0 00010000:00010000:0.0:1789998012.171315:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998013.194890:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998013.718165:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998013.718215:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998013.718316:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704634240 00000100:00100000:3.0:1789998013.718326:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704634240 00000100:00100000:3.0:1789998013.718413:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1620 00000100:00100000:3.0:1789998013.718425:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704634240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998013.718507:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2352:x1876946704634240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 85us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998013.718514:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1620 00000100:00100000:1.0:1789998013.718678:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704634112 00000100:00100000:1.0:1789998013.718684:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704634112 00000100:00100000:1.0:1789998013.718730:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1281 00000100:00100000:1.0:1789998013.718738:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704634112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998013.718768:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704634112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998013.718774:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1281 00000100:00080000:2.0:1789998013.718937:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789998013.719245:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998013.719295:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998013.719375:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704634368 00000100:00100000:1.0:1789998013.719379:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704634368 00000100:00100000:1.0:1789998013.719419:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704634496 00000100:00100000:1.0:1789998013.719422:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704634496 00000100:00100000:1.0:1789998013.719446:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1130 00000100:00100000:1.0:1789998013.719453:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704634368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998013.719489:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704634368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998013.719495:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1130 00000100:00100000:1.0:1789998013.719507:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1131 00000100:00100000:1.0:1789998013.719513:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704634496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998013.719536:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704634496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 23us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998013.719542:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1131 00000100:00080000:3.0:1789998013.719673:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789998013.719676:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998013.899077:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789998013.899107:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713100032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998013.899190:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998013.899194:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789998013.899208:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713100160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789998013.899247:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998013.899276:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713100032 00000100:00100000:2.0:1789998013.899284:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713100032 00000100:00100000:3.0:1789998013.899289:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713100160 00000100:00100000:3.0:1789998013.899295:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713100160 00000100:00100000:2.0:1789998013.899349:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1789998013.899362:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713100032:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789998013.899395:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789998013.899400:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789998013.899402:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998013.899504:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713100032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998013.899524:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1789998013.900338:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713100032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998013.900846:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:2.0:1789998013.900860:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713100160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789998013.900887:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998013.901124:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713100160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998013.901130:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:3.0:1789998013.901302:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713100160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789998014.220110:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998015.242897:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998016.267030:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998016.971936:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789998016.971957:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713100672:0@lo:400:kworker.0 00000100:00100000:3.0:1789998016.971961:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713100416:0@lo:400:kworker.0 00000100:00100000:0.0:1789998016.972333:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713100544:0@lo:400:kworker.0 00000100:00100000:2.0:1789998016.972452:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998016.972499:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713100288:0@lo:400:kworker.0 00000100:00100000:2.0:1789998016.972523:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998016.972542:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789998016.972546:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713100800:0@lo:400:kworker.0 00000100:00100000:2.0:1789998016.972562:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998016.972585:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713100672 00000100:00100000:2.0:1789998016.972592:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713100672 00000100:00100000:2.0:1789998016.972638:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713100800 00000100:00100000:2.0:1789998016.972641:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713100800 00000100:00100000:2.0:1789998016.972677:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1789998016.972685:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713100672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998016.972729:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713100672:12345-0@lo:400:kworker.0 Request processed in 46us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998016.972736:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1789998016.972750:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1789998016.972755:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713100800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998016.972775:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713100800:12345-0@lo:400:kworker.0 Request processed in 21us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998016.972780:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1789998016.972794:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713100288 00000100:00100000:2.0:1789998016.972797:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713100288 00000100:00100000:2.0:1789998016.972819:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1789998016.972825:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713100288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998016.972863:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713100288:12345-0@lo:400:kworker.0 Request processed in 38us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998016.972869:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00080000:2.0:1789998016.972892:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789998016.972896:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998016.972932:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713100800:0@lo:400:kworker.0 00000100:00100000:2.0:1789998016.972943:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713100672:0@lo:400:kworker.0 00000100:00100000:2.0:1789998016.972950:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713100288:0@lo:400:kworker.0 00000100:00100000:3.0:1789998016.973607:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998016.973647:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713100928:0@lo:400:kworker.0 00000100:00100000:3.0:1789998016.973694:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998016.973729:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713100416 00000100:00100000:3.0:1789998016.973734:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713100416 00000100:00100000:3.0:1789998016.973758:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713100928 00000100:00100000:3.0:1789998016.973761:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713100928 00000100:00100000:3.0:1789998016.973782:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:3.0:1789998016.973789:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713100416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998016.973829:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713100416:12345-0@lo:400:kworker.0 Request processed in 40us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998016.973835:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00100000:3.0:1789998016.973858:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:3.0:1789998016.973865:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713100928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998016.973892:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713100928:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998016.973898:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00000100:00100000:3.0:1789998016.973931:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713100416:0@lo:400:kworker.0 00000100:00100000:3.0:1789998016.973940:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713100928:0@lo:400:kworker.0 00000100:00080000:2.0:1789998016.974238:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998016.976115:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998016.976229:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713100544 00000100:00100000:1.0:1789998016.976236:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713100544 00000100:00100000:1.0:1789998016.976348:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1789998016.976357:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713100544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998016.976423:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713100544:12345-0@lo:400:kworker.0 Request processed in 67us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998016.976429:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00080000:2.0:1789998016.978413:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998016.978876:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713100544:0@lo:400:kworker.0 00010000:00010000:0.0:1789998017.291063:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998018.314888:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998018.841416:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998018.841459:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998018.841494:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998018.841528:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998018.841638:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704635008 00000100:00100000:2.0:1789998018.841649:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704635008 00000100:00100000:2.0:1789998018.841735:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704634880 00000100:00100000:2.0:1789998018.841739:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704634880 00000100:00100000:2.0:1789998018.841763:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1134 00000100:00100000:2.0:1789998018.841774:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704635008:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998018.841857:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704635008:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998018.841865:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1134 00000100:00100000:2.0:1789998018.841885:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1135 00000100:00100000:2.0:1789998018.841892:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704634880:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998018.841918:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704634880:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998018.841924:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1135 00000100:00100000:1.0:1789998018.842008:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704634624 00000100:00100000:1.0:1789998018.842013:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704634624 00000100:00100000:1.0:1789998018.842059:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1283 00000100:00100000:1.0:1789998018.842066:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704634624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998018.842095:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704634624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998018.842100:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1283 00000100:00080000:0.0:1789998018.842256:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789998018.842261:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789998018.842796:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704634752 00000100:00100000:3.0:1789998018.842802:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704634752 00000100:00100000:3.0:1789998018.842865:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1624 00000100:00100000:3.0:1789998018.842874:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704634752:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998018.842925:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:2353:x1876946704634752:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 52us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998018.842935:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1624 00000100:00080000:0.0:1789998018.843061:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998019.019078:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713101056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998019.019149:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998019.019385:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713101056 00000100:00100000:2.0:1789998019.019393:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713101056 00000100:00100000:2.0:1789998019.019457:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1789998019.019467:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713101056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789998019.019504:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998019.019550:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713101056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998019.019557:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00080000:0.0:1789998019.019621:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998019.019687:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713101056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998019.025934:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713101184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998019.026007:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998019.026733:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713101184 00000100:00100000:3.0:1789998019.026743:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713101184 00000100:00100000:3.0:1789998019.026894:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1789998019.026904:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713101184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789998019.026937:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789998019.027001:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713101184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998019.027007:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1789998019.027094:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713101184:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789998019.029375:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789998019.339594:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998020.305724:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998020.305876:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704635136 00000100:00100000:3.0:1789998020.305885:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704635136 00000100:00100000:3.0:1789998020.305983:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1249 00000100:00100000:3.0:1789998020.305993:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60367:x1876946704635136:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789998020.306096:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60367:x1876946704635136:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998020.306103:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1249 00000100:00080000:0.0:1789998020.306415:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998020.309066:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998020.309229:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704635264 00000100:00100000:1.0:1789998020.309238:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704635264 00000100:00100000:1.0:1789998020.309294:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 673 00000100:00100000:1.0:1789998020.309303:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60367:x1876946704635264:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:1.0:1789998020.309637:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60367:x1876946704635264:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 335us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998020.309645:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 673 00000100:00080000:0.0:1789998020.310556:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998020.313799:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998020.313900:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704635392 00000100:00100000:2.0:1789998020.313909:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704635392 00000100:00100000:2.0:1789998020.313979:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 674 00000100:00100000:2.0:1789998020.313989:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60367:x1876946704635392:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00080000:0.0:1789998020.314005:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998020.314505:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60367:x1876946704635392:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 515us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998020.314514:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 674 00000100:00100000:3.0:1789998020.318455:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998020.318605:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704635520 00000100:00100000:1.0:1789998020.318615:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704635520 00000100:00100000:1.0:1789998020.318691:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1250 00000100:00100000:1.0:1789998020.318701:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60367:x1876946704635520:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:1.0:1789998020.319101:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60367:x1876946704635520:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 401us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998020.319109:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1250 00000100:00100000:0.0:1789998020.324504:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998020.324581:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704635648 00000100:00100000:3.0:1789998020.324590:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704635648 00000100:00100000:3.0:1789998020.324643:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1251 00000100:00100000:3.0:1789998020.324683:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60367:x1876946704635648:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789998020.324772:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60367:x1876946704635648:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 121us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998020.324794:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1251 00000100:00100000:3.0:1789998020.326912:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998020.327226:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704635776 00000100:00100000:2.0:1789998020.327235:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704635776 00000100:00100000:2.0:1789998020.327287:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 675 00000100:00100000:2.0:1789998020.327297:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60367:x1876946704635776:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789998020.327628:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60367:x1876946704635776:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 333us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998020.327637:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 675 00000100:00100000:1.0:1789998020.331151:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998020.331183:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704635904 00000100:00100000:2.0:1789998020.331284:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704635904 00000100:00100000:2.0:1789998020.331337:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 676 00000100:00100000:2.0:1789998020.331347:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60367:x1876946704635904:12345-192.168.204.4@tcp:19:lfs.60003 00000100:00100000:2.0:1789998020.331729:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:60367:x1876946704635904:12345-192.168.204.4@tcp:19:lfs.60003 Request processed in 382us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998020.331737:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 676 00000100:00100000:0.0:1789998020.333768:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998020.333852:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704636032 00000100:00100000:3.0:1789998020.333861:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704636032 00000100:00100000:3.0:1789998020.333911:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1252 00000100:00100000:3.0:1789998020.333920:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60367:x1876946704636032:12345-192.168.204.4@tcp:48:lfs.60003 00000100:00100000:3.0:1789998020.334289:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60367:x1876946704636032:12345-192.168.204.4@tcp:48:lfs.60003 Request processed in 369us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998020.334297:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1252 00000100:00100000:1.0:1789998020.361516:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998020.361611:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704636160 00000100:00100000:3.0:1789998020.361620:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704636160 00000100:00100000:3.0:1789998020.361738:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1253 00000100:00100000:3.0:1789998020.361748:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+7:60368:x1876946704636160:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789998020.361769:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998020.361809:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e85b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2bc expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998020.361869:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e862 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998020.361883:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998020.361896:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789998020.361928:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00000004:00200000:3.0:1789998020.361932:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789998020.361949:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e862 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998020.361973:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052be00/0x65b43101d592e85b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2bc expref: 9 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998020.361991:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e862 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2bc expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998020.362000:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:3.0:1789998020.362004:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789998020.362007:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789998020.362066:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60368:x1876946704636160:12345-192.168.204.4@tcp:101:rm.0 Request processed in 319us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998020.362073:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1253 00010000:00010000:1.0:1789998020.363085:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998020.364304:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998020.364377:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704636416 00000100:00100000:3.0:1789998020.364384:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704636416 00000100:00100000:3.0:1789998020.364451:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1254 00000100:00100000:3.0:1789998020.364462:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:60368:x1876946704636416:12345-192.168.204.4@tcp:101:rm.0 00010000:00010000:3.0:1789998020.364480:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998020.364501:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2c3 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789998020.364564:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00010000:3.0:1789998020.364777:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e869 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2c3 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998020.364810:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:3.0:1789998020.364813:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789998020.364819:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b000/0x65b43101d592e869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2c3 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998020.364837:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789998020.364890:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:60368:x1876946704636416:12345-192.168.204.4@tcp:101:rm.0 Request processed in 430us (587us total) trans 4294967775 rc 301/301 00000100:00100000:3.0:1789998020.364897:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1254 00000100:00100000:0.0:1789998020.367797:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998020.367896:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704636544 00000100:00100000:3.0:1789998020.367904:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704636544 00000100:00100000:3.0:1789998020.368006:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 126 00000100:00100000:3.0:1789998020.368024:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:60368:x1876946704636544:12345-192.168.204.4@tcp:37:rm.0 00000100:00100000:3.0:1789998020.371718:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:60368:x1876946704636544:12345-192.168.204.4@tcp:37:rm.0 Request processed in 3686us (3931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998020.371732:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 126 00000100:00100000:3.0:1789998020.379930:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998020.380015:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704636800 00000100:00100000:0.0:1789998020.380026:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704636800 00000100:00100000:0.0:1789998020.380084:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 127 00000100:00100000:0.0:1789998020.380095:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:60368:x1876946704636800:12345-192.168.204.4@tcp:35:rm.0 00000100:00100000:0.0:1789998020.380318:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:60368:x1876946704636800:12345-192.168.204.4@tcp:35:rm.0 Request processed in 224us (397us total) trans 4294967776 rc 0/0 00000100:00100000:0.0:1789998020.380326:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 127 00000100:00100000:0.0:1789998020.390323:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998020.390361:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704637056 00000100:00100000:0.0:1789998020.390371:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704637056 00000100:00100000:0.0:1789998020.390422:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1255 00000100:00100000:0.0:1789998020.390432:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+10:60368:x1876946704637056:12345-192.168.204.4@tcp:36:rm.0 00010000:00010000:0.0:1789998020.390484:0:11799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789998020.390511:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b400/0x65b43101d592e862 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2bc expref: 10 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390535:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0e00/0x65b43101d592e807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2a7 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390553:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9e00) 00010000:00010000:0.0:1789998020.390569:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e052b600/0x65b43101d592e521 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf1f1 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390579:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38ee49e400) 00010000:00010000:0.0:1789998020.390586:0:11799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789998020.390607:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390620:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390629:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390640:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390646:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390670:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390968:0:11799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390978:0:11799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.390985:0:11799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789998020.391750:0:11799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 16384 00010000:00010000:0.0:1789998020.391768:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391776:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391798:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391804:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789998020.391809:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391818:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391828:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff8a38c28e9200) 00010000:00010000:0.0:1789998020.391831:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789998020.391836:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391843:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e0400/0x65b43101d592e885 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391868:0:11799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391875:0:11799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391880:0:11799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391885:0:11799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:0.0:1789998020.391888:0:11799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391894:0:11799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391902:0:11799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38c28e9d00) 00010000:00010000:0.0:1789998020.391905:0:11799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789998020.391908:0:11799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998020.391914:0:11799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1200/0x65b43101d592e877 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789998020.391928:0:11799:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0ca0f4e reply state 0000000090b84fa5 transno 4294967777 ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998020.391936:0:11799:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789998020.392017:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+9:60368:x1876946704637056:12345-192.168.204.4@tcp:36:rm.0 Request processed in 1585us (1702us total) trans 4294967777 rc 0/0 00000100:00100000:0.0:1789998020.392026:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1255 00010000:00010000:1.0:1789998020.399633:0:3268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998020.399667:0:3268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998020.399812:0:3268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998020.399833:0:3268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1ecf4f0) 00010000:00010000:1.0:1789998020.399903:0:3268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998020.399913:0:3268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998020.399929:0:3268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff8a38c28e9b00) 00010000:00010000:1.0:1789998020.399933:0:3268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789998020.399938:0:3268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998020.399962:0:3268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a39020e1c00/0x65b43101d592e87e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11799 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789998021.275897:0:102167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe6536400 20000000:00000080:0.0:1789998021.275915:0:102167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c722dc00 uarg=0000000000000000 00010000:00010000:0.0:1789998021.279349:0:102167:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1789998021.279444:0:102167:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1789998021.279498:0:102167:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998021.279522:0:102167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998021.279541:0:102167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e50c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998021.279549:0:102167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998021.279586:0:102167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e50c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998021.279601:0:102167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e50c expref: 18 pid: 5803 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998021.279615:0:102167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb1dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102167:1876946713101312:0@lo:104: 00000100:00100000:0.0:1789998021.279784:0:102167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998021.279870:0:102167:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0a77d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789998021.279933:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713101312 00000100:00100000:3.0:1789998021.279940:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713101312 00000100:00100000:3.0:1789998021.280079:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789998021.280089:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb1ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:102167:x1876946713101312:12345-0@lo:104: 00010000:00010000:3.0:1789998021.280102:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.280164:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998021.280170:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb1ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:102167:x1876946713101312:12345-0@lo:104: Request processed in 84us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998021.280177:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:1.0:1789998021.280220:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789998021.280226:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280234:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789998021.280238:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280246:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789998021.280254:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998021.280260:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789998021.280287:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280292:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789998021.280312:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280319:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592e50c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e513 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280333:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998021.280335:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998021.280336:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998021.280352:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713101440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998021.280392:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998021.280425:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713101440 00000100:00100000:1.0:1789998021.280428:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713101440 00010000:00010000:1.0:1789998021.280446:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e50c expref: 19 pid: 5803 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998021.280467:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1789998021.280472:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713101440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998021.280481:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998021.280486:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e50c expref: 19 pid: 5803 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280494:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e50c expref: 19 pid: 5803 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280511:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280520:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280533:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280540:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280547:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280553:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280558:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789998021.280562:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280570:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280577:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998021.280585:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789998021.280607:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713101440:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998021.280613:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1789998021.280696:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713101440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998021.280797:0:102167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592e513 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e50c expref: 18 pid: 5803 timeout: 2309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998021.280816:0:102167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb1dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102167:1876946713101312:0@lo:104: 00010000:00010000:0.0:1789998021.280828:0:102167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998021.280837:0:102167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998021.280844:0:102167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998021.280850:0:102167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592e88c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998021.391456:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789998021.834274:0:102215:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe604ae070 20000000:00000080:3.0:1789998021.834292:0:102215:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c333dc00 uarg=0000000000000000 00010000:00010000:3.0:1789998021.834575:0:102215:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789998021.834590:0:102215:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789998021.834607:0:102215:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998021.834817:0:102215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834833:0:102215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834844:0:102215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834850:0:102215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834859:0:102215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834866:0:102215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834872:0:102215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998021.834876:0:102215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834884:0:102215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834896:0:102215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834904:0:102215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998021.834912:0:102215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592e893 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998022.095185:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713101568:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095252:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998022.095296:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713102080:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095320:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998022.095345:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789998022.095350:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713101696:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095373:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998022.095391:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713102208:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095410:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998022.095438:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713101824:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095478:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998022.095501:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789998022.095508:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713101952:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095530:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998022.095564:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713101568 00000100:00100000:0.0:1789998022.095571:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713101568 00000100:00100000:0.0:1789998022.095612:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1789998022.095620:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713101568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095691:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713101568:12345-0@lo:400:kworker.0 Request processed in 71us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998022.095698:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1789998022.095730:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713102080 00000100:00100000:0.0:1789998022.095734:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713102080 00000100:00100000:0.0:1789998022.095784:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713101952 00000100:00100000:0.0:1789998022.095788:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713101952 00000100:00100000:0.0:1789998022.095809:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1789998022.095815:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713102080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095846:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713102080:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998022.095852:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1789998022.095863:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1789998022.095868:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713101952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.095898:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713101952:12345-0@lo:400:kworker.0 Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998022.095904:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1789998022.095922:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713101696 00000100:00100000:0.0:1789998022.095925:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713101696 00000100:00100000:0.0:1789998022.095952:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713102208 00000100:00100000:0.0:1789998022.095955:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713102208 00000100:00100000:0.0:1789998022.095974:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713101824 00000100:00100000:0.0:1789998022.095977:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713101824 00000100:00100000:0.0:1789998022.095996:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:0.0:1789998022.096002:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713101696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.096034:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713101696:12345-0@lo:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998022.096039:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00100000:0.0:1789998022.096050:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:0.0:1789998022.096055:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713102208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.096081:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713102208:12345-0@lo:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998022.096087:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:0.0:1789998022.096099:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1627 00000100:00100000:0.0:1789998022.096104:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713101824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.096130:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713101824:12345-0@lo:400:kworker.0 Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998022.096135:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1627 00000100:00080000:0.0:1789998022.096161:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789998022.096165:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789998022.096168:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998022.096206:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713101952:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.096218:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713101824:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.096239:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb1df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713101696:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.096244:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713102208:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.096249:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713101568:0@lo:400:kworker.0 00000100:00100000:0.0:1789998022.096254:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb1de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713102080:0@lo:400:kworker.0 00000020:00000080:3.0:1789998022.326329:0:102263:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc49517d10 20000000:00000080:3.0:1789998022.326347:0:102263:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c333e400 uarg=0000000000000000 00010000:00010000:3.0:1789998022.326563:0:102263:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789998022.326577:0:102263:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789998022.326595:0:102263:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998022.326616:0:102263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326646:0:102263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326680:0:102263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326687:0:102263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326694:0:102263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326701:0:102263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326707:0:102263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998022.326711:0:102263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326722:0:102263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326734:0:102263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326752:0:102263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998022.326759:0:102263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592e89a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998022.412197:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789998023.311499:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789998023.311507:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789998023.311513:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998023.311555:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998023.311568:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998023.311579:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998023.311602:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713102336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789998023.311683:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998023.311749:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5caa300 going to sleep for 11 seconds 00000100:00100000:3.0:1789998023.311961:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713102336 00000100:00100000:3.0:1789998023.311969:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713102336 00000100:00100000:3.0:1789998023.312023:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1789998023.312033:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713102336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998023.312045:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998023.312058:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e8a1 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998023.312081:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998023.312092:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998023.312099:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052be00, rc 0) 00000100:00100000:3.0:1789998023.313025:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713102336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 990us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998023.313037:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1789998023.313487:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713102336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998023.313507:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998023.313518:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998023.313540:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789998023.313544:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998023.313552:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998023.435339:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998023.959335:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998023.959375:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998023.959413:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998023.959440:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998023.959464:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704637312 00000100:00100000:0.0:1789998023.959472:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704637312 00000100:00100000:0.0:1789998023.959519:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1628 00000100:00100000:0.0:1789998023.959528:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704637312:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998023.959599:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+8:2355:x1876946704637312:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998023.959605:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1628 00000100:00100000:0.0:1789998023.959637:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704637440 00000100:00100000:0.0:1789998023.959753:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704637440 00000100:00100000:0.0:1789998023.959787:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704637568 00000100:00100000:0.0:1789998023.959791:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704637568 00000100:00100000:0.0:1789998023.959814:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1138 00000100:00100000:0.0:1789998023.959821:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704637440:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998023.959847:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704637440:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998023.959854:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1138 00000100:00100000:0.0:1789998023.959866:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1139 00000100:00100000:0.0:1789998023.959873:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704637568:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998023.959896:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704637568:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998023.959902:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1139 00000100:00080000:0.0:1789998023.959926:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789998023.959930:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789998023.959946:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789998023.960214:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704637184 00000100:00100000:3.0:1789998023.960220:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704637184 00000100:00100000:0.0:1789998023.960261:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1286 00000100:00100000:0.0:1789998023.960272:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704637184:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998023.960305:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704637184:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 36us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998023.960312:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1286 00000100:00100000:1.0:1789998024.139779:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713102592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998024.139869:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998024.139909:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713102592 00000100:00100000:0.0:1789998024.139918:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713102592 00000100:00100000:1.0:1789998024.139921:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713102464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789998024.139945:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998024.139979:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713102464 00000100:00100000:1.0:1789998024.139983:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713102464 00000100:00100000:0.0:1789998024.139983:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1789998024.139993:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb2aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713102592:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998024.140017:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:1.0:1789998024.140023:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713102464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998024.140028:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00002000:00000024:1.0:1789998024.140039:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998024.140075:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb2aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713102592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998024.140081:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00080000:0.0:1789998024.140303:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789998024.140307:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998024.144127:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713102464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4094us (4171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998024.144140:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1789998024.146342:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713102592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789998024.146446:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713102464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789998024.458809:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789998024.875865:0:102458:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9ce31530 20000000:00000080:1.0:1789998024.875899:0:102458:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38ffd50400 uarg=0000000000000000 00010000:00010000:1.0:1789998024.876120:0:102458:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789998024.876135:0:102458:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789998024.876153:0:102458:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789998024.876173:0:102458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998024.876190:0:102458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998024.876198:0:102458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998024.876241:0:102458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998024.876255:0:102458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 18 pid: 7594 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998024.876268:0:102458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102458:1876946713102720:0@lo:104: 00000100:00100000:1.0:1789998024.876336:0:102458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998024.876461:0:102458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d3b04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998024.876505:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713102720 00000100:00100000:0.0:1789998024.876513:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713102720 00000100:00100000:0.0:1789998024.876615:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789998024.876625:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:102458:x1876946713102720:12345-0@lo:104: 00010000:00010000:0.0:1789998024.876637:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998024.876810:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998024.876817:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:102458:x1876946713102720:12345-0@lo:104: Request processed in 195us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998024.876824:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00010000:00010000:2.0:1789998024.876885:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998024.876892:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.876900:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998024.876904:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.876913:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998024.876921:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998024.876928:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998024.876956:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.876962:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789998024.876985:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.876992:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2200/0x65b43101d592e8a1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877006:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998024.877007:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998024.877008:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998024.877018:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713102848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998024.877042:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998024.877081:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713102848 00000100:00100000:2.0:1789998024.877084:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713102848 00010000:00010000:2.0:1789998024.877098:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 19 pid: 7594 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998024.877110:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1789998024.877114:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713102848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998024.877122:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998024.877125:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 19 pid: 7594 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877132:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 19 pid: 7594 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877143:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877152:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877161:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877165:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877170:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877174:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877177:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998024.877180:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877184:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877189:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998024.877195:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998024.877212:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713102848:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998024.877216:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1789998024.877241:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713102848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998024.877334:0:102458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052be00/0x65b43101d592e8a8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e8a1 expref: 18 pid: 7594 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998024.877342:0:102458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102458:1876946713102720:0@lo:104: 00010000:00010000:1.0:1789998024.877351:0:102458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998024.877357:0:102458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998024.877361:0:102458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998024.877364:0:102458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3c00/0x65b43101d592e8af lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789998025.214411:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967777 is committed 00010000:00010000:1.0:1789998025.485188:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789998025.994914:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789998025.994923:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789998025.994927:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789998025.994971:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998025.994985:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998025.994997:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998025.995023:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713102976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998025.995091:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998025.995156:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789998025.995725:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713102976 00000100:00100000:3.0:1789998025.995734:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713102976 00000100:00100000:3.0:1789998025.995785:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:3.0:1789998025.995795:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713102976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998025.995808:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998025.995823:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e8b6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998025.995860:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998025.995871:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998025.995880:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789998025.995932:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713102976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998025.995939:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1789998025.999598:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713102976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998025.999627:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998025.999640:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998025.999701:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789998025.999708:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998025.999716:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998026.506872:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998027.210873:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713103104:0@lo:400:kworker.0 00000100:00100000:1.0:1789998027.211039:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713103232:0@lo:400:kworker.0 00000100:00100000:1.0:1789998027.211096:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998027.211122:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998027.211187:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713103360:0@lo:400:kworker.0 00000100:00100000:2.0:1789998027.211222:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998027.211227:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713103104 00000100:00100000:0.0:1789998027.211237:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713103104 00000100:00100000:2.0:1789998027.211253:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713103488:0@lo:400:kworker.0 00000100:00100000:2.0:1789998027.211282:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998027.211288:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1789998027.211304:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713103104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998027.211312:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713103232 00000100:00100000:2.0:1789998027.211317:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713103232 00000100:00100000:2.0:1789998027.211350:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713103360 00000100:00100000:2.0:1789998027.211353:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713103360 00000100:00100000:0.0:1789998027.211355:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713103104:12345-0@lo:400:kworker.0 Request processed in 59us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998027.211362:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1789998027.211392:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:2.0:1789998027.211401:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713103232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998027.211435:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713103232:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998027.211441:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00100000:2.0:1789998027.211454:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:2.0:1789998027.211460:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713103360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998027.211494:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713103360:12345-0@lo:400:kworker.0 Request processed in 34us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998027.211500:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:2.0:1789998027.211518:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713103488 00000100:00100000:2.0:1789998027.211522:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713103488 00000100:00100000:2.0:1789998027.211549:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1789998027.211556:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713103488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998027.211598:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713103488:12345-0@lo:400:kworker.0 Request processed in 43us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998027.211604:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00080000:2.0:1789998027.211625:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789998027.211629:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998027.211750:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713103232:0@lo:400:kworker.0 00000100:00100000:1.0:1789998027.211758:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713103744:0@lo:400:kworker.0 00000100:00100000:1.0:1789998027.211782:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998027.211959:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713103744 00000100:00100000:3.0:1789998027.211964:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713103744 00000100:00100000:3.0:1789998027.212004:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:3.0:1789998027.212011:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713103744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998027.212051:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713103744:12345-0@lo:400:kworker.0 Request processed in 40us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998027.212057:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:0.0:1789998027.212143:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713103104:0@lo:400:kworker.0 00000100:00100000:0.0:1789998027.212187:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713103616:0@lo:400:kworker.0 00000100:00100000:0.0:1789998027.212212:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998027.212243:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713103616 00000100:00100000:0.0:1789998027.212247:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713103616 00000100:00100000:0.0:1789998027.212272:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1789998027.212278:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713103616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998027.212312:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713103616:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998027.212317:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1789998027.212343:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713103616:0@lo:400:kworker.0 00000100:00100000:3.0:1789998027.212863:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713103360:0@lo:400:kworker.0 00000100:00080000:1.0:1789998027.213127:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998027.213132:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998027.213156:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713103744:0@lo:400:kworker.0 00000100:00100000:0.0:1789998027.213310:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713103488:0@lo:400:kworker.0 00010000:00010000:2.0:1789998027.533085:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998028.567605:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998029.079560:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998029.079604:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998029.079647:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998029.079724:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998029.079735:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704637952 00000100:00100000:1.0:1789998029.079746:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704637952 00000100:00100000:2.0:1789998029.079753:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704637824 00000100:00100000:2.0:1789998029.079759:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704637824 00000100:00100000:1.0:1789998029.079805:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704638080 00000100:00100000:1.0:1789998029.079809:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704638080 00000100:00100000:2.0:1789998029.079815:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1632 00000100:00100000:2.0:1789998029.079829:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704637824:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998029.079836:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1142 00000100:00100000:1.0:1789998029.079846:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704637952:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998029.079913:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704637952:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998029.079921:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1142 00000100:00100000:3.0:1789998029.079935:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704637696 00000100:00100000:3.0:1789998029.079942:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704637696 00000100:00100000:1.0:1789998029.079942:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1143 00000100:00100000:1.0:1789998029.079952:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704638080:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998029.079982:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1289 00000100:00100000:1.0:1789998029.079983:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704638080:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 30us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998029.079991:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1143 00000100:00100000:3.0:1789998029.080006:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704637696:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:1.0:1789998029.080007:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998029.080012:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789998029.080016:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789998029.080044:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704637696:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 41us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998029.080052:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1289 00000100:00100000:2.0:1789998029.080504:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704637824:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 679us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998029.080512:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1632 00000100:00100000:0.0:1789998029.260168:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713103872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998029.260236:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998029.260406:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713103872 00000100:00100000:1.0:1789998029.260414:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713103872 00000100:00100000:1.0:1789998029.260481:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1789998029.260490:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713103872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998029.260522:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998029.260567:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713103872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998029.260574:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:1.0:1789998029.261515:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713103872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789998029.261594:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998029.263047:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789998029.263063:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713104000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789998029.263120:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998029.263284:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713104000 00000100:00100000:0.0:1789998029.263291:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713104000 00000100:00100000:0.0:1789998029.263343:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:0.0:1789998029.263351:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713104000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998029.263384:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998029.263440:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713104000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998029.263447:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00080000:1.0:1789998029.263545:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998029.263573:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713104000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789998029.579188:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998030.604281:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998031.627754:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789998032.109456:0:102802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23a: test mapped regular ACLs ========= 09:40:31 (1789998031) 00000100:00100000:3.0:1789998032.330926:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713104512:0@lo:400:kworker.0 00000100:00100000:3.0:1789998032.330998:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998032.331066:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789998032.331074:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713104384:0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331085:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713104128:0@lo:400:kworker.0 00000100:00100000:3.0:1789998032.331099:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998032.331116:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998032.331131:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713104384 00000100:00100000:3.0:1789998032.331138:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713104384 00000100:00100000:0.0:1789998032.331139:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713104640:0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331159:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998032.331175:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789998032.331180:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713104256:0@lo:400:kworker.0 00000100:00100000:3.0:1789998032.331192:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:0.0:1789998032.331198:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998032.331201:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713104384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331212:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713104768:0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331228:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998032.331244:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713104384:12345-0@lo:400:kworker.0 Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998032.331251:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:0.0:1789998032.331261:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713104512 00000100:00100000:3.0:1789998032.331264:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713104256 00000100:00100000:0.0:1789998032.331265:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713104512 00000100:00100000:3.0:1789998032.331266:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713104256 00000100:00100000:3.0:1789998032.331282:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713104768 00000100:00100000:3.0:1789998032.331285:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713104768 00000100:00100000:0.0:1789998032.331301:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713104640 00000100:00100000:3.0:1789998032.331304:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:0.0:1789998032.331304:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713104640 00000100:00100000:3.0:1789998032.331309:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713104256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331324:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1789998032.331330:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713104512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998032.331339:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713104256:12345-0@lo:400:kworker.0 Request processed in 30us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998032.331344:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00100000:3.0:1789998032.331356:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1789998032.331357:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713104512:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998032.331373:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713104768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331374:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1789998032.331386:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1789998032.331391:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713104640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998032.331403:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713104768:12345-0@lo:400:kworker.0 Request processed in 42us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998032.331409:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1789998032.331413:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713104640:12345-0@lo:400:kworker.0 Request processed in 23us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998032.331419:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00080000:3.0:1789998032.331424:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789998032.331428:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789998032.331430:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998032.331433:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713104128 00000100:00100000:0.0:1789998032.331436:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713104128 00000100:00100000:3.0:1789998032.331464:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713104384:0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331470:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1789998032.331475:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713104512:0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331475:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713104128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331503:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713104128:12345-0@lo:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998032.331508:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:0.0:1789998032.331543:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713104256:0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331567:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713104768:0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331575:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713104128:0@lo:400:kworker.0 00000100:00100000:0.0:1789998032.331582:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713104640:0@lo:400:kworker.0 00010000:00010000:0.0:1789998032.650978:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789998032.961701:0:102850:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23a Need 2 clients at least 00010000:00010000:2.0:1789998033.681056:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789998033.896551:0:102898:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23b: test mapped default ACLs ========= 09:40:33 (1789998033) 00000100:00100000:2.0:1789998034.203033:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998034.203067:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998034.203092:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998034.203120:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998034.203154:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704638464 00000100:00100000:2.0:1789998034.203163:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704638464 00000100:00100000:2.0:1789998034.203218:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704638592 00000100:00100000:2.0:1789998034.203221:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704638592 00000100:00100000:2.0:1789998034.203247:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1146 00000100:00100000:2.0:1789998034.203260:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704638464:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998034.203274:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704638336 00000100:00100000:1.0:1789998034.203278:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704638336 00000100:00100000:1.0:1789998034.203311:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1636 00000100:00100000:1.0:1789998034.203318:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704638336:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998034.203328:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704638464:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 73us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998034.203339:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1146 00000100:00100000:1.0:1789998034.203345:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704638336:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998034.203351:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1636 00000100:00100000:2.0:1789998034.203356:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1147 00000100:00100000:2.0:1789998034.203362:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704638592:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998034.203383:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704638592:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 21us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998034.203547:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704638208 00000100:00100000:3.0:1789998034.203552:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704638208 00000100:00100000:2.0:1789998034.204882:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1147 00000100:00080000:1.0:1789998034.204998:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789998034.205005:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998034.205007:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998034.206411:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1291 00000100:00100000:1.0:1789998034.206423:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704638208:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998034.206498:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704638208:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 77us (3472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998034.206505:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1291 00000100:00100000:2.0:1789998034.379302:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713104896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998034.379376:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998034.379448:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789998034.379455:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713105024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998034.379479:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998034.379560:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713104896 00000100:00100000:0.0:1789998034.379568:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713104896 00000100:00100000:0.0:1789998034.379637:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713105024 00000100:00100000:0.0:1789998034.379640:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713105024 00000100:00100000:0.0:1789998034.379684:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1789998034.379694:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713104896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998034.379728:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998034.379795:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713104896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998034.379802:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1789998034.379817:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1789998034.379824:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713105024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998034.379843:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998034.379870:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713105024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998034.379876:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:0.0:1789998034.379916:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713105024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998034.379929:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713104896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789998034.380187:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789998034.380191:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789998034.698914:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789998034.841441:0:102946:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23b Need 2 clients at least 00010000:00010000:0.0:1789998035.724017:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789998036.135388:0:102996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 24: check nodemap proc files for LBUGs and Oopses ========================================================== 09:40:34 (1789998034) 00010000:00010000:2.0:1789998036.753029:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:0.0:1789998037.150353:0:103044:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:0.0:1789998037.164508:0:103044:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:2.0:1789998037.450852:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789998037.450880:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713105152:0@lo:400:kworker.0 00000100:00100000:2.0:1789998037.450964:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998037.450994:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713105152 00000100:00100000:1.0:1789998037.451004:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713105152 00000100:00100000:3.0:1789998037.451047:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713105408:0@lo:400:kworker.0 00000100:00100000:1.0:1789998037.451047:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1789998037.451056:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713105152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998037.451079:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998037.451091:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713105280:0@lo:400:kworker.0 00000100:00100000:1.0:1789998037.451103:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713105152:12345-0@lo:400:kworker.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998037.451111:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:3.0:1789998037.451118:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789998037.451124:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713105536:0@lo:400:kworker.0 00000100:00100000:2.0:1789998037.451129:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998037.451159:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713105792:0@lo:400:kworker.0 00000100:00100000:3.0:1789998037.451160:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998037.451192:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998037.451224:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713105536 00000100:00100000:2.0:1789998037.451228:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713105152:0@lo:400:kworker.0 00000100:00100000:0.0:1789998037.451228:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713105664:0@lo:400:kworker.0 00000100:00100000:1.0:1789998037.451230:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713105536 00000100:00080000:2.0:1789998037.451263:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998037.451265:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998037.451277:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713105664 00000100:00100000:1.0:1789998037.451280:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713105664 00000100:00100000:1.0:1789998037.451304:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1789998037.451311:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713105536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998037.451315:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:0.0:1789998037.451322:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7413850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713105664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998037.451346:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713105536:12345-0@lo:400:kworker.0 Request processed in 35us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998037.451347:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7413850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713105664:12345-0@lo:400:kworker.0 Request processed in 27us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998037.451352:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1789998037.451384:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713105408 00000100:00100000:2.0:1789998037.451385:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713105280 00000100:00100000:3.0:1789998037.451388:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713105408 00000100:00100000:2.0:1789998037.451393:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713105280 00000100:00100000:3.0:1789998037.451427:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713105792 00000100:00100000:3.0:1789998037.451433:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713105792 00000100:00100000:2.0:1789998037.451438:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:2.0:1789998037.451461:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713105408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998037.451487:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:3.0:1789998037.451497:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713105280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998037.451502:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713105408:12345-0@lo:400:kworker.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998037.451510:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:3.0:1789998037.451540:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713105280:12345-0@lo:400:kworker.0 Request processed in 45us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998037.451547:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:3.0:1789998037.451560:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:3.0:1789998037.451565:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713105792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998037.451586:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713105792:12345-0@lo:400:kworker.0 Request processed in 21us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998037.451590:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00100000:3.0:1789998037.451619:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713105536:0@lo:400:kworker.0 00000100:00100000:3.0:1789998037.451627:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713105408:0@lo:400:kworker.0 00000100:00080000:2.0:1789998037.451931:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789998037.451935:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998037.452074:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:0.0:1789998037.452306:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713105664:0@lo:400:kworker.0 00000100:00100000:3.0:1789998037.454530:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713105280:0@lo:400:kworker.0 00000100:00100000:3.0:1789998037.454550:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713105792:0@lo:400:kworker.0 00010000:00010000:0.0:1789998037.771067:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789998037.876267:0:103093:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd08724fd0 20000000:00000080:1.0:1789998037.876285:0:103093:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c26400 uarg=0000000000000000 10000000:01000000:1.0:1789998037.876841:0:103093:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789998037.876861:0:103093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998037.876879:0:103093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998037.876888:0:103093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998037.876925:0:103093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998037.876938:0:103093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 18 pid: 5803 timeout: 2326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998037.876952:0:103093:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103093:1876946713105920:0@lo:104: 00000100:00100000:1.0:1789998037.877009:0:103093:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998037.877061:0:103093:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998037.877376:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713105920 00000100:00100000:0.0:1789998037.877384:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713105920 00000100:00100000:0.0:1789998037.877424:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789998037.877434:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103093:x1876946713105920:12345-0@lo:104: 00010000:00010000:0.0:1789998037.877458:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998037.877524:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998037.877530:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103093:x1876946713105920:12345-0@lo:104: Request processed in 98us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998037.877537:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00010000:0.0:1789998037.877557:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998037.877563:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998037.877571:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789998037.877575:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998037.877585:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998037.877593:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998037.877600:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789998037.877625:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998037.877631:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998037.877647:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998037.877754:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713106048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789998037.877785:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998037.877832:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713106048 00000100:00100000:3.0:1789998037.877836:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713106048 00010000:00010000:3.0:1789998037.877859:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 19 pid: 5803 timeout: 2326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998037.877882:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1789998037.877888:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713106048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998037.877898:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998037.877903:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 19 pid: 5803 timeout: 2326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877912:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 19 pid: 5803 timeout: 2326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877927:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877934:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877946:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877952:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877957:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877963:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877967:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998037.877970:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877977:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877986:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998037.877995:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998037.878021:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713106048:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998037.878028:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1789998037.878061:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713106048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998037.878137:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e8b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8bd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998037.878159:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998037.878161:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998037.878162:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998037.878281:0:103093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592e8bd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e8b6 expref: 18 pid: 5803 timeout: 2326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998037.878292:0:103093:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103093:1876946713105920:0@lo:104: 00010000:00010000:1.0:1789998037.878304:0:103093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998037.878313:0:103093:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998037.878320:0:103093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998037.878326:0:103093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592e8c4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789998038.548393:0:103141:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6c5b6440 20000000:00000080:2.0:1789998038.548410:0:103141:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c09c00 uarg=0000000000000000 10000000:01000000:2.0:1789998038.548705:0:103141:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998038.548726:0:103141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548741:0:103141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548753:0:103141:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548760:0:103141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548768:0:103141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548776:0:103141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548782:0:103141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998038.548789:0:103141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548797:0:103141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548810:0:103141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548818:0:103141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.548825:0:103141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e8cb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998038.794921:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789998039.114760:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789998039.114768:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789998039.114772:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789998039.114815:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.114828:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.114841:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998039.114868:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713106176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998039.114937:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998039.114994:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789998039.115061:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713106176 00000100:00100000:1.0:1789998039.115069:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713106176 00000100:00100000:1.0:1789998039.115123:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1789998039.115132:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713106176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998039.115146:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998039.115158:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e8d2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998039.115181:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998039.115193:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998039.115202:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:0.0:1789998039.116063:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713106176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998039.116082:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.116093:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998039.116126:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789998039.116132:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.116145:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998039.118537:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713106176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3398us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998039.118549:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000020:00000080:0.0:1789998039.194767:0:103189:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd658cecd0 20000000:00000080:0.0:1789998039.194786:0:103189:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e6000 uarg=0000000000000000 10000000:01000000:0.0:1789998039.195107:0:103189:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998039.195127:0:103189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.195144:0:103189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.195153:0:103189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.195192:0:103189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.195206:0:103189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 18 pid: 5803 timeout: 2327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998039.195220:0:103189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103189:1876946713106304:0@lo:104: 00000100:00100000:0.0:1789998039.195572:0:103189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998039.195754:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789998039.195769:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713106304 00000100:00100000:3.0:1789998039.195776:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713106304 00000100:00100000:0.0:1789998039.195798:0:103189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789998039.195892:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789998039.195905:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103189:x1876946713106304:12345-0@lo:104: 00010000:00010000:3.0:1789998039.195918:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998039.195990:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998039.195997:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd86450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103189:x1876946713106304:12345-0@lo:104: Request processed in 96us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998039.196006:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789998039.196020:0:103189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103189:1876946713106304:0@lo:104: 00010000:00010000:0.0:1789998039.196044:0:103189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.196992:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998039.197002:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197012:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998039.197016:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197026:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998039.197034:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998039.197040:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998039.197087:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197094:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789998039.197131:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197139:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592e8d2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998039.197159:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713106432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998039.197167:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998039.197170:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998039.197172:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998039.197201:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998039.197335:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713106432 00000100:00100000:2.0:1789998039.197341:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713106432 00010000:00010000:2.0:1789998039.197363:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 19 pid: 5803 timeout: 2327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998039.197392:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789998039.197400:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713106432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998039.197420:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998039.197425:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 19 pid: 5803 timeout: 2327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197628:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 19 pid: 5803 timeout: 2327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197641:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592e8d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e8d2 expref: 19 pid: 5803 timeout: 2327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197675:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197685:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197699:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197706:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197713:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197721:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197726:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998039.197730:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197738:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197748:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.197758:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789998039.197762:0:103189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.197773:0:103189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998039.197780:0:103189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592e8e0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998039.197795:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713106432:12345-0@lo:103:ldlm_bl.0 Request processed in 395us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998039.197803:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1789998039.197903:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713106432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789998039.322999:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998039.323042:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998039.323070:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998039.323098:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704638848 00000100:00100000:3.0:1789998039.323108:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704638848 00000100:00100000:3.0:1789998039.323170:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1640 00000100:00100000:3.0:1789998039.323182:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704638848:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998039.323261:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704638848:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998039.323269:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1640 00000100:00100000:3.0:1789998039.323294:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704638976 00000100:00100000:3.0:1789998039.323298:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704638976 00000100:00100000:3.0:1789998039.323330:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1150 00000100:00100000:3.0:1789998039.323338:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704638976:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998039.323358:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704638720 00000100:00100000:1.0:1789998039.323363:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704638720 00000100:00100000:3.0:1789998039.323366:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2354:x1876946704638976:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998039.323372:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1150 00000100:00100000:1.0:1789998039.323391:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1294 00000100:00100000:1.0:1789998039.323399:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704638720:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:3.0:1789998039.323403:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789998039.323407:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998039.323434:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704638720:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 37us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998039.323441:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1294 00000100:00100000:3.0:1789998039.335703:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998039.335738:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704639104 00000100:00100000:3.0:1789998039.335748:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704639104 00000100:00100000:3.0:1789998039.335799:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1151 00000100:00100000:3.0:1789998039.335809:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704639104:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998039.335876:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704639104:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 69us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998039.335883:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1151 00000100:00080000:3.0:1789998039.335919:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998039.498804:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713106560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998039.498876:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998039.498947:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713106688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998039.498970:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998039.499011:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713106560 00000100:00100000:0.0:1789998039.499019:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713106560 00000100:00100000:0.0:1789998039.499064:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713106688 00000100:00100000:0.0:1789998039.499067:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713106688 00000100:00100000:0.0:1789998039.499084:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:0.0:1789998039.499093:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713106560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998039.499126:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789998039.499208:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789998039.499213:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998039.501057:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:1.0:1789998039.501080:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713106688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998039.501115:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998039.501268:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713106560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2173us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998039.501277:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:1.0:1789998039.503332:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713106688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2256us (4353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998039.503344:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:2.0:1789998039.506951:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713106560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998039.507162:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713106688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789998039.819819:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998039.955143:0:103237:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd32b60340 20000000:00000080:2.0:1789998039.955160:0:103237:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fadca800 uarg=0000000000000000 10000000:01000000:2.0:1789998039.955343:0:103237:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998039.955365:0:103237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955382:0:103237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955393:0:103237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955417:0:103237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955426:0:103237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955434:0:103237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955442:0:103237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998039.955446:0:103237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955454:0:103237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955473:0:103237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955482:0:103237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998039.955489:0:103237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e8e7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789998040.587824:0:103286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebdd63ba0 20000000:00000080:3.0:1789998040.587839:0:103286:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae39400 uarg=0000000000000000 10000000:01000000:3.0:1789998040.588221:0:103286:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998040.588243:0:103286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588258:0:103286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588269:0:103286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588276:0:103286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588283:0:103286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588290:0:103286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588296:0:103286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998040.588300:0:103286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588307:0:103286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588319:0:103286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588327:0:103286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.588333:0:103286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8ee lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998040.847618:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789998040.971971:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789998040.971978:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789998040.971984:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789998040.972023:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998040.972039:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998040.972051:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998040.972075:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713106816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998040.972138:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998040.972203:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789998040.972293:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713106816 00000100:00100000:3.0:1789998040.972301:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713106816 00000100:00100000:3.0:1789998040.972549:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:3.0:1789998040.972559:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713106816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998040.972576:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998040.972589:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e8f5 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.972611:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.972622:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998040.972631:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b800, rc 0) 00000100:00100000:3.0:1789998040.972692:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713106816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998040.972698:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:0.0:1789998040.972714:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713106816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998040.972734:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998040.972743:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998040.972759:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789998040.972763:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998040.973352:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789998041.218010:0:103334:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe32062580 20000000:00000080:1.0:1789998041.218027:0:103334:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c27000 uarg=0000000000000000 10000000:01000000:1.0:1789998041.218207:0:103334:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789998041.218226:0:103334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998041.218243:0:103334:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998041.218251:0:103334:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998041.218362:0:103334:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998041.218387:0:103334:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 18 pid: 7594 timeout: 2329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998041.218401:0:103334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103334:1876946713106944:0@lo:104: 00000100:00100000:1.0:1789998041.218464:0:103334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998041.218567:0:103334:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c35fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1789998041.218647:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713106944 00000100:00100000:0.0:1789998041.218719:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713106944 00000100:00100000:0.0:1789998041.218775:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789998041.218785:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103334:x1876946713106944:12345-0@lo:104: 00010000:00010000:0.0:1789998041.218800:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.218951:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998041.218957:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103334:x1876946713106944:12345-0@lo:104: Request processed in 175us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998041.218965:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00010000:2.0:1789998041.219019:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998041.219026:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998041.219033:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998041.219036:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998041.219044:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998041.219050:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998041.219055:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998041.219088:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998041.219094:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789998041.219120:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998041.219132:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1200/0x65b43101d592e8f5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e8fc expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998041.219147:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998041.219149:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998041.219151:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998041.219158:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789998041.219167:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713107072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998041.219198:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998041.219368:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713107072 00000100:00100000:0.0:1789998041.219382:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713107072 00010000:00010000:0.0:1789998041.219401:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 19 pid: 7594 timeout: 2329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998041.219431:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789998041.219439:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713107072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998041.219448:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789998041.219454:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 19 pid: 7594 timeout: 2329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219463:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 19 pid: 7594 timeout: 2329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219479:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219487:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219501:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219516:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219522:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219528:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998041.219529:0:103334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b800/0x65b43101d592e8fc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e8f5 expref: 19 pid: 7594 timeout: 2329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219533:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789998041.219537:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998041.219541:0:103334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103334:1876946713106944:0@lo:104: 00010000:00010000:0.0:1789998041.219545:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219553:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998041.219555:0:103334:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998041.219561:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789998041.219568:0:103334:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998041.219574:0:103334:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998041.219632:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713107072:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998041.219638:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00010000:00010000:1.0:1789998041.219700:0:103334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592e903 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998041.219841:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713107072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998041.868098:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789998042.570875:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789998042.570883:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789998042.570889:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998042.570932:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998042.570944:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998042.570955:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998042.570980:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713107200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789998042.571045:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998042.571095:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789998042.571213:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713107200 00000100:00100000:3.0:1789998042.571220:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713107200 00000100:00100000:3.0:1789998042.571264:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1789998042.571274:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713107200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998042.571286:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998042.571299:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e90a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998042.571320:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e90a expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998042.571332:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e90a expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998042.571341:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052ac00, rc 0) 00000100:00100000:3.0:1789998042.571395:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713107200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998042.571402:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1789998042.571449:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713107200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998042.571462:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998042.571472:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998042.571493:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789998042.571498:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998042.571506:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998042.571649:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713107456:0@lo:400:kworker.0 00000100:00100000:0.0:1789998042.571708:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998042.571736:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789998042.571743:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713107328:0@lo:400:kworker.0 00000100:00100000:0.0:1789998042.571763:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998042.572068:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713107840:0@lo:400:kworker.0 00000100:00100000:0.0:1789998042.572095:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998042.572127:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713107456 00000100:00100000:0.0:1789998042.572135:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713107456 00000100:00100000:0.0:1789998042.572173:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713107328 00000100:00100000:0.0:1789998042.572176:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713107328 00000100:00100000:0.0:1789998042.572192:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713107840 00000100:00100000:0.0:1789998042.572194:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713107840 00000100:00100000:0.0:1789998042.572212:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:0.0:1789998042.572217:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713107456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998042.572256:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713107456:12345-0@lo:400:kworker.0 Request processed in 38us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998042.572262:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00100000:0.0:1789998042.572277:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:0.0:1789998042.572282:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713107328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998042.572309:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713107328:12345-0@lo:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998042.572315:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:0.0:1789998042.572327:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1789998042.572332:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713107840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998042.572371:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713107840:12345-0@lo:400:kworker.0 Request processed in 39us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998042.572377:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00080000:0.0:1789998042.572400:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998042.572432:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713107328:0@lo:400:kworker.0 00000100:00100000:0.0:1789998042.572441:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713107840:0@lo:400:kworker.0 00000100:00100000:0.0:1789998042.572453:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713107456:0@lo:400:kworker.0 00000100:00100000:2.0:1789998042.572542:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713107584:0@lo:400:kworker.0 00000100:00100000:2.0:1789998042.572578:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998042.572606:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789998042.572613:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713107712:0@lo:400:kworker.0 00000100:00100000:2.0:1789998042.572633:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998042.572942:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713107584 00000100:00100000:3.0:1789998042.572947:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713107584 00000100:00100000:3.0:1789998042.572989:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713107712 00000100:00100000:3.0:1789998042.572993:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713107712 00000100:00100000:3.0:1789998042.573011:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1789998042.573018:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713107584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998042.573062:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713107584:12345-0@lo:400:kworker.0 Request processed in 44us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998042.573068:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1789998042.573080:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1789998042.573086:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713107712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998042.573113:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713107712:12345-0@lo:400:kworker.0 Request processed in 27us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998042.573118:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1789998042.573152:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713107712:0@lo:400:kworker.0 00000100:00100000:3.0:1789998042.573163:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713107584:0@lo:400:kworker.0 00000100:00080000:2.0:1789998042.573415:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789998042.573420:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789998042.890885:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789998043.473641:0:103482:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfda17db0 20000000:00000080:0.0:1789998043.473683:0:103482:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c63e4c00 uarg=0000000000000000 10000000:01000000:0.0:1789998043.473878:0:103482:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998043.473897:0:103482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998043.473914:0:103482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e90a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998043.473922:0:103482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998043.473960:0:103482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e90a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998043.473975:0:103482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e90a expref: 18 pid: 5804 timeout: 2332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998043.473989:0:103482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103482:1876946713107968:0@lo:104: 00000100:00100000:0.0:1789998043.474051:0:103482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998043.474113:0:103482:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c576ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789998043.474188:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713107968 00000100:00100000:1.0:1789998043.474196:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713107968 00000100:00100000:1.0:1789998043.474251:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789998043.474261:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103482:x1876946713107968:12345-0@lo:104: 00010000:00010000:1.0:1789998043.474275:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998043.474354:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789998043.474359:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103482:x1876946713107968:12345-0@lo:104: Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998043.474366:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789998043.474433:0:103482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103482:1876946713107968:0@lo:104: 00010000:00010000:2.0:1789998043.474477:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998043.474485:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998043.474493:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998043.474496:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998043.474505:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998043.474512:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998043.474517:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789998043.474551:0:103482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998043.474553:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998043.474570:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789998043.474598:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998043.474605:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3a00/0x65b43101d592e90a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e911 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998043.474627:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998043.474630:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998043.474631:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998043.474722:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713108096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789998043.474752:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998043.474849:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713108096 00000100:00100000:3.0:1789998043.474854:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713108096 00010000:00010000:3.0:1789998043.474876:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e90a expref: 19 pid: 5804 timeout: 2332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998043.474944:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1789998043.474953:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713108096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998043.474964:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998043.474970:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e90a expref: 19 pid: 5804 timeout: 2332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.474979:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e90a expref: 19 pid: 5804 timeout: 2332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.474992:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052ac00/0x65b43101d592e911 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e90a expref: 19 pid: 5804 timeout: 2332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475007:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475014:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475025:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475031:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475037:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475042:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475047:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998043.475050:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475057:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475075:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998043.475083:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998043.475131:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713108096:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998043.475138:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00010000:00010000:0.0:1789998043.475189:0:103482:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998043.475198:0:103482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998043.475205:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713108096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998043.475206:0:103482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592e918 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998043.918156:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998044.162390:0:103530:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd29ff2c20 20000000:00000080:2.0:1789998044.162407:0:103530:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb3e3400 uarg=0000000000000000 10000000:01000000:2.0:1789998044.162604:0:103530:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998044.162623:0:103530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162639:0:103530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162649:0:103530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162874:0:103530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162881:0:103530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162888:0:103530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162895:0:103530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998044.162899:0:103530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162908:0:103530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162926:0:103530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162934:0:103530:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998044.162940:0:103530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592e91f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998044.447759:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998044.447799:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998044.447833:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998044.447835:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704639360 00000100:00100000:0.0:1789998044.447845:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704639360 00000100:00100000:3.0:1789998044.447856:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998044.447904:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1644 00000100:00100000:2.0:1789998044.447996:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704639232 00000100:00100000:3.0:1789998044.448000:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704639488 00000100:00100000:2.0:1789998044.448001:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704639232 00000100:00100000:3.0:1789998044.448003:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704639488 00000100:00100000:3.0:1789998044.448028:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704639616 00000100:00100000:3.0:1789998044.448031:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704639616 00000100:00100000:2.0:1789998044.448031:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1297 00000100:00100000:2.0:1789998044.448039:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704639232:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998044.448049:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 677 00000100:00100000:3.0:1789998044.448055:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704639488:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:3.0:1789998044.448076:0:8169:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592e22d 00000100:00080000:3.0:1789998044.448085:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a37c6937800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789998044.448105:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704639232:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 66us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998044.448112:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1297 00000001:00000004:3.0:1789998044.448119:0:8169:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00080000:2.0:1789998044.448138:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789998044.448142:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789998044.448144:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998044.448255:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 678 00000100:00100000:2.0:1789998044.448261:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704639616:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:2.0:1789998044.448273:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592e17e 00000100:00080000:2.0:1789998044.448279:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a37c6934000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789998044.448300:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:3.0:1789998044.448364:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704639488:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 308us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998044.448371:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 677 00010000:00010000:3.0:1789998044.448424:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998044.448438:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998044.448479:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704639360:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998044.448508:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704639360:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998044.448530:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+2:2351:x1876946704639616:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 196us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998044.448538:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 678 00000100:00100000:0.0:1789998044.451488:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1644 00000100:00100000:2.0:1789998044.622328:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713108224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998044.622396:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998044.622731:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713108224 00000100:00100000:1.0:1789998044.622739:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713108224 00000100:00100000:1.0:1789998044.622791:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1789998044.622799:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713108224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789998044.622829:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998044.622868:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713108224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998044.622875:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00080000:0.0:1789998044.622933:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789998044.625372:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713108352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789998044.625437:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998044.627561:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713108352 00000100:00100000:0.0:1789998044.627574:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713108352 00000100:00080000:1.0:1789998044.627643:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998044.627688:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1789998044.627699:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713108352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998044.627736:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998044.627822:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713108352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998044.627830:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:2.0:1789998044.628426:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f94da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713108224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789998044.628478:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713108352:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789998044.940647:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789998045.130971:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789998045.130980:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789998045.130986:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789998045.131035:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998045.131046:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998045.131057:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998045.131082:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713108480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998045.131152:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998045.131217:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5caacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789998045.131287:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713108480 00000100:00100000:3.0:1789998045.131304:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713108480 00000100:00100000:3.0:1789998045.131357:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1789998045.131368:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713108480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998045.131383:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998045.131397:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e926 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998045.131420:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e926 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998045.131431:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e926 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998045.131441:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789998045.131495:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713108480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998045.131503:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1789998045.131534:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713108480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998045.131550:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998045.131559:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998045.131578:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789998045.131583:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998045.131590:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998045.962757:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998046.988742:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789998047.036550:0:103726:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd822a4de0 20000000:00000080:1.0:1789998047.036569:0:103726:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4ceec00 uarg=0000000000000000 00010000:00010000:1.0:1789998047.037293:0:103726:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789998047.037309:0:103726:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1789998047.037321:0:103726:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789998047.037340:0:103726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998047.037357:0:103726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e926 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998047.037366:0:103726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998047.037491:0:103726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e926 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998047.037508:0:103726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e926 expref: 18 pid: 5804 timeout: 2335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998047.037524:0:103726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103726:1876946713108608:0@lo:104: 00000100:00100000:1.0:1789998047.037588:0:103726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998047.037767:0:103726:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789998047.038928:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713108608 00000100:00100000:3.0:1789998047.038939:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713108608 00000100:00100000:3.0:1789998047.038998:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789998047.039009:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103726:x1876946713108608:12345-0@lo:104: 00010000:00010000:3.0:1789998047.039024:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.039145:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998047.039152:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103726:x1876946713108608:12345-0@lo:104: Request processed in 145us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998047.039159:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789998047.039285:0:103726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103726:1876946713108608:0@lo:104: 00010000:00010000:1.0:1789998047.039306:0:103726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998047.039345:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998047.039352:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998047.039359:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998047.039363:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998047.039467:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998047.039477:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998047.039482:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998047.039555:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998047.039562:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789998047.039613:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789998047.039633:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998047.039641:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1c00/0x65b43101d592e926 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e92d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998047.039687:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998047.039689:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998047.039692:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998047.040277:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713108736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789998047.040330:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998047.040523:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713108736 00000100:00100000:3.0:1789998047.040530:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713108736 00010000:00010000:3.0:1789998047.040554:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e926 expref: 19 pid: 5804 timeout: 2335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998047.040620:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789998047.040630:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713108736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998047.040644:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998047.040649:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e926 expref: 19 pid: 5804 timeout: 2335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040691:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e926 expref: 19 pid: 5804 timeout: 2335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040708:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e92d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e926 expref: 19 pid: 5804 timeout: 2335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040723:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040732:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040748:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040756:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040763:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040769:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040774:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998047.040778:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040785:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040801:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998047.040810:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998047.040850:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713108736:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998047.040856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00010000:00010000:1.0:1789998047.040914:0:103726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998047.040922:0:103726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998047.040929:0:103726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2600/0x65b43101d592e934 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998047.041518:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713108736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998047.692227:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713108864:0@lo:400:kworker.0 00000100:00100000:2.0:1789998047.692305:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998047.692387:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713108864 00000100:00100000:0.0:1789998047.692396:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713108864 00000100:00100000:0.0:1789998047.692447:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1789998047.692456:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713108864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998047.692604:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713108864:12345-0@lo:400:kworker.0 Request processed in 148us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998047.692613:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1789998047.692734:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713109120:0@lo:400:kworker.0 00000100:00100000:0.0:1789998047.692777:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998047.692802:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789998047.692809:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713108992:0@lo:400:kworker.0 00000100:00100000:0.0:1789998047.692835:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998047.692862:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713109248:0@lo:400:kworker.0 00000100:00100000:0.0:1789998047.692894:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998047.693015:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713109120 00000100:00100000:0.0:1789998047.693020:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713109120 00000100:00100000:0.0:1789998047.693055:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713108992 00000100:00100000:0.0:1789998047.693058:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713108992 00000100:00100000:0.0:1789998047.693078:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:0.0:1789998047.693085:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713109120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998047.693121:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713109120:12345-0@lo:400:kworker.0 Request processed in 37us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998047.693128:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00000100:00100000:0.0:1789998047.693140:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1789998047.693146:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713108992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998047.693169:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713108992:12345-0@lo:400:kworker.0 Request processed in 23us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998047.693175:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1789998047.693195:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713109248 00000100:00100000:0.0:1789998047.693198:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713109248 00000100:00100000:0.0:1789998047.693229:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:0.0:1789998047.693237:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713109248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998047.693286:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713109248:12345-0@lo:400:kworker.0 Request processed in 50us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998047.693292:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1789998047.693626:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713108864:0@lo:400:kworker.0 00000100:00100000:2.0:1789998047.693646:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713109376:0@lo:400:kworker.0 00000100:00080000:1.0:1789998047.693718:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789998047.693723:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998047.693866:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998047.693940:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713109504:0@lo:400:kworker.0 00000100:00100000:2.0:1789998047.693965:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998047.693990:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713109504 00000100:00100000:2.0:1789998047.693994:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713109504 00000100:00100000:2.0:1789998047.694028:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:2.0:1789998047.694034:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713109504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998047.694073:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713109504:12345-0@lo:400:kworker.0 Request processed in 39us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998047.694079:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00080000:2.0:1789998047.694095:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998047.694112:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713109504:0@lo:400:kworker.0 00000100:00100000:3.0:1789998047.694191:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713109248:0@lo:400:kworker.0 00000100:00100000:3.0:1789998047.694218:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713108992:0@lo:400:kworker.0 00000100:00100000:3.0:1789998047.694228:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713109120:0@lo:400:kworker.0 00000100:00100000:1.0:1789998047.697633:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713109376 00000100:00100000:1.0:1789998047.697647:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713109376 00000100:00100000:1.0:1789998047.697856:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:1.0:1789998047.697867:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713109376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998047.697953:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713109376:12345-0@lo:400:kworker.0 Request processed in 89us (4088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998047.697961:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00080000:1.0:1789998047.697992:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998047.698030:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713109376:0@lo:400:kworker.0 00010000:00010000:3.0:1789998048.010931:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789998048.715851:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789998048.715859:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789998048.715864:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789998048.715913:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998048.715925:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998048.715937:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998048.715965:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713109632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998048.716032:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998048.716078:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee4cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789998048.716097:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713109632 00000100:00100000:3.0:1789998048.716104:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713109632 00000100:00100000:3.0:1789998048.716165:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1789998048.716174:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713109632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998048.716187:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998048.716199:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e93b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998048.716233:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e93b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998048.716246:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e93b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998048.716257:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789998048.716300:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713109632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998048.716308:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:3.0:1789998048.716365:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85dbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713109632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998048.716381:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998048.716390:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998048.716412:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789998048.716418:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998048.716425:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789998048.745758:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789998048.745767:0:7614:0:(genops.c:885:class_export_put()) final put ffff8a37c6933000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789998048.745870:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c6933000/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0001 00000020:00000080:1.0:1789998048.745919:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c6934000 for lustre-OST0001 00000001:00100000:0.0:1789998048.764437:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:0.0:1789998048.764445:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a37c6930800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:1.0:1789998048.764535:0:84165:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c6930800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-OST0000 00000020:00000080:1.0:1789998048.764793:0:84165:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c6937800 for lustre-OST0000 00010000:00010000:3.0:1789998049.035819:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998049.559678:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998049.559716:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998049.559744:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704639872 00000100:00100000:2.0:1789998049.559754:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704639872 00000100:00100000:2.0:1789998049.559815:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1648 00000100:00100000:2.0:1789998049.559827:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704639872:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998049.559891:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2355:x1876946704639872:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998049.559898:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1648 00000100:00100000:1.0:1789998049.560067:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704639744 00000100:00100000:1.0:1789998049.560073:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704639744 00000100:00100000:1.0:1789998049.560108:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1301 00000100:00100000:1.0:1789998049.560117:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704639744:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998049.560147:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704639744:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 32us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998049.560154:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1301 00000100:00080000:1.0:1789998049.560181:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998049.739918:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713109760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998049.740539:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998049.740621:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713109760 00000100:00100000:1.0:1789998049.740627:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713109888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998049.740628:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713109760 00000100:00100000:1.0:1789998049.740671:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998049.740690:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713109888 00000100:00100000:2.0:1789998049.740693:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713109888 00000100:00100000:1.0:1789998049.740707:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:2.0:1789998049.740852:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:2.0:1789998049.740862:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713109888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789998049.740898:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998049.740945:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713109888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998049.741072:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00080000:2.0:1789998049.741098:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789998049.741103:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998049.741139:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713109888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998049.741414:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713109760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789998049.741453:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998049.741502:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713109760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 787us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998049.741509:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:2.0:1789998049.741534:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713109760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789998050.064484:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998050.554598:0:103972:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc881e1070 20000000:00000080:2.0:1789998050.554617:0:103972:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb3e3400 uarg=0000000000000000 00010000:00010000:2.0:1789998050.558289:0:103972:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789998050.558310:0:103972:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789998050.558401:0:103972:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998050.558421:0:103972:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998050.558437:0:103972:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e93b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998050.558446:0:103972:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998050.558483:0:103972:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e93b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998050.558498:0:103972:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e93b expref: 18 pid: 5804 timeout: 2339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998050.558512:0:103972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103972:1876946713110016:0@lo:104: 00000100:00100000:2.0:1789998050.558576:0:103972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998050.558725:0:103972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fd95fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789998050.558870:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713110016 00000100:00100000:3.0:1789998050.558878:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713110016 00000100:00100000:3.0:1789998050.558931:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789998050.558940:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103972:x1876946713110016:12345-0@lo:104: 00010000:00010000:3.0:1789998050.558952:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.559033:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998050.559039:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:103972:x1876946713110016:12345-0@lo:104: Request processed in 101us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998050.559044:0:103972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38e0c62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103972:1876946713110016:0@lo:104: 00000100:00100000:3.0:1789998050.559050:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:2.0:1789998050.559069:0:103972:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998050.559120:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998050.559127:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998050.559136:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789998050.559139:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998050.559148:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998050.559156:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998050.559162:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789998050.559205:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998050.559212:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789998050.559255:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713110144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998050.559288:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789998050.559342:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998050.559351:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592e93b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e942 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998050.559368:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998050.559371:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998050.559373:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998050.559688:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713110144 00000100:00100000:3.0:1789998050.559694:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713110144 00010000:00010000:3.0:1789998050.560574:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e93b expref: 19 pid: 5804 timeout: 2339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998050.560617:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:3.0:1789998050.560626:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d00c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713110144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998050.560641:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998050.560648:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e93b expref: 19 pid: 5804 timeout: 2339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560693:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e93b expref: 19 pid: 5804 timeout: 2339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560723:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e942 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e93b expref: 19 pid: 5804 timeout: 2339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560739:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560758:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560776:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560784:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560791:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560798:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560804:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998050.560809:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560817:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560841:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998050.560852:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998050.560912:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d00c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713110144:12345-0@lo:103:ldlm_bl.0 Request processed in 287us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998050.560920:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789998050.561006:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713110144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998050.561185:0:103972:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998050.561205:0:103972:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998050.561211:0:103972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592e949 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103972 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998051.082930:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789998051.164015:0:104022:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd5f6dfa0 20000000:00000080:3.0:1789998051.164036:0:104022:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c333c400 uarg=0000000000000000 00010000:00010000:3.0:1789998051.166113:0:104022:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789998051.166134:0:104022:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789998051.166157:0:104022:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998051.166192:0:104022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166209:0:104022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166220:0:104022:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166227:0:104022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166233:0:104022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166240:0:104022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166265:0:104022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998051.166269:0:104022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166277:0:104022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166293:0:104022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166302:0:104022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998051.166308:0:104022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592e950 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789998051.729941:0:104070:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3754b7c0 20000000:00000080:2.0:1789998051.729962:0:104070:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c3338c00 uarg=0000000000000000 00010000:00010000:2.0:1789998051.730229:0:104070:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789998051.730246:0:104070:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789998051.730264:0:104070:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998051.730286:0:104070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730303:0:104070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730316:0:104070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730324:0:104070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730331:0:104070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730339:0:104070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730346:0:104070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998051.730351:0:104070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730359:0:104070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730373:0:104070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730381:0:104070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998051.730388:0:104070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e957 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998052.107789:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789998052.490836:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789998052.490844:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789998052.490849:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789998052.490898:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998052.490912:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998052.490924:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998052.490964:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713110272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998052.491034:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998052.491120:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32da480 going to sleep for 11 seconds 00000100:00100000:0.0:1789998052.491201:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713110272 00000100:00100000:0.0:1789998052.491223:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713110272 00000100:00100000:0.0:1789998052.491278:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1789998052.491287:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713110272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998052.491300:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998052.491313:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e95e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998052.491336:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e95e expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998052.491347:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e95e expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998052.491356:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1200, rc 0) 00000100:00100000:0.0:1789998052.491402:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713110272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998052.491409:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1789998052.491976:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85d8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713110272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998052.491996:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998052.492006:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998052.492028:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789998052.492033:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998052.492041:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998052.812026:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713110400:0@lo:400:kworker.0 00000100:00100000:0.0:1789998052.812078:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713110656:0@lo:400:kworker.0 00000100:00100000:0.0:1789998052.812122:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998052.812123:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998052.812257:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713110528:0@lo:400:kworker.0 00000100:00100000:0.0:1789998052.812312:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789998052.812319:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713110784:0@lo:400:kworker.0 00000100:00100000:2.0:1789998052.813595:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713110912:0@lo:400:kworker.0 00000100:00100000:2.0:1789998052.813649:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998052.813717:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713110656 00000100:00100000:2.0:1789998052.813726:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713110656 00000100:00100000:2.0:1789998052.813861:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1789998052.813871:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713110656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998052.813993:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713110656:12345-0@lo:400:kworker.0 Request processed in 122us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998052.814001:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1789998052.814030:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713110400 00000100:00100000:2.0:1789998052.814034:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713110400 00000100:00100000:2.0:1789998052.814057:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713110912 00000100:00100000:2.0:1789998052.814060:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713110912 00000100:00100000:2.0:1789998052.814082:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:2.0:1789998052.814089:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713110400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998052.814124:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713110400:12345-0@lo:400:kworker.0 Request processed in 36us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998052.814130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00100000:2.0:1789998052.814158:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:2.0:1789998052.814167:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fadf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713110912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998052.814194:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fadf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713110912:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998052.814200:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00080000:2.0:1789998052.814220:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789998052.814225:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998052.814261:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713110912:0@lo:400:kworker.0 00000100:00100000:2.0:1789998052.814352:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713110400:0@lo:400:kworker.0 00000100:00100000:1.0:1789998052.814502:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998052.814538:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713110528 00000100:00100000:1.0:1789998052.814542:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713110528 00000100:00100000:1.0:1789998052.814572:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:1.0:1789998052.814579:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713110528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998052.814613:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713110528:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998052.814618:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00080000:1.0:1789998052.814633:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998052.814650:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713110528:0@lo:400:kworker.0 00000100:00100000:0.0:1789998052.819557:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998052.819638:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713110656:0@lo:400:kworker.0 00000100:00100000:1.0:1789998052.820529:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713110784 00000100:00100000:1.0:1789998052.820539:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713110784 00000100:00100000:1.0:1789998052.820623:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1789998052.820634:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713110784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998052.820737:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713110784:12345-0@lo:400:kworker.0 Request processed in 105us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998052.820744:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00080000:2.0:1789998052.820839:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998052.820912:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713110784:0@lo:400:kworker.0 00010000:00010000:1.0:1789998053.130907:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998054.154949:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789998054.661572:0:104266:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff02784eb0 20000000:00000080:3.0:1789998054.661590:0:104266:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c08400 uarg=0000000000000000 00010000:00010000:3.0:1789998054.662154:0:104266:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789998054.662387:0:104266:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789998054.662412:0:104266:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998054.662432:0:104266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998054.662450:0:104266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e95e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998054.662458:0:104266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998054.662496:0:104266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e95e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998054.662511:0:104266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e95e expref: 18 pid: 5804 timeout: 2343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998054.662524:0:104266:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104266:1876946713111040:0@lo:104: 00000100:00100000:3.0:1789998054.662585:0:104266:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998054.662945:0:104266:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3f84d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789998054.663145:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713111040 00000100:00100000:0.0:1789998054.663153:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713111040 00000100:00100000:0.0:1789998054.663307:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789998054.663318:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:104266:x1876946713111040:12345-0@lo:104: 00010000:00010000:0.0:1789998054.663333:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998054.663409:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998054.663415:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:104266:x1876946713111040:12345-0@lo:104: Request processed in 100us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998054.663422:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789998054.663497:0:104266:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104266:1876946713111040:0@lo:104: 00010000:00010000:1.0:1789998054.663520:0:104266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663571:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998054.663578:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663585:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998054.663588:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663596:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998054.663602:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998054.663608:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998054.663683:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663690:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789998054.663711:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663719:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a600/0x65b43101d592e95e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e965 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663734:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998054.663736:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998054.663738:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998054.663751:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713111168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998054.663787:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998054.663825:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713111168 00000100:00100000:2.0:1789998054.663829:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713111168 00010000:00010000:2.0:1789998054.663849:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e95e expref: 19 pid: 5804 timeout: 2343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998054.663875:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789998054.663882:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713111168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998054.663892:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998054.663897:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e95e expref: 19 pid: 5804 timeout: 2343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663906:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e95e expref: 19 pid: 5804 timeout: 2343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663919:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592e965 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e95e expref: 19 pid: 5804 timeout: 2343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663932:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663940:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663952:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663959:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663969:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663975:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663980:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998054.663984:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.663991:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.664002:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998054.664011:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998054.664039:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713111168:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998054.664046:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789998054.664079:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713111168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998054.664541:0:104266:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998054.664550:0:104266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998054.664557:0:104266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a400/0x65b43101d592e96c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998054.682538:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998054.682589:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998054.682634:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704640000 00000100:00100000:0.0:1789998054.682668:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704640000 00000100:00100000:0.0:1789998054.682728:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1303 00000100:00100000:0.0:1789998054.682738:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704640000:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998054.682821:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2353:x1876946704640000:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998054.682829:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1303 00000100:00100000:2.0:1789998054.683764:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704640128 00000100:00100000:2.0:1789998054.683774:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704640128 00000100:00100000:2.0:1789998054.683841:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1652 00000100:00100000:2.0:1789998054.683863:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704640128:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:1.0:1789998054.683991:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998054.684849:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2353:x1876946704640128:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 995us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998054.684863:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1652 00000100:00100000:0.0:1789998054.858833:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38ffdc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713111296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998054.858900:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998054.858970:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713111296 00000100:00100000:0.0:1789998054.858979:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713111296 00000100:00100000:0.0:1789998054.859031:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1789998054.859041:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713111296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998054.859076:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998054.859133:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713111296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998054.859144:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00080000:0.0:1789998054.859175:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998054.859213:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38ffdc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713111296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998054.859506:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713111424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998054.859536:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998054.859923:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713111424 00000100:00100000:0.0:1789998054.859929:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713111424 00000100:00100000:0.0:1789998054.860008:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1789998054.860017:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713111424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998054.860040:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998054.860080:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713111424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998054.860087:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:0.0:1789998054.860141:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713111424:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789998054.862249:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789998055.180497:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998056.207458:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789998056.459591:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789998056.459599:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789998056.459605:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789998056.459764:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998056.459777:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998056.459790:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998056.459819:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713111552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789998056.460047:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998056.460113:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c32da480 going to sleep for 11 seconds 00000100:00100000:0.0:1789998056.460926:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713111552 00000100:00100000:0.0:1789998056.460936:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713111552 00000100:00100000:0.0:1789998056.461055:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:0.0:1789998056.461066:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713111552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998056.461090:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998056.461108:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e973 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998056.461136:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e973 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998056.461147:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e973 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998056.461156:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789998056.461219:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713111552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998056.461226:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1789998056.461316:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713111552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998056.461332:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998056.461341:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998056.461362:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789998056.461366:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998056.461373:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998057.227145:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998057.931029:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713111936:0@lo:400:kworker.0 00000100:00100000:0.0:1789998057.931108:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998057.931174:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789998057.931180:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713112064:0@lo:400:kworker.0 00000100:00100000:0.0:1789998057.931209:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998057.931248:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713112064 00000100:00100000:0.0:1789998057.931256:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713112064 00000100:00100000:2.0:1789998057.931281:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713111680:0@lo:400:kworker.0 00000100:00100000:0.0:1789998057.931312:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1789998057.931328:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713112064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998057.931329:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998057.931365:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713112192:0@lo:400:kworker.0 00000100:00100000:0.0:1789998057.931391:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713112064:12345-0@lo:400:kworker.0 Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998057.931398:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00080000:0.0:1789998057.931418:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998057.931431:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713111680 00000100:00100000:0.0:1789998057.931434:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713111680 00000100:00100000:0.0:1789998057.931457:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1789998057.931463:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713111680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998057.931495:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713111680:12345-0@lo:400:kworker.0 Request processed in 32us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998057.931500:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1789998057.931546:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713112064:0@lo:400:kworker.0 00000100:00100000:3.0:1789998057.931775:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713111808:0@lo:400:kworker.0 00000100:00100000:3.0:1789998057.931807:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998057.931807:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713111936 00000100:00100000:2.0:1789998057.931824:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998057.931862:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713111680:0@lo:400:kworker.0 00000100:00100000:3.0:1789998057.931872:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713112320:0@lo:400:kworker.0 00000100:00100000:2.0:1789998057.931889:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713111808 00000100:00100000:2.0:1789998057.931894:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713111808 00000100:00100000:3.0:1789998057.931899:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998057.931900:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713111936 00000100:00100000:2.0:1789998057.931933:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713112320 00000100:00100000:2.0:1789998057.931937:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713112320 00000100:00100000:3.0:1789998057.931946:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713112192 00000100:00100000:1.0:1789998057.931946:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:3.0:1789998057.931953:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713112192 00000100:00100000:1.0:1789998057.931961:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713111808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998057.931972:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:2.0:1789998057.931982:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713111936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998057.931990:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1789998057.932001:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713112192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998057.932016:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713111808:12345-0@lo:400:kworker.0 Request processed in 58us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998057.932025:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:2.0:1789998057.932040:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713111936:12345-0@lo:400:kworker.0 Request processed in 58us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998057.932060:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:3.0:1789998057.932066:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713112192:12345-0@lo:400:kworker.0 Request processed in 67us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998057.932071:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713112320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998057.932077:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1789998057.932112:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713112320:12345-0@lo:400:kworker.0 Request processed in 44us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998057.932119:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:3.0:1789998057.932125:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713112192:0@lo:400:kworker.0 00000100:00100000:1.0:1789998057.932170:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713111808:0@lo:400:kworker.0 00000100:00100000:1.0:1789998057.932179:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713112320:0@lo:400:kworker.0 00000100:00080000:1.0:1789998057.932209:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998057.932214:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998057.932228:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713111936:0@lo:400:kworker.0 00000100:00100000:2.0:1789998057.932541:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00010000:00010000:1.0:1789998058.250849:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998059.277737:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998059.800881:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998059.800938:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998059.801110:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704640384 00000100:00100000:2.0:1789998059.801122:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704640384 00000100:00100000:2.0:1789998059.801204:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1656 00000100:00100000:2.0:1789998059.801215:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704640384:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998059.801306:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2352:x1876946704640384:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998059.801313:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1656 00000100:00080000:1.0:1789998059.801541:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789998059.802167:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704640256 00000100:00100000:3.0:1789998059.802175:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704640256 00000100:00100000:3.0:1789998059.802221:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1306 00000100:00100000:3.0:1789998059.802228:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704640256:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998059.802624:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2352:x1876946704640256:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 395us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998059.802632:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1306 00000100:00100000:2.0:1789998059.979447:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789998059.979473:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713112448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998059.979569:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998059.979648:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713112576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998059.979696:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998059.979817:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713112448 00000100:00100000:1.0:1789998059.979827:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713112448 00000100:00100000:1.0:1789998059.979896:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713112576 00000100:00100000:1.0:1789998059.979899:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713112576 00000100:00100000:1.0:1789998059.979918:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:1.0:1789998059.979928:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713112448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998059.979964:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998059.980034:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713112448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998059.980042:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1789998059.980048:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1789998059.980057:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713112576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789998059.980077:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998059.980086:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713112448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789998059.980104:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713112576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998059.980108:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38c85da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713112576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789998059.980110:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00080000:0.0:1789998059.980202:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789998059.980208:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789998060.298743:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998061.323024:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789998061.867803:0:104609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25a: test save and reload nodemap config ========================================================== 09:41:00 (1789998060) 00010000:00010000:0.0:1789998062.348635:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998062.801251:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998062.801915:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704640512 00000100:00100000:1.0:1789998062.801924:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704640512 00000100:00100000:1.0:1789998062.802074:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1256 00000100:00100000:1.0:1789998062.802085:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:62887:x1876946704640512:12345-192.168.204.4@tcp:101:lsof.0 00010000:00010000:1.0:1789998062.802107:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998062.802196:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e981 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2ca expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998062.802270:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e988 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998062.802285:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998062.802300:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789998062.802336:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789998062.802340:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789998062.802408:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e988 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998062.802434:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3000/0x65b43101d592e981 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2ca expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998062.802450:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e988 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2ca expref: 6 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998062.802458:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789998062.802461:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789998062.802465:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2e00, rc 0) 00000100:00100000:1.0:1789998062.802543:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:62887:x1876946704640512:12345-192.168.204.4@tcp:101:lsof.0 Request processed in 460us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998062.802550:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1256 00000100:00080000:0.0:1789998062.803124:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998063.051110:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713112960:0@lo:400:kworker.0 00000100:00100000:3.0:1789998063.051159:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713112832:0@lo:400:kworker.0 00000100:00100000:0.0:1789998063.051186:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998063.051215:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998063.051298:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713112704:0@lo:400:kworker.0 00000100:00100000:1.0:1789998063.051337:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998063.051417:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713113088:0@lo:400:kworker.0 00000100:00100000:2.0:1789998063.051451:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998063.051480:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713112960 00000100:00100000:2.0:1789998063.051488:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713112960 00000100:00100000:0.0:1789998063.051579:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713112704 00000100:00100000:0.0:1789998063.051583:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713112704 00000100:00100000:0.0:1789998063.051616:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:0.0:1789998063.051624:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713112704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998063.051692:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713112704:12345-0@lo:400:kworker.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998063.051700:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:0.0:1789998063.051731:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713113088 00000100:00100000:0.0:1789998063.051734:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713113088 00000100:00100000:0.0:1789998063.051762:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1789998063.051768:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713113088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998063.051805:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713113088:12345-0@lo:400:kworker.0 Request processed in 37us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998063.051811:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00080000:0.0:1789998063.051832:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789998063.051837:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998063.051866:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713113088:0@lo:400:kworker.0 00000100:00100000:1.0:1789998063.052286:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713112832 00000100:00100000:1.0:1789998063.052292:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713112832 00000100:00100000:2.0:1789998063.052830:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:2.0:1789998063.052841:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713112960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998063.052893:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713112960:12345-0@lo:400:kworker.0 Request processed in 55us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998063.052899:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:0.0:1789998063.054057:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713112704:0@lo:400:kworker.0 00000100:00100000:0.0:1789998063.054071:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713113216:0@lo:400:kworker.0 00000100:00100000:0.0:1789998063.054114:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998063.054177:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713113216 00000100:00100000:0.0:1789998063.054184:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713113216 00000100:00100000:0.0:1789998063.054228:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1789998063.054236:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713113216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998063.054280:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713113216:12345-0@lo:400:kworker.0 Request processed in 46us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998063.054287:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:0.0:1789998063.054311:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998063.054333:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6def480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713113216:0@lo:400:kworker.0 00000100:00100000:0.0:1789998063.054391:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713112960:0@lo:400:kworker.0 00000100:00100000:3.0:1789998063.054398:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713113344:0@lo:400:kworker.0 00000100:00100000:3.0:1789998063.054436:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998063.054579:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713113344 00000100:00100000:1.0:1789998063.054584:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713113344 00000100:00100000:3.0:1789998063.054614:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1789998063.054622:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:3.0:1789998063.054627:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713112832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998063.054635:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c85da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713113344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998063.054706:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713112832:12345-0@lo:400:kworker.0 Request processed in 84us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998063.054715:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c85da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713113344:12345-0@lo:400:kworker.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998063.054716:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00100000:1.0:1789998063.054727:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00080000:1.0:1789998063.054759:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789998063.054762:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713112832:0@lo:400:kworker.0 00000100:00100000:3.0:1789998063.054776:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713113344:0@lo:400:kworker.0 00010000:00010000:2.0:1789998063.371687:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998063.625363:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998063.625392:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998063.625512:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998063.625713:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704640768 00000100:00100000:3.0:1789998063.625717:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704640640 00000100:00100000:3.0:1789998063.625724:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704640640 00000100:00100000:0.0:1789998063.625725:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704640768 00000100:00100000:3.0:1789998063.625782:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704641024 00000100:00100000:3.0:1789998063.625786:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704641024 00000100:00100000:0.0:1789998063.625794:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:0.0:1789998063.625809:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+12:2352:x1876946704640640:12345-192.168.204.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789998063.625811:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:3.0:1789998063.625824:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+12:2352:x1876946704640768:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789998063.625830:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998063.625835:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789998063.625835:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 21 00000100:00100000:2.0:1789998063.625844:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+12:2354:x1876946704641024:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789998063.625851:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38c0031800/0x65b43101d5928391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae1eb expref: 12 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998063.625852:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789998063.625853:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d5928440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae223 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998063.625861:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38c27df200/0x65b43101d59284b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae238 expref: 12 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998063.625868:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789998063.625869:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998063.625927:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+10:2354:x1876946704641024:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 84us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998063.625948:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 21 00010000:00010000:0.0:1789998063.625978:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998063.626085:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+8:2352:x1876946704640768:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 262us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998063.626097:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+8:2352:x1876946704640640:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 287us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998063.626100:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 20 00000100:00100000:0.0:1789998063.626115:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 19 00000100:00100000:3.0:1789998063.626999:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998063.627037:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704641152 00000100:00100000:0.0:1789998063.627042:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704641152 00000100:00100000:0.0:1789998063.627086:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1257 00000100:00100000:0.0:1789998063.627095:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+6:2351:x1876946704641152:12345-192.168.204.4@tcp:39:umount.0 00000020:00000080:0.0:1789998063.627131:0:5812:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592839f 00000020:00010000:0.0:1789998063.627140:0:5812:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a37c55df800: total 0 00000100:00080000:0.0:1789998063.627144:0:5812:0:(import.c:65:import_set_state_nolock()) ffff8a37c55db800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789998063.627182:0:5812:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967777 00000100:00100000:0.0:1789998063.627999:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f94d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dca90b7a-8ebc-4a6c-9659-0ee79e2da878+5:2351:x1876946704641152:12345-192.168.204.4@tcp:39:umount.0 Request processed in 902us (999us total) trans 4294967778 rc 0/0 00000020:00010000:1.0:1789998063.628009:0:5798:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a37c55df800: total 0 00000100:00100000:0.0:1789998063.628009:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1257 00010000:00010000:1.0:1789998063.628052:0:5798:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55df800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789998063.628081:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062db00) 00010000:00010000:1.0:1789998063.628086:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789998063.628094:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2e00/0x65b43101d592e988 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2ca expref: 4 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998063.628112:0:5798:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55df800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789998063.628119:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998063.628121:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998063.628122:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998063.648126:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998063.648695:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704641408 00000100:00100000:3.0:1789998063.648706:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704641408 00000100:00100000:3.0:1789998063.648772:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1308 00000100:00100000:3.0:1789998063.648784:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+7:2351:x1876946704641408:12345-192.168.204.4@tcp:251:umount.0 00000020:00000080:3.0:1789998063.648831:0:5805:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592837c 00000020:00010000:3.0:1789998063.648840:0:5805:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a37c55dd800: total 0 00000100:00080000:3.0:1789998063.648845:0:5805:0:(import.c:65:import_set_state_nolock()) ffff8a37c55d8800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789998063.648943:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e05b6c2-1c0a-4120-ac29-13df1e35c85c+3:2351:x1876946704641408:12345-192.168.204.4@tcp:251:umount.0 Request processed in 151us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998063.648951:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1308 00000020:00010000:1.0:1789998063.650324:0:6673:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a37c55dd800: total 0 00010000:00010000:1.0:1789998063.650387:0:6673:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c55dd800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789998063.650429:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2200/0x65b43101d5928447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aae22a expref: 2 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998063.650447:0:6673:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c55dd800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789998063.650457:0:6673:0:(genops.c:885:class_export_put()) final put ffff8a37c55dd800/0e05b6c2-1c0a-4120-ac29-13df1e35c85c 00010000:00010000:1.0:1789998063.650480:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998063.650483:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998063.650485:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998063.650705:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c55dd800/0e05b6c2-1c0a-4120-ac29-13df1e35c85c for MGS 00000020:00000080:2.0:1789998063.650748:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c55d8800 for MGS 00010000:00010000:2.0:1789998064.396981:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1789998064.684251:0:104658:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1789998064.684256:0:104658:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:1.0:1789998065.098857:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789998065.098883:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713113472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998065.098975:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998065.099478:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713113472 00000100:00100000:0.0:1789998065.099487:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713113472 00000100:00100000:0.0:1789998065.099680:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1789998065.099691:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713113472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998065.099734:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998065.099799:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713113472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998065.099807:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1789998065.099837:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713113600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998065.099867:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998065.099917:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713113600 00000100:00100000:0.0:1789998065.099922:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713113600 00000100:00100000:2.0:1789998065.100160:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713113472:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789998065.106497:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998065.106585:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998065.106919:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1789998065.106935:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713113600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998065.106983:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998065.107083:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713113600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (7213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998065.107090:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1789998065.108983:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713113600:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1789998065.412460:0:104706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea5a55af0 20000000:00000080:2.0:1789998065.412481:0:104706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fad8d400 uarg=0000000000000000 10000000:01000000:2.0:1789998065.413378:0:104706:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998065.413403:0:104706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998065.413425:0:104706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e973 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998065.413434:0:104706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998065.413478:0:104706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e973 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998065.413495:0:104706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e973 expref: 18 pid: 5804 timeout: 2354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998065.413510:0:104706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104706:1876946713113728:0@lo:104: 00000100:00100000:2.0:1789998065.413581:0:104706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998065.416051:0:104706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789998065.416648:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713113728 00000100:00100000:1.0:1789998065.417211:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713113728 00000100:00100000:1.0:1789998065.417312:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789998065.417323:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:104706:x1876946713113728:12345-0@lo:104: 00010000:00010000:1.0:1789998065.417347:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998065.417456:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789998065.417462:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:104706:x1876946713113728:12345-0@lo:104: Request processed in 143us (3883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998065.417469:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:0.0:1789998065.417521:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998065.417530:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417537:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789998065.417542:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417552:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998065.417559:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998065.417564:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789998065.417614:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417621:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998065.417647:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417687:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3a00/0x65b43101d592e973 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e97a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417704:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998065.417707:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998065.417709:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998065.417740:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713113856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789998065.417779:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998065.417851:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713113856 00000100:00100000:0.0:1789998065.417855:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713113856 00010000:00010000:0.0:1789998065.417879:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e973 expref: 19 pid: 5804 timeout: 2354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998065.417914:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789998065.417922:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713113856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998065.417935:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789998065.417940:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e973 expref: 19 pid: 5804 timeout: 2354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417952:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e973 expref: 19 pid: 5804 timeout: 2354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417971:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417979:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.417996:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.418004:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.418010:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.418018:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.418023:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789998065.418027:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.418034:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.418044:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998065.418053:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789998065.418083:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713113856:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998065.418089:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:0.0:1789998065.418141:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713113856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998065.418377:0:104706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e97a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e973 expref: 18 pid: 5804 timeout: 2354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998065.418404:0:104706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104706:1876946713113728:0@lo:104: 00010000:00010000:2.0:1789998065.418419:0:104706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998065.418428:0:104706:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998065.418434:0:104706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998065.418441:0:104706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592e98f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998065.421711:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789998066.105190:0:104754:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce79e57d0 20000000:00000080:0.0:1789998066.105206:0:104754:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f847b400 uarg=0000000000000000 10000000:01000000:0.0:1789998066.105418:0:104754:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998066.105437:0:104754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105453:0:104754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105464:0:104754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105476:0:104754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105483:0:104754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105490:0:104754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105497:0:104754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789998066.105502:0:104754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105511:0:104754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105524:0:104754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105532:0:104754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.105539:0:104754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592e996 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789998066.149069:0:5832:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000001:00080000:0.0:1789998066.149085:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967778 is committed 00000020:00000080:0.0:1789998066.149091:0:5832:0:(genops.c:885:class_export_put()) final put ffff8a37c55df800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 00000020:00000080:3.0:1789998066.149205:0:485:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c55df800/dca90b7a-8ebc-4a6c-9659-0ee79e2da878 for lustre-MDT0000 00000020:00000080:3.0:1789998066.149267:0:485:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c55db800 for lustre-MDT0000 00010000:00010000:2.0:1789998066.443964:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789998066.689048:0:104805:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd59dea810 20000000:00000080:0.0:1789998066.689068:0:104805:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa6800 uarg=0000000000000000 10000000:01000000:0.0:1789998066.689514:0:104805:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998066.689541:0:104805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689561:0:104805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689574:0:104805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689581:0:104805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689589:0:104805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689597:0:104805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689604:0:104805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789998066.689609:0:104805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689618:0:104805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689633:0:104805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689640:0:104805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998066.689682:0:104805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592e99d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789998067.313719:0:104853:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda46e23f0 20000000:00000080:1.0:1789998067.313840:0:104853:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4d15c00 uarg=0000000000000000 10000000:01000000:1.0:1789998067.314146:0:104853:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789998067.314171:0:104853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314189:0:104853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314201:0:104853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314279:0:104853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314288:0:104853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314295:0:104853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314301:0:104853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789998067.314307:0:104853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314316:0:104853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314332:0:104853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314340:0:104853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998067.314347:0:104853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592e9a4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998067.339718:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789998067.339727:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789998067.339732:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789998067.339790:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.339803:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.339816:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998067.339842:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713113984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998067.339923:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998067.339979:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789998067.343253:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713113984 00000100:00100000:3.0:1789998067.343273:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713113984 00000100:00100000:3.0:1789998067.343360:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:3.0:1789998067.343371:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713113984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998067.343395:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998067.343419:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e9ab expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998067.343450:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e9ab expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998067.343462:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e9ab expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998067.343472:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052aa00, rc 0) 00000100:00100000:3.0:1789998067.343563:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713113984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (3639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998067.343570:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1789998067.343833:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713113984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998067.343854:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.343878:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998067.343905:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789998067.343912:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.344003:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998067.468280:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789998067.991073:0:104901:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0a12f0f0 20000000:00000080:0.0:1789998067.991093:0:104901:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fafa6800 uarg=0000000000000000 10000000:01000000:0.0:1789998067.991292:0:104901:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998067.991312:0:104901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.991331:0:104901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e9ab expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.991339:0:104901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.991379:0:104901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e9ab expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.991394:0:104901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e9ab expref: 18 pid: 5803 timeout: 2356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998067.991408:0:104901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104901:1876946713114112:0@lo:104: 00000100:00100000:0.0:1789998067.991475:0:104901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998067.992570:0:104901:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3e9fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789998067.993835:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789998067.993869:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713114112 00000100:00100000:3.0:1789998067.993879:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713114112 00000100:00100000:3.0:1789998067.993980:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789998067.993992:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c333c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:104901:x1876946713114112:12345-0@lo:104: 00010000:00010000:3.0:1789998067.994010:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998067.994108:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998067.994114:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c333c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:104901:x1876946713114112:12345-0@lo:104: Request processed in 125us (2639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998067.994121:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1789998067.994312:0:104901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104901:1876946713114112:0@lo:104: 00010000:00010000:2.0:1789998067.994336:0:104901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998067.996535:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998067.996549:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998067.996560:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998067.996564:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998067.996575:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998067.996587:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998067.996593:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998067.996650:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998067.996677:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789998067.996701:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998067.996708:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592e9ab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9b2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998067.996729:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998067.996731:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998067.996733:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998067.996752:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713114240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998067.996813:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998067.996937:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713114240 00000100:00100000:0.0:1789998067.996944:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713114240 00010000:00010000:0.0:1789998067.996976:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e9ab expref: 19 pid: 5803 timeout: 2356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998067.997017:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789998067.997028:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713114240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998067.997049:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789998067.997056:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e9ab expref: 19 pid: 5803 timeout: 2356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997067:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e9ab expref: 19 pid: 5803 timeout: 2356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997084:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9b2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e9ab expref: 19 pid: 5803 timeout: 2356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997100:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997109:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997127:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997134:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997140:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997146:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997152:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789998067.997155:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997163:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997176:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998067.997185:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789998067.997226:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713114240:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998067.997234:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789998067.997275:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713114240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998067.997342:0:104901:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998067.997351:0:104901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998067.997359:0:104901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0c00/0x65b43101d592e9b9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998068.172322:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713114368:0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.172398:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998068.172537:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713114880:0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.172567:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998068.172615:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789998068.172624:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713114752:0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.172689:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998068.172702:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713114368 00000100:00100000:2.0:1789998068.172712:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713114368 00000100:00100000:0.0:1789998068.172734:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713114496:0@lo:400:kworker.0 00000100:00100000:2.0:1789998068.172757:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713114880 00000100:00100000:2.0:1789998068.172761:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713114880 00000100:00100000:2.0:1789998068.172798:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:2.0:1789998068.172808:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713114368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.172857:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998068.172887:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789998068.172894:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713114368:12345-0@lo:400:kworker.0 Request processed in 87us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998068.172902:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1789998068.172908:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713114624:0@lo:400:kworker.0 00000100:00100000:2.0:1789998068.172923:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713114496 00000100:00100000:2.0:1789998068.172928:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713114496 00000100:00100000:0.0:1789998068.172940:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998068.172961:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:2.0:1789998068.172968:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713114880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.172984:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1789998068.172997:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713114496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998068.173005:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713114880:12345-0@lo:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998068.173012:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:0.0:1789998068.173044:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713114496:12345-0@lo:400:kworker.0 Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998068.173051:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1789998068.173146:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713114752 00000100:00100000:0.0:1789998068.173151:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713114752 00000100:00080000:1.0:1789998068.173167:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998068.173173:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998068.173188:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713114624 00000100:00100000:0.0:1789998068.173192:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713114624 00000100:00080000:1.0:1789998068.173218:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998068.173228:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1789998068.173235:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713114752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.173272:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713114752:12345-0@lo:400:kworker.0 Request processed in 37us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998068.173279:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:0.0:1789998068.173293:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1789998068.173300:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713114624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.173329:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713114624:12345-0@lo:400:kworker.0 Request processed in 30us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998068.173335:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1789998068.173396:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713114624:0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.173406:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713114496:0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.173567:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713114752:0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.173578:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713114368:0@lo:400:kworker.0 00000100:00100000:0.0:1789998068.173728:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713114880:0@lo:400:kworker.0 00010000:00010000:2.0:1789998068.492788:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789998068.657892:0:104949:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3426be00 20000000:00000080:3.0:1789998068.657909:0:104949:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9c27400 uarg=0000000000000000 10000000:01000000:3.0:1789998068.658173:0:104949:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998068.658195:0:104949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658210:0:104949:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658220:0:104949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658227:0:104949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658233:0:104949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658245:0:104949:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658252:0:104949:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998068.658257:0:104949:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658266:0:104949:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658278:0:104949:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658285:0:104949:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998068.658292:0:104949:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052aa00/0x65b43101d592e9c0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104949 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998069.450780:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789998069.450790:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789998069.450796:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789998069.450877:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998069.450891:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998069.450902:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998069.450930:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713115008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998069.451008:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998069.451067:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d0b51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789998069.451741:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713115008 00000100:00100000:3.0:1789998069.451752:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713115008 00000100:00100000:3.0:1789998069.451813:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:3.0:1789998069.451835:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713115008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998069.451849:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998069.451864:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e9c7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998069.451889:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998069.451905:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998069.451914:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a200, rc 0) 00000100:00100000:3.0:1789998069.451976:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713115008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998069.451983:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1789998069.452175:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713115008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998069.452193:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998069.452204:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998069.452224:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789998069.452230:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998069.452238:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998069.514811:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998070.221132:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713115136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998070.221250:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713115264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998070.221306:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998070.221355:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998070.221399:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713115136 00000100:00100000:0.0:1789998070.221407:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713115136 00000100:00100000:0.0:1789998070.221465:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713115264 00000100:00100000:0.0:1789998070.221469:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713115264 00000100:00100000:0.0:1789998070.221485:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1789998070.221494:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713115136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998070.221528:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998070.221572:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713115136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998070.221579:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1789998070.221594:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1789998070.221600:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713115264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998070.221617:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998070.221646:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713115264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998070.221675:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1789998070.221718:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713115136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789998070.221842:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998070.221846:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998070.221867:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713115264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789998070.538856:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789998070.726380:0:105096:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd9eb5bc0 20000000:00000080:0.0:1789998070.726398:0:105096:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38f9b16c00 uarg=0000000000000000 10000000:01000000:0.0:1789998070.726593:0:105096:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998070.726614:0:105096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998070.726631:0:105096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998070.726640:0:105096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998070.726755:0:105096:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998070.726769:0:105096:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 18 pid: 5805 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998070.726783:0:105096:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105096:1876946713115392:0@lo:104: 00000100:00100000:0.0:1789998070.726862:0:105096:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998070.726979:0:105096:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5caa240 going to sleep for 11 seconds 00000100:00100000:3.0:1789998070.727160:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713115392 00000100:00100000:3.0:1789998070.727168:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713115392 00000100:00100000:3.0:1789998070.727249:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1789998070.727258:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105096:x1876946713115392:12345-0@lo:104: 00010000:00010000:3.0:1789998070.727270:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998070.727367:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998070.727373:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105096:x1876946713115392:12345-0@lo:104: Request processed in 117us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998070.727379:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00010000:2.0:1789998070.727437:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998070.727445:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727452:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998070.727455:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727463:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998070.727470:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998070.727477:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998070.727514:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727520:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789998070.727545:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727551:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0e00/0x65b43101d592e9c7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ce expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727576:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998070.727577:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998070.727579:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998070.727590:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713115520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998070.727625:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998070.727703:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713115520 00000100:00100000:2.0:1789998070.727707:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713115520 00010000:00010000:2.0:1789998070.727726:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 19 pid: 5805 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998070.727747:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1789998070.727753:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c54f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713115520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998070.727763:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998070.727767:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 19 pid: 5805 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727777:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 19 pid: 5805 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727792:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727814:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727828:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727835:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727842:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727848:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727852:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998070.727856:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727863:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727872:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998070.727882:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998070.727910:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c54f2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713115520:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998070.727917:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00000100:00100000:2.0:1789998070.727979:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713115520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998070.728254:0:105096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a200/0x65b43101d592e9ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e9c7 expref: 18 pid: 5805 timeout: 2359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998070.728265:0:105096:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105096:1876946713115392:0@lo:104: 00010000:00010000:0.0:1789998070.728277:0:105096:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998070.728285:0:105096:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998070.728292:0:105096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998070.728298:0:105096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0a00/0x65b43101d592e9d5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789998071.298298:0:105147:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe068cb0a0 20000000:00000080:2.0:1789998071.298320:0:105147:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c54a3000 uarg=0000000000000000 10000000:01000000:2.0:1789998071.300067:0:105147:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998071.300094:0:105147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300113:0:105147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300124:0:105147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300131:0:105147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300138:0:105147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300145:0:105147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300150:0:105147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2c00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998071.300155:0:105147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300162:0:105147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300180:0:105147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300188:0:105147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998071.300195:0:105147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2c00/0x65b43101d592e9dc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998071.563022:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789998072.589072:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789998072.589081:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789998072.589086:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789998072.589131:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998072.589143:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998072.589155:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998072.589181:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713115648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998072.589248:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998072.589300:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38e09a8180 going to sleep for 11 seconds 00000100:00100000:2.0:1789998072.590105:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713115648 00000100:00100000:2.0:1789998072.590117:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713115648 00000100:00100000:2.0:1789998072.590176:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1789998072.590186:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713115648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998072.590203:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789998072.590221:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e9e3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998072.590248:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998072.590260:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998072.590269:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3400, rc 0) 00000100:00100000:2.0:1789998072.590330:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713115648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998072.590337:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1789998072.590405:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713115648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998072.590423:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998072.590431:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998072.590450:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789998072.590454:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998072.590462:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998072.597189:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998073.290905:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789998073.290932:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713115776:0@lo:400:kworker.0 00000100:00100000:2.0:1789998073.291006:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998073.291075:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713116160:0@lo:400:kworker.0 00000100:00100000:1.0:1789998073.291110:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713115904:0@lo:400:kworker.0 00000100:00100000:2.0:1789998073.291118:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998073.291160:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998073.291191:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789998073.291263:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713115776 00000100:00100000:2.0:1789998073.291266:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713116160 00000100:00100000:2.0:1789998073.291275:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713116160 00000100:00100000:3.0:1789998073.291277:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713116288:0@lo:400:kworker.0 00000100:00100000:0.0:1789998073.291283:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713115776 00000100:00100000:1.0:1789998073.291323:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713116032:0@lo:400:kworker.0 00000100:00100000:3.0:1789998073.291325:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998073.291341:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713115904 00000100:00100000:2.0:1789998073.291344:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1789998073.291346:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713115904 00000100:00100000:2.0:1789998073.291358:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713116160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998073.291367:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998073.291381:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713116288 00000100:00100000:0.0:1789998073.291385:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713116288 00000100:00100000:0.0:1789998073.291420:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1663 00000100:00100000:2.0:1789998073.291426:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713116160:12345-0@lo:400:kworker.0 Request processed in 71us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998073.291435:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713115776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998073.291439:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:1.0:1789998073.291459:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:2.0:1789998073.291463:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713116032 00000100:00100000:2.0:1789998073.291468:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713116032 00000100:00100000:1.0:1789998073.291473:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713115904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998073.291490:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713115776:12345-0@lo:400:kworker.0 Request processed in 59us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998073.291501:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1789998073.291511:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713116032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998073.291515:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1663 00000100:00100000:1.0:1789998073.291528:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713115904:12345-0@lo:400:kworker.0 Request processed in 57us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998073.291550:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713116032:12345-0@lo:400:kworker.0 Request processed in 41us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998073.291556:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1789998073.291606:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00100000:2.0:1789998073.291610:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713116160:0@lo:400:kworker.0 00000100:00100000:2.0:1789998073.291626:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713115776:0@lo:400:kworker.0 00000100:00100000:1.0:1789998073.291627:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:1.0:1789998073.291640:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c8777c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713116288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998073.291705:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c8777c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713116288:12345-0@lo:400:kworker.0 Request processed in 68us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998073.291712:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00080000:0.0:1789998073.291880:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789998073.291887:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789998073.291891:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998073.291926:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713116032:0@lo:400:kworker.0 00000100:00100000:0.0:1789998073.291938:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713115904:0@lo:400:kworker.0 00000100:00100000:0.0:1789998073.291988:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713116288:0@lo:400:kworker.0 00010000:00010000:0.0:1789998073.610796:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998074.058149:0:105342:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc73a56010 20000000:00000080:2.0:1789998074.058168:0:105342:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38ffd87c00 uarg=0000000000000000 10000000:01000000:2.0:1789998074.058468:0:105342:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998074.058487:0:105342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998074.058506:0:105342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998074.058514:0:105342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998074.058555:0:105342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998074.058571:0:105342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 18 pid: 5803 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998074.058585:0:105342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105342:1876946713116416:0@lo:104: 00000100:00100000:2.0:1789998074.063777:0:105342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998074.064129:0:105342:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789998074.064205:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713116416 00000100:00100000:1.0:1789998074.064215:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713116416 00000100:00100000:1.0:1789998074.064278:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789998074.064292:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105342:x1876946713116416:12345-0@lo:104: 00010000:00010000:1.0:1789998074.064315:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998074.064420:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789998074.064427:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105342:x1876946713116416:12345-0@lo:104: Request processed in 140us (5777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998074.064434:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789998074.064518:0:105342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105342:1876946713116416:0@lo:104: 00010000:00010000:2.0:1789998074.064552:0:105342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.064627:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998074.064635:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.064645:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789998074.064650:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.064699:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998074.064707:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998074.064713:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789998074.064767:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.064777:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998074.064808:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.064818:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592e9e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ea expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.064845:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998074.064847:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998074.064848:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998074.065020:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789998074.065040:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713116544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789998074.065088:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998074.065269:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713116544 00000100:00100000:0.0:1789998074.065275:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713116544 00010000:00010000:0.0:1789998074.065303:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 19 pid: 5803 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998074.065337:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1789998074.065347:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713116544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998074.065360:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789998074.065365:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 19 pid: 5803 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065376:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 19 pid: 5803 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065394:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3400/0x65b43101d592e9ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e9e3 expref: 19 pid: 5803 timeout: 2362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065407:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065415:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065431:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065438:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065445:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065451:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065461:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789998074.065465:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065472:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065489:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998074.065501:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789998074.065619:0:105342:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998074.065631:0:105342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998074.065637:0:105342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2200/0x65b43101d592e9f1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998074.066489:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713116544:12345-0@lo:103:ldlm_bl.0 Request processed in 1143us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998074.066498:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1789998074.068971:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713116544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998074.634957:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998075.339328:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789998075.339352:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713116672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998075.339425:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998075.339487:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713116672 00000100:00100000:1.0:1789998075.339497:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713116672 00000100:00100000:1.0:1789998075.339564:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1789998075.339574:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713116672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998075.339608:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998075.339684:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713116672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998075.339692:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1789998075.339759:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713116800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789998075.339786:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998075.339825:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713116800 00000100:00100000:1.0:1789998075.339829:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713116800 00000100:00100000:1.0:1789998075.339851:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1789998075.339857:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713116800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789998075.339876:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998075.339910:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713116800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998075.339916:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00080000:2.0:1789998075.340158:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789998075.340162:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998075.340258:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713116800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789998075.340290:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713116672:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1789998075.595961:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789998075.595968:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789998075.595973:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789998075.596016:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998075.596029:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998075.596040:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998075.596070:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713116928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789998075.596139:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998075.596188:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c385b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789998075.596648:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713116928 00000100:00100000:3.0:1789998075.596680:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713116928 00000100:00100000:3.0:1789998075.596736:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1789998075.596745:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713116928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998075.596757:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998075.596771:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592e9f8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998075.596795:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998075.596806:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998075.596815:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a600, rc 0) 00000100:00100000:3.0:1789998075.596874:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713116928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998075.596881:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1789998075.596925:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713116928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998075.596940:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998075.596949:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998075.596967:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789998075.596972:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998075.596984:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998075.659338:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998076.684534:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789998076.976356:0:105538:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc77b2a890 20000000:00000080:0.0:1789998076.976374:0:105538:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38ffd53c00 uarg=0000000000000000 10000000:01000000:0.0:1789998076.977246:0:105538:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998076.977269:0:105538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998076.977288:0:105538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998076.977296:0:105538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998076.977336:0:105538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998076.977352:0:105538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 18 pid: 5804 timeout: 2365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998076.977365:0:105538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105538:1876946713117056:0@lo:104: 00000100:00100000:0.0:1789998076.977433:0:105538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998076.977560:0:105538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c3581a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789998076.977642:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713117056 00000100:00100000:1.0:1789998076.977650:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713117056 00000100:00100000:0.0:1789998076.978040:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1789998076.978051:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105538:x1876946713117056:12345-0@lo:104: 00010000:00010000:0.0:1789998076.978064:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998076.978145:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998076.978151:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105538:x1876946713117056:12345-0@lo:104: Request processed in 103us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998076.978158:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789998076.978225:0:105538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105538:1876946713117056:0@lo:104: 00010000:00010000:2.0:1789998076.978247:0:105538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978359:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789998076.978366:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978374:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789998076.978378:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978385:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789998076.978391:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998076.978397:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789998076.978433:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978441:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789998076.978463:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978470:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592e9f8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592e9ff expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978491:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998076.978493:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998076.978494:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998076.978507:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713117184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998076.978541:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998076.978585:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713117184 00000100:00100000:1.0:1789998076.978589:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713117184 00010000:00010000:1.0:1789998076.978608:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 19 pid: 5804 timeout: 2365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998076.978628:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789998076.978635:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713117184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998076.978645:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998076.978650:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 19 pid: 5804 timeout: 2365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978690:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 19 pid: 5804 timeout: 2365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978703:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a600/0x65b43101d592e9ff lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592e9f8 expref: 19 pid: 5804 timeout: 2365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978717:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978724:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978738:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978746:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978752:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978759:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978764:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789998076.978768:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978775:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978787:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998076.978796:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789998076.978821:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713117184:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998076.978826:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:1.0:1789998076.978854:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713117184:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998076.978946:0:105538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998076.978954:0:105538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998076.978959:0:105538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592ea06 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1789998077.677235:0:105586:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe045c5860 20000000:00000080:1.0:1789998077.677257:0:105586:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4d07c00 uarg=0000000000000000 10000000:01000000:1.0:1789998077.677605:0:105586:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789998077.677630:0:105586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677648:0:105586:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677721:0:105586:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677728:0:105586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677735:0:105586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677744:0:105586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677750:0:105586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789998077.677755:0:105586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677763:0:105586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677778:0:105586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677785:0:105586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998077.677791:0:105586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3800/0x65b43101d592ea0d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998077.708527:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998078.414074:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789998078.414121:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789998078.414149:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713117440:0@lo:400:kworker.0 00000100:00100000:1.0:1789998078.414264:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998078.415889:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713117440 00000100:00100000:1.0:1789998078.415901:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713117440 00000100:00100000:1.0:1789998078.415969:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:1.0:1789998078.415981:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713117440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998078.416072:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713117440:12345-0@lo:400:kworker.0 Request processed in 95us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998078.416081:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00100000:1.0:1789998078.416139:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713117440:0@lo:400:kworker.0 00000100:00100000:2.0:1789998078.416589:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713117312:0@lo:400:kworker.0 00000100:00100000:2.0:1789998078.416637:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998078.416710:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713117312 00000100:00100000:2.0:1789998078.416715:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713117312 00000100:00100000:2.0:1789998078.416747:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1789998078.416757:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713117312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998078.416805:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713117312:12345-0@lo:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998078.416896:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1789998078.416947:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713117312:0@lo:400:kworker.0 00000100:00100000:3.0:1789998078.418028:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713117568:0@lo:400:kworker.0 00000100:00100000:3.0:1789998078.418085:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998078.418129:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789998078.418136:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713117696:0@lo:400:kworker.0 00000100:00100000:3.0:1789998078.418162:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998078.418369:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713117696 00000100:00100000:1.0:1789998078.418378:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713117696 00000100:00100000:1.0:1789998078.418457:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:2.0:1789998078.418460:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713117952:0@lo:400:kworker.0 00000100:00100000:1.0:1789998078.418469:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713117696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998078.418497:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998078.418526:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789998078.418532:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713117696:12345-0@lo:400:kworker.0 Request processed in 66us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998078.418535:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713117824:0@lo:400:kworker.0 00000100:00100000:1.0:1789998078.418545:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00080000:1.0:1789998078.418568:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998078.418569:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998078.418609:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713117568 00000100:00100000:2.0:1789998078.418614:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713117568 00000100:00100000:2.0:1789998078.418671:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713117952 00000100:00100000:2.0:1789998078.418675:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713117952 00000100:00100000:2.0:1789998078.418700:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1667 00000100:00100000:2.0:1789998078.418707:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713117568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998078.418743:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713117568:12345-0@lo:400:kworker.0 Request processed in 36us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998078.418749:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1667 00000100:00100000:2.0:1789998078.418766:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:2.0:1789998078.418773:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713117952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998078.418806:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713117952:12345-0@lo:400:kworker.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998078.419412:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713117696:0@lo:400:kworker.0 00000100:00100000:3.0:1789998078.419425:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713117568:0@lo:400:kworker.0 00000100:00100000:2.0:1789998078.419505:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00100000:2.0:1789998078.419542:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713117952:0@lo:400:kworker.0 00000100:00100000:1.0:1789998078.422045:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713117824 00000100:00100000:1.0:1789998078.422058:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713117824 00000100:00100000:1.0:1789998078.422268:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1789998078.422280:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713117824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998078.422377:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713117824:12345-0@lo:400:kworker.0 Request processed in 101us (3810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998078.422473:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00080000:1.0:1789998078.422524:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998078.422529:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998078.422566:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713117824:0@lo:400:kworker.0 10000000:01000000:2.0:1789998078.474731:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789998078.474743:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789998078.474750:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998078.474809:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998078.474824:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998078.474838:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998078.474867:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713118080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789998078.474946:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998078.475007:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c54b5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789998078.475329:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713118080 00000100:00100000:0.0:1789998078.475340:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713118080 00000100:00100000:0.0:1789998078.475398:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:0.0:1789998078.475408:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713118080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998078.475421:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998078.475437:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ea14 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998078.475464:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ea14 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998078.475476:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea14 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998078.475486:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789998078.475541:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713118080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998078.475549:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1789998078.475739:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713118080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998078.475754:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998078.475764:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998078.475784:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789998078.475790:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998078.475798:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998078.736566:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998079.754982:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998080.458808:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713118208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998080.458880:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998080.458966:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713118208 00000100:00100000:1.0:1789998080.458974:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713118208 00000100:00100000:1.0:1789998080.459429:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1789998080.459440:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713118208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998080.459478:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998080.459539:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713118208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998080.459546:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:0.0:1789998080.460827:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789998080.462591:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713118336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789998080.462710:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998080.462785:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713118336 00000100:00100000:3.0:1789998080.462792:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713118336 00000100:00100000:3.0:1789998080.462853:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1789998080.462863:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713118336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789998080.462902:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789998080.462913:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789998080.462965:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713118336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998080.462972:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:3.0:1789998080.463045:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713118208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998080.463330:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713118336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789998080.780167:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789998080.956031:0:105783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd7d9e71a0 20000000:00000080:0.0:1789998080.956049:0:105783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38ffd51c00 uarg=0000000000000000 10000000:01000000:0.0:1789998080.956398:0:105783:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998080.956418:0:105783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998080.956435:0:105783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea14 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998080.956443:0:105783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998080.956482:0:105783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ea14 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998080.956496:0:105783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ea14 expref: 18 pid: 5804 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998080.956510:0:105783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105783:1876946713118464:0@lo:104: 00000100:00100000:0.0:1789998080.956576:0:105783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998080.956732:0:105783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38ee505780 going to sleep for 11 seconds 00000100:00100000:1.0:1789998080.956972:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713118464 00000100:00100000:1.0:1789998080.956980:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713118464 00000100:00100000:1.0:1789998080.957031:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1789998080.957041:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105783:x1876946713118464:12345-0@lo:104: 00010000:00010000:1.0:1789998080.957054:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957118:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789998080.957124:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105783:x1876946713118464:12345-0@lo:104: Request processed in 85us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998080.957130:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00010000:00010000:1.0:1789998080.957152:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789998080.957158:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957165:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789998080.957169:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957177:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789998080.957185:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998080.957190:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1789998080.957222:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957227:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789998080.957247:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957253:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ea14 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea1b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957267:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998080.957269:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998080.957270:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998080.957283:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789998080.957293:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713118592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998080.957323:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998080.957352:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713118592 00000100:00100000:1.0:1789998080.957356:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713118592 00010000:00010000:1.0:1789998080.957375:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea14 expref: 19 pid: 5804 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998080.957396:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1789998080.957403:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713118592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998080.957412:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998080.957417:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea14 expref: 19 pid: 5804 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957427:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ea14 expref: 19 pid: 5804 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957444:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957452:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957466:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957473:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957481:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957487:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957497:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1600 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789998080.957501:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957509:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957517:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998080.957525:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789998080.957553:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713118592:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998080.957561:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1789998080.957607:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713118592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998080.957716:0:105783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1c00/0x65b43101d592ea1b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ea14 expref: 18 pid: 5804 timeout: 2369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998080.957728:0:105783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105783:1876946713118464:0@lo:104: 00010000:00010000:0.0:1789998080.957741:0:105783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998080.957750:0:105783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998080.957757:0:105783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998080.957763:0:105783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1600/0x65b43101d592ea22 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789998081.713223:0:105833:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4b209440 20000000:00000080:3.0:1789998081.713242:0:105833:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a38f9ba2c00 uarg=0000000000000000 20000000:01000000:3.0:1789998081.713280:0:105833:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='nodemap..fileset=/c0dir' 20000000:01000000:3.0:1789998081.713286:0:105833:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'nodemap..fileset=/c0dir' 20000000:01000000:3.0:1789998081.713291:0:105833:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/nodemap..fileset=/c0dir del=0 00000040:00080000:1.0:1789998081.714833:0:105834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789998081.714990:0:105833:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.nodemap..fileset=/c0dir in log params 00000040:00080000:2.0:1789998081.721463:0:105833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789998081.721521:0:105833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 112 off9648 00000040:00080000:2.0:1789998081.722965:0:105833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9872 10000000:01000000:2.0:1789998081.723012:0:105833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789998081.723041:0:105833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.723062:0:105833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38c27de200/0x65b43101d5928494 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592848d expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.723072:0:105833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38f660e600/0x65b43101d59284a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592849b expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.723078:0:105833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3600/0x65b43101d59284b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d59284a9 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.723086:0:105833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.723129:0:105833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3600/0x65b43101d59284b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d59284a9 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.723145:0:105833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3600/0x65b43101d59284b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d59284a9 expref: 17 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998081.723160:0:105833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a00700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105833:1876946713118720:0@lo:104: 00000100:00100000:2.0:1789998081.723231:0:105833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789998081.723334:0:105833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38f660e600/0x65b43101d59284a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592849b expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.723343:0:105833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38f660e600/0x65b43101d59284a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592849b expref: 17 pid: 5804 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998081.723352:0:105833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105833:1876946713118848:0@lo:104: 00000100:00100000:2.0:1789998081.723374:0:105833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789998081.723478:0:105833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38c27de200/0x65b43101d5928494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592848d expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.723486:0:105833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38c27de200/0x65b43101d5928494 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592848d expref: 17 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998081.723495:0:105833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a01880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105833:1876946713118976:0@lo:104: 00000100:00100000:2.0:1789998081.723520:0:105833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998081.723638:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713118720 00000100:00100000:3.0:1789998081.723647:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713118720 00000100:00100000:3.0:1789998081.723724:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713118848 00000100:00100000:3.0:1789998081.723728:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713118848 00000100:00100000:3.0:1789998081.723748:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789998081.723757:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+4:105833:x1876946713118720:12345-0@lo:104: 00010000:00010000:3.0:1789998081.723770:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fa591a00/0x65b43101d59284a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d59284b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998081.723831:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00010000:00010000:3.0:1789998081.723840:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998081.723849:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+4:105833:x1876946713118720:12345-0@lo:104: Request processed in 92us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998081.723851:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+4:105833:x1876946713118848:12345-0@lo:104: 00010000:00010000:1.0:1789998081.723866:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38c27dfe00/0x65b43101d592849b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d59284a2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998081.723875:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00010000:00010000:3.0:1789998081.723907:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789998081.723914:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789998081.723922:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105833:x1876946713118848:12345-0@lo:104: Request processed in 81us (545us total) trans 0 rc 0/0 00010000:00010000:3.0:1789998081.723923:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fa591a00/0x65b43101d59284a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d59284b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998081.723932:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:3.0:1789998081.723940:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fa591a00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789998081.723946:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fa591a00/0x65b43101d59284a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d59284b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.723955:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789998081.723956:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fa591a00/0x65b43101d59284a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d59284b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.723964:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38c27dfe00/0x65b43101d592849b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d59284a2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789998081.723966:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fa591a00/0x65b43101d59284a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d59284b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.723983:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38c27dfe00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789998081.723989:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38c27dfe00/0x65b43101d592849b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d59284a2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998081.723992:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789998081.724002:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38c27dfe00/0x65b43101d592849b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d59284a2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789998081.724009:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38c27dfe00/0x65b43101d592849b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d59284a2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998081.724016:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789998081.724029:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fa591a00/0x65b43101d59284a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d59284b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.724035:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38c27dfe00/0x65b43101d592849b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d59284a2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998081.724038:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789998081.724045:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789998081.724065:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fa591a00/0x65b43101d59284a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d59284b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.724069:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38c27dfe00/0x65b43101d592849b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d59284a2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.724076:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38c27dfe00/0x65b43101d592849b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d59284a2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998081.724084:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fa591a00/0x65b43101d59284a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d59284b0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.724094:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998081.724098:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998081.724101:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998081.724103:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998081.724106:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998081.724108:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998081.724110:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789998081.724123:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713119232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789998081.724131:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713119104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998081.724159:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998081.724189:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998081.724213:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713119232 00000100:00100000:1.0:1789998081.724218:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713119232 00000100:00100000:3.0:1789998081.724239:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713119104 00010000:00010000:1.0:1789998081.724241:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38f660e600/0x65b43101d59284a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592849b expref: 18 pid: 5804 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998081.724245:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713119104 00000100:00100000:2.0:1789998081.724254:0:105833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae10540 going to sleep for 11 seconds 00010000:00010000:3.0:1789998081.724264:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3600/0x65b43101d59284b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d59284a9 expref: 19 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998081.724272:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789998081.724275:0:105833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a00700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105833:1876946713118720:0@lo:104: 00000100:00100000:1.0:1789998081.724285:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713119232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998081.724289:0:105833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105833:1876946713118848:0@lo:104: 00000100:00100000:3.0:1789998081.724294:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00010000:00010000:1.0:1789998081.724299:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789998081.724303:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713119104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998081.724307:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38f660e600/0x65b43101d59284a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592849b expref: 19 pid: 5804 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998081.724311:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713118976 00010000:00010000:3.0:1789998081.724314:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789998081.724319:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713118976 00010000:00010000:1.0:1789998081.724323:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38f660e600/0x65b43101d59284a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592849b expref: 19 pid: 5804 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998081.724324:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3600/0x65b43101d59284b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d59284a9 expref: 19 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.724351:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38f660e600/0x65b43101d59284a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592849b expref: 19 pid: 5804 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998081.724356:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3600/0x65b43101d59284b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d59284a9 expref: 19 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998081.724367:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789998081.724370:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3600/0x65b43101d59284b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d59284a9 expref: 19 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998081.724382:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998081.724411:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713119104:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998081.724417:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1789998081.724443:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713119104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998081.724471:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:2.0:1789998081.724479:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789998081.724489:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb45d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105833:x1876946713118976:12345-0@lo:104: 00010000:00010000:2.0:1789998081.724499:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fa591400/0x65b43101d592848d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d5928494 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.725021:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789998081.725062:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:3283:x1876946713119232:12345-0@lo:103:ldlm_bl.0 Request processed in 781us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998081.725069:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1789998081.725111:0:105833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a01880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105833:1876946713118976:0@lo:104: 00010000:00010000:2.0:1789998081.725121:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789998081.725129:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb45d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:105833:x1876946713118976:12345-0@lo:104: Request processed in 642us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998081.725137:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00010000:00010000:3.0:1789998081.725138:0:105833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998081.725183:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713119232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998081.725224:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998081.725231:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fa591400/0x65b43101d592848d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d5928494 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998081.725238:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fa591400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789998081.725316:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fa591400/0x65b43101d592848d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d5928494 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998081.725325:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fa591400/0x65b43101d592848d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d5928494 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998081.725332:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fa591400/0x65b43101d592848d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d5928494 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998081.725338:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789998081.725443:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fa591400/0x65b43101d592848d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d5928494 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998081.725450:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998081.725476:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fa591400/0x65b43101d592848d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d5928494 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998081.725484:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fa591400/0x65b43101d592848d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d5928494 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998081.725497:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998081.725499:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998081.725501:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998081.725511:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789998081.725592:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713119360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789998081.725952:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998081.726084:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713119360 00000100:00100000:1.0:1789998081.726091:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713119360 00010000:00010000:1.0:1789998081.726115:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38c27de200/0x65b43101d5928494 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592848d expref: 16 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998081.726141:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00000100:00100000:1.0:1789998081.726149:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:3282:x1876946713119360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998081.726160:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998081.726166:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38c27de200/0x65b43101d5928494 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592848d expref: 16 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726178:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38c27de200/0x65b43101d5928494 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592848d expref: 16 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726194:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38c27de200/0x65b43101d5928494 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592848d expref: 16 pid: 5805 timeout: 2370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726209:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726218:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726233:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726319:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726327:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726333:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726339:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789998081.726343:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.726351:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.726965:0:105833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998081.726976:0:105833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.728317:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.728331:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592ea29 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998081.728352:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789998081.728539:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+15:3282:x1876946713119360:12345-0@lo:103:ldlm_bl.0 Request processed in 2386us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998081.728551:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:0.0:1789998081.728894:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713119360:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998081.804401:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789998082.762728:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789998082.762736:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38d0027000 from 7 10000000:01000000:3.0:1789998082.762742:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789998082.762802:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.762815:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.762827:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998082.762857:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713119488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998082.762927:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998082.763003:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1789998082.763027:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713119488 00000100:00100000:2.0:1789998082.763037:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713119488 00000100:00100000:2.0:1789998082.763162:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:2.0:1789998082.763175:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+15:5807:x1876946713119488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998082.763191:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789998082.763278:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ea30 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998082.763310:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ea30 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998082.763324:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea30 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998082.763333:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789998082.763380:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:5807:x1876946713119488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998082.763387:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:3.0:1789998082.763800:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713119488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998082.763817:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.763828:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998082.763900:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713119616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998082.763934:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998082.763962:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1789998082.764472:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713119616 00000100:00100000:2.0:1789998082.764480:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713119616 00000100:00100000:2.0:1789998082.764523:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:2.0:1789998082.764533:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:5807:x1876946713119616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998082.765070:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:5807:x1876946713119616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 538us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998082.765079:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:3.0:1789998082.766078:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713119616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998082.766345:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713119744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998082.766432:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998082.766485:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1789998082.766586:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713119744 00000100:00100000:2.0:1789998082.766594:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713119744 00000100:00100000:2.0:1789998082.766731:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1789998082.766743:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:5807:x1876946713119744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789998082.766979:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:5807:x1876946713119744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998082.766987:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:3.0:1789998082.767349:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713119744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998082.770077:0:105901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105901:1876946713119872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789998082.770178:0:105901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998082.770240:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713119872 00000100:00100000:2.0:1789998082.770249:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713119872 00000100:00100000:2.0:1789998082.770322:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:2.0:1789998082.770331:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:105901:x1876946713119872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789998082.770426:0:105901:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789998082.770584:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:105901:x1876946713119872:12345-0@lo:502:llog_process_th.0 Request processed in 253us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998082.770592:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1789998082.771958:0:105901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105901:1876946713119872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789998082.772013:0:105901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789998082.772028:0:105901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789998082.772032:0:105901:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:3.0:1789998082.772039:0:105901:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a38d0027000 00000020:00000080:3.0:1789998082.772042:0:105901:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:3.0:1789998082.772927:0:105901:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 869us 00000100:00100000:3.0:1789998082.786429:0:105901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105901:1876946713120000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789998082.786607:0:105901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998082.786743:0:105901:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8000 going to sleep for 11 seconds 00000100:00100000:0.0:1789998082.786846:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713120000 00000100:00100000:0.0:1789998082.786855:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713120000 00000100:00100000:0.0:1789998082.786917:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1789998082.786929:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:105901:x1876946713120000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789998082.787181:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:105901:x1876946713120000:12345-0@lo:502:llog_process_th.0 Request processed in 255us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998082.787189:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1789998082.787285:0:105901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105901:1876946713120000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789998082.787314:0:105901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789998082.787321:0:105901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789998082.787324:0:105901:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:3.0:1789998082.787328:0:105901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789998082.787553:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789998082.787585:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789998082.787595:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.787608:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998082.787618:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1789998082.787621:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:0.0:1789998082.787624:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789998082.787671:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.787681:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.787691:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998082.787709:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998082.787740:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998082.787779:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61600 going to sleep for 11 seconds 00000100:00100000:1.0:1789998082.787801:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713120128 00000100:00100000:1.0:1789998082.787807:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713120128 00000100:00100000:1.0:1789998082.787844:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1789998082.787853:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:5807:x1876946713120128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998082.787863:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998082.787879:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ea3e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998082.787900:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ea3e expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998082.787911:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea3e expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998082.787918:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2200, rc 0) 00000100:00100000:1.0:1789998082.787959:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713120128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998082.787969:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:0.0:1789998082.787992:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998082.788006:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.788016:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998082.788030:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789998082.788034:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.788045:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998082.788052:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789998082.788054:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38e0c2b000 from 7 10000000:01000000:0.0:1789998082.788056:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789998082.788070:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.788077:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.788084:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998082.788096:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998082.788119:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998082.788177:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61600 going to sleep for 11 seconds 00000100:00100000:3.0:1789998082.788211:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713120256 00000100:00100000:3.0:1789998082.788216:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713120256 00000100:00100000:3.0:1789998082.788279:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1789998082.788287:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713120256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998082.788294:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998082.788303:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ea4c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.788317:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ea4c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.788326:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea4c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.788332:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052a400, rc 0) 00000100:00100000:3.0:1789998082.788374:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713120256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998082.788380:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1789998082.788441:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998082.788526:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998082.788535:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998082.788594:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789998082.788620:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998082.788774:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998082.788826:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713120384 00000100:00100000:0.0:1789998082.788831:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713120384 00000100:00100000:0.0:1789998082.788855:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1789998082.788862:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713120384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789998082.789101:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713120384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 239us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998082.789108:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1789998082.789161:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789998082.789191:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789998082.789227:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998082.789240:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f610c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998082.789250:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713120512 00000100:00100000:0.0:1789998082.789253:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713120512 00000100:00100000:0.0:1789998082.789270:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1789998082.789275:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713120512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789998082.789400:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713120512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998082.789406:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1789998082.789439:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789998082.789628:0:105903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105903:1876946713120640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789998082.789680:0:105903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998082.789697:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713120640 00000100:00100000:0.0:1789998082.789700:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713120640 00000100:00100000:0.0:1789998082.789720:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1789998082.789726:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:105903:x1876946713120640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789998082.789839:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:105903:x1876946713120640:12345-0@lo:502:llog_process_th.0 Request processed in 113us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998082.789845:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:0.0:1789998082.789871:0:105903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789998082.789882:0:105903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105903:1876946713120640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789998082.789902:0:105903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789998082.789909:0:105903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789998082.789911:0:105903:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:0.0:1789998082.789917:0:105903:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a38e0c2b000 00000020:00000080:0.0:1789998082.789920:0:105903:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:0.0:1789998082.790537:0:105903:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 599us 00000100:00100000:0.0:1789998082.790574:0:105903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105903:1876946713120768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789998082.790617:0:105903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998082.790751:0:105903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d057b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789998082.790781:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713120768 00000100:00100000:1.0:1789998082.790787:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713120768 00000100:00100000:1.0:1789998082.790851:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:1.0:1789998082.790860:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:105903:x1876946713120768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789998082.791024:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:105903:x1876946713120768:12345-0@lo:502:llog_process_th.0 Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998082.791031:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1789998082.791364:0:105903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105903:1876946713120768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789998082.791404:0:105903:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789998082.791410:0:105903:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789998082.791413:0:105903:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:0.0:1789998082.791416:0:105903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789998082.791530:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789998082.791552:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789998082.791572:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.791585:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998082.791595:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789998082.791598:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38e9732000 from 7 10000000:01000000:3.0:1789998082.791601:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789998082.791627:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.791636:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.791645:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998082.791713:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998082.791749:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998082.791774:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789998082.792227:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713120896 00000100:00100000:0.0:1789998082.792233:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713120896 00000100:00100000:0.0:1789998082.792270:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1789998082.792277:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713120896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998082.792289:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998082.792301:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ea5a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.792326:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ea5a expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.792337:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea5a expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998082.792345:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789998082.792398:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713120896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998082.792404:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1789998082.792628:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713120896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998082.792644:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998082.792679:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998082.792740:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713121024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998082.792774:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998082.793110:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713121024 00000100:00100000:1.0:1789998082.793117:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713121024 00000100:00100000:1.0:1789998082.793158:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1789998082.793167:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713121024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998082.793491:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789998082.793595:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713121024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 428us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998082.793603:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1789998082.793637:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713121024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998082.793697:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713121152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789998082.793738:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998082.793770:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789998082.793790:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713121152 00000100:00100000:3.0:1789998082.793795:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713121152 00000100:00100000:3.0:1789998082.793821:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1789998082.793828:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713121152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998082.793988:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713121152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998082.793995:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:1.0:1789998082.794190:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713121152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998082.796401:0:105905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105905:1876946713121280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789998082.796491:0:105905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998082.796529:0:105905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d89c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789998082.796575:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713121280 00000100:00100000:1.0:1789998082.796586:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713121280 00000100:00100000:1.0:1789998082.796748:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1789998082.796759:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:105905:x1876946713121280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789998082.797113:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:105905:x1876946713121280:12345-0@lo:502:llog_process_th.0 Request processed in 355us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998082.797122:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1789998082.797171:0:105905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105905:1876946713121280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789998082.797204:0:105905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789998082.797214:0:105905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789998082.797216:0:105905:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:0.0:1789998082.797223:0:105905:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a38e9732000 00000020:00000080:0.0:1789998082.797227:0:105905:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:0.0:1789998082.798948:0:105905:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 1705us 00000100:00100000:0.0:1789998082.799001:0:105905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105905:1876946713121408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789998082.799075:0:105905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998082.799161:0:105905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38d057b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789998082.799204:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713121408 00000100:00100000:2.0:1789998082.799212:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713121408 00000100:00100000:2.0:1789998082.799290:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1789998082.799300:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:105905:x1876946713121408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789998082.799579:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:105905:x1876946713121408:12345-0@lo:502:llog_process_th.0 Request processed in 280us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998082.799587:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:0.0:1789998082.799695:0:105905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:105905:1876946713121408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789998082.799726:0:105905:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789998082.799734:0:105905:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789998082.799736:0:105905:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:0.0:1789998082.799740:0:105905:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789998082.800119:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789998082.800144:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789998082.800156:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998082.800168:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998082.827036:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998083.534560:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713121792:0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.534564:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713121536:0@lo:400:kworker.0 00000100:00100000:3.0:1789998083.534940:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998083.535019:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789998083.535020:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713121792 00000100:00100000:3.0:1789998083.535029:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713121920:0@lo:400:kworker.0 00000100:00100000:1.0:1789998083.535030:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713121792 00000100:00100000:3.0:1789998083.535066:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998083.535098:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:1.0:1789998083.535110:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713121792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998083.535172:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713121792:12345-0@lo:400:kworker.0 Request processed in 65us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998083.535180:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:1.0:1789998083.535221:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713121792:0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.535361:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998083.535395:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713122048:0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.535475:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998083.535503:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789998083.535581:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713121920 00000100:00100000:2.0:1789998083.535586:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713121920 00000100:00100000:2.0:1789998083.535612:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713122048 00000100:00100000:2.0:1789998083.535614:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713122048 00000100:00100000:2.0:1789998083.535628:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1789998083.535636:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713121920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998083.535703:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713121920:12345-0@lo:400:kworker.0 Request processed in 69us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998083.535710:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1789998083.535724:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1789998083.535730:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713122048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998083.535757:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713122048:12345-0@lo:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998083.535763:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1789998083.535852:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713121664:0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.535880:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998083.535908:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713122176:0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.535926:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998083.535950:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713122048:0@lo:400:kworker.0 00000100:00080000:0.0:1789998083.535975:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789998083.535980:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789998083.535983:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998083.535996:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713121664 00000100:00100000:0.0:1789998083.536004:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713121664 00000100:00100000:0.0:1789998083.536024:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:0.0:1789998083.536031:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713121664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.536065:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713121664:12345-0@lo:400:kworker.0 Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998083.536070:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:0.0:1789998083.536079:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713122176 00000100:00100000:0.0:1789998083.536082:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713122176 00000100:00100000:0.0:1789998083.536102:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1671 00000100:00100000:0.0:1789998083.536108:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713122176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.536131:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713122176:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998083.536136:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1671 00000100:00100000:0.0:1789998083.536161:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713121664:0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.536169:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713122176:0@lo:400:kworker.0 00000100:00080000:0.0:1789998083.536182:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998083.537454:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713121536 00000100:00100000:1.0:1789998083.537462:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713121536 00000100:00100000:1.0:1789998083.537499:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1789998083.537507:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713121536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998083.538779:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713121536:12345-0@lo:400:kworker.0 Request processed in 1256us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998083.538791:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1789998083.538885:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713121920:0@lo:400:kworker.0 00000100:00100000:0.0:1789998083.539261:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713121536:0@lo:400:kworker.0 00010000:00010000:2.0:1789998083.852010:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998084.874893:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998085.578970:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713122304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998085.579054:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998085.579227:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713122304 00000100:00100000:3.0:1789998085.579238:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713122304 00000100:00080000:0.0:1789998085.579532:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998085.579543:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789998085.579553:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713122432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998085.579585:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998085.581927:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713122432 00000100:00100000:3.0:1789998085.581945:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713122432 00000100:00080000:0.0:1789998085.582032:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789998085.582033:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1789998085.582048:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713122304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789998085.582088:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789998085.582181:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713122304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (3127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998085.582190:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1789998085.582210:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1789998085.582216:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713122432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789998085.582235:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789998085.582265:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713122432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998085.582272:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:0.0:1789998085.582776:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713122432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998085.582795:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713122304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789998085.898763:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789998086.381202:0:106132:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: start setup 09:41:25 (1789998085) === 00010000:00010000:2.0:1789998086.923381:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998087.952413:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998088.650869:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713122560:0@lo:400:kworker.0 00000100:00100000:1.0:1789998088.650966:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998088.651205:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789998088.651213:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713122688:0@lo:400:kworker.0 00000100:00100000:1.0:1789998088.651311:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998088.651347:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713122560 00000100:00100000:1.0:1789998088.651355:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713122560 00000100:00100000:1.0:1789998088.651401:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1789998088.651410:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713122560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998088.651473:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713122560:12345-0@lo:400:kworker.0 Request processed in 63us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998088.651480:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1789998088.651510:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713122688 00000100:00100000:1.0:1789998088.651514:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713122688 00000100:00100000:0.0:1789998088.651735:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713123200:0@lo:400:kworker.0 00000100:00100000:0.0:1789998088.651769:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998088.652068:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713122816:0@lo:400:kworker.0 00000100:00100000:2.0:1789998088.652201:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713122944:0@lo:400:kworker.0 00000100:00100000:2.0:1789998088.652232:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998088.652628:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713123072:0@lo:400:kworker.0 00000100:00100000:2.0:1789998088.652779:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998088.652821:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713122560:0@lo:400:kworker.0 00000100:00100000:2.0:1789998088.652860:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713122944 00000100:00100000:2.0:1789998088.652865:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713122944 00000100:00100000:2.0:1789998088.652912:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713123072 00000100:00100000:2.0:1789998088.652916:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713123072 00000100:00100000:2.0:1789998088.652938:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1789998088.652947:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713122944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998088.653010:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713122944:12345-0@lo:400:kworker.0 Request processed in 64us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998088.653248:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1789998088.653273:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1789998088.653282:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713123072:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789998088.653314:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789998088.653320:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998088.653322:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713123072:12345-0@lo:400:kworker.0 Request processed in 41us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998088.653330:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1789998088.653365:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713122944:0@lo:400:kworker.0 00000100:00100000:3.0:1789998088.653413:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713123200 00000100:00100000:3.0:1789998088.653418:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713123200 00000100:00100000:0.0:1789998088.653459:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:3.0:1789998088.653468:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:0.0:1789998088.653473:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713122688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998088.653483:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713123200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998088.653519:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713122688:12345-0@lo:400:kworker.0 Request processed in 52us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998088.653527:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00100000:3.0:1789998088.653542:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713123200:12345-0@lo:400:kworker.0 Request processed in 63us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998088.653555:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:0.0:1789998088.653569:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998088.653587:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713122816 00000100:00100000:3.0:1789998088.653592:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713122816 00000100:00100000:3.0:1789998088.653628:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1789998088.653629:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713123200:0@lo:400:kworker.0 00000100:00100000:3.0:1789998088.653638:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713122816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998088.653706:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713122816:12345-0@lo:400:kworker.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998088.653712:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00100000:0.0:1789998088.653721:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713122816:0@lo:400:kworker.0 00000100:00080000:3.0:1789998088.653732:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998088.653798:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713123072:0@lo:400:kworker.0 00000100:00100000:2.0:1789998088.653812:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713122688:0@lo:400:kworker.0 00010000:00010000:3.0:1789998088.970818:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998089.997485:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998090.699362:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789998090.699737:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713123456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998090.699819:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998090.699887:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713123328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998090.699912:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998090.699995:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713123456 00000100:00100000:0.0:1789998090.700005:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713123456 00000100:00100000:0.0:1789998090.700075:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713123328 00000100:00100000:0.0:1789998090.700079:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713123328 00000100:00100000:0.0:1789998090.700097:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1789998090.700106:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713123456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998090.700142:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998090.700194:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713123456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998090.700202:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:0.0:1789998090.700218:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1789998090.700236:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713123328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998090.700258:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998090.700286:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713123328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998090.700292:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00080000:2.0:1789998090.700570:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789998090.700576:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998090.700618:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713123456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998090.700632:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713123328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789998091.019394:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998092.042843:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998093.067127:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998093.774585:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713123840:0@lo:400:kworker.0 00000100:00100000:0.0:1789998093.774585:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713123712:0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.774647:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713123584:0@lo:400:kworker.0 00000100:00100000:0.0:1789998093.774839:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998093.774897:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713123712 00000100:00100000:2.0:1789998093.774908:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713123712 00000100:00100000:2.0:1789998093.774981:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1675 00000100:00100000:2.0:1789998093.774993:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713123712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.775065:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998093.775097:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713124096:0@lo:400:kworker.0 00000100:00100000:0.0:1789998093.775097:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713124224:0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.775124:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998093.775124:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998093.775156:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713123584 00000100:00100000:0.0:1789998093.775159:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713123584 00000100:00100000:3.0:1789998093.775164:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713124224 00000100:00100000:3.0:1789998093.775166:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713124224 00000100:00100000:0.0:1789998093.775186:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:0.0:1789998093.775193:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713123584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.775197:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:3.0:1789998093.775202:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713124224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.775233:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713124224:12345-0@lo:400:kworker.0 Request processed in 30us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998093.775233:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713123584:12345-0@lo:400:kworker.0 Request processed in 39us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998093.775240:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00080000:3.0:1789998093.775268:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789998093.775310:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713123584:0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.775357:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713124096 00000100:00100000:3.0:1789998093.775361:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713124096 00000100:00100000:3.0:1789998093.775396:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1789998093.775403:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713124096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.775443:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713124096:12345-0@lo:400:kworker.0 Request processed in 41us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998093.775449:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1789998093.775467:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713123968:0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.775492:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998093.775521:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713123968 00000100:00100000:3.0:1789998093.775524:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713123968 00000100:00100000:3.0:1789998093.775549:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1789998093.775555:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713123968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998093.776044:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713123712:12345-0@lo:400:kworker.0 Request processed in 1054us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998093.776053:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1675 00000100:00080000:2.0:1789998093.776092:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789998093.776095:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998093.776115:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713124096:0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.776200:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713123968:12345-0@lo:400:kworker.0 Request processed in 645us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998093.776207:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1789998093.776253:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713123712:0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.776263:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713124224:0@lo:400:kworker.0 00000100:00100000:2.0:1789998093.776331:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713123968:0@lo:400:kworker.0 00000100:00100000:1.0:1789998093.776384:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998093.776470:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713123840 00000100:00100000:3.0:1789998093.776474:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713123840 00000100:00100000:3.0:1789998093.776542:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:3.0:1789998093.776549:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713123840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998093.778053:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713123840:12345-0@lo:400:kworker.0 Request processed in 1497us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998093.778066:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00100000:1.0:1789998093.778154:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713123840:0@lo:400:kworker.0 00000100:00080000:2.0:1789998093.778211:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998093.778339:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00010000:00010000:2.0:1789998094.091814:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998095.117138:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789998095.591632:0:106539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg404-server.virtnet: executing load_modules_local 00000100:00100000:2.0:1789998095.818926:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789998095.819174:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713124480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998095.819414:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998095.819748:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713124352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998095.819786:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998095.819861:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713124480 00000100:00100000:2.0:1789998095.819869:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713124480 00000100:00100000:2.0:1789998095.819931:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713124352 00000100:00100000:2.0:1789998095.819935:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713124352 00000100:00100000:2.0:1789998095.820098:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1789998095.820111:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713124480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789998095.820150:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998095.820221:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713124480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998095.820230:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1789998095.820572:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1789998095.820583:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713124352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789998095.820605:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998095.820818:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713124352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 237us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998095.820827:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00080000:2.0:1789998095.820858:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789998095.820862:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998095.820915:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713124480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998095.820939:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713124352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789998096.139915:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998097.165221:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998098.187220:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789998098.534241:0:106800:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000100:00100000:3.0:1789998098.890920:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713124608:0@lo:400:kworker.0 00000100:00100000:3.0:1789998098.891000:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998098.891046:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713124608 00000100:00100000:1.0:1789998098.891055:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713124608 00000100:00100000:3.0:1789998098.891088:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713125120:0@lo:400:kworker.0 00000100:00100000:1.0:1789998098.891107:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1789998098.891119:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713124608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998098.891143:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998098.891188:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713124608:12345-0@lo:400:kworker.0 Request processed in 71us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998098.891194:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713124608:0@lo:400:kworker.0 00000100:00100000:1.0:1789998098.891200:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1789998098.891218:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789998098.891227:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713124736:0@lo:400:kworker.0 00000100:00100000:3.0:1789998098.891303:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998098.891308:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713124864:0@lo:400:kworker.0 00000100:00100000:2.0:1789998098.891346:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998098.891372:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789998098.891377:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713124992:0@lo:400:kworker.0 00000100:00100000:2.0:1789998098.891400:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998098.891437:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713124736 00000100:00100000:2.0:1789998098.891441:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713124736 00000100:00100000:2.0:1789998098.891470:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713124864 00000100:00100000:2.0:1789998098.891473:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713124864 00000100:00100000:2.0:1789998098.891500:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:2.0:1789998098.891507:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713124736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998098.891539:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713124736:12345-0@lo:400:kworker.0 Request processed in 33us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998098.891546:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00100000:2.0:1789998098.891564:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1789998098.891570:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713124864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998098.891599:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713124864:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998098.891605:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1679 00000100:00100000:2.0:1789998098.891623:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713125120 00000100:00100000:2.0:1789998098.891627:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713125120 00000100:00100000:2.0:1789998098.891650:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713124992 00000100:00100000:2.0:1789998098.891677:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713124992 00000100:00100000:2.0:1789998098.891698:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1789998098.891704:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713125120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998098.891733:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713125120:12345-0@lo:400:kworker.0 Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998098.891739:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1789998098.891749:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1789998098.891756:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713124992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998098.891779:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713124992:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998098.891785:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00080000:2.0:1789998098.891799:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789998098.891803:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789998098.891805:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998098.891835:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713124992:0@lo:400:kworker.0 00000100:00100000:3.0:1789998098.891956:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713124736:0@lo:400:kworker.0 00000100:00100000:3.0:1789998098.891963:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713125248:0@lo:400:kworker.0 00000100:00100000:3.0:1789998098.891989:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998098.892010:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713125248 00000100:00100000:1.0:1789998098.892015:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713125248 00000100:00100000:1.0:1789998098.892048:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:1.0:1789998098.892061:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713125248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998098.892070:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713125120:0@lo:400:kworker.0 00000100:00100000:1.0:1789998098.892100:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713125248:12345-0@lo:400:kworker.0 Request processed in 39us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998098.892106:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00080000:1.0:1789998098.892122:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998098.892161:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713124864:0@lo:400:kworker.0 00000100:00100000:2.0:1789998098.894587:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713125248:0@lo:400:kworker.0 00010000:00010000:2.0:1789998099.213919:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998100.238230:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998100.938974:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713125376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998100.939079:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998100.939239:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713125376 00000100:00100000:2.0:1789998100.939251:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713125376 00000100:00100000:1.0:1789998100.939334:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789998100.939366:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713125504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789998100.939447:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998100.940316:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713125504 00000100:00100000:2.0:1789998100.940327:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713125504 00000100:00100000:0.0:1789998100.940423:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:0.0:1789998100.940440:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713125376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998100.940490:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789998100.940644:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789998100.940651:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998100.940773:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713125376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 332us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998100.940788:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1789998100.940831:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713125376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998100.943813:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1789998100.944130:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713125504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998100.944190:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998100.944341:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713125504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 225us (4893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998100.945986:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1789998100.946106:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713125504:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789998101.259770:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789998101.315793:0:106997:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000004:1.0:1789998101.321398:0:106998:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000004:2.0:1789998101.336269:0:106999:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000080:2.0:1789998102.031226:0:107047:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc20fc21b0 20000000:00000080:2.0:1789998102.031245:0:107047:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a38fb1bc000 uarg=0000000000000000 20000000:01000000:2.0:1789998102.031280:0:107047:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789998102.031289:0:107047:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789998102.031294:0:107047:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789998102.032571:0:107048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789998102.033230:0:107047:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789998102.042904:0:107047:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789998102.043081:0:107047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043102:0:107047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea30 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043127:0:107047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea4c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043134:0:107047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea5a expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043142:0:107047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043205:0:107047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ea5a expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043220:0:107047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ea5a expref: 18 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998102.043234:0:107047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107047:1876946713125632:0@lo:104: 00000100:00100000:3.0:1789998102.043313:0:107047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789998102.043398:0:107047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ea4c expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043407:0:107047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ea4c expref: 18 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998102.043506:0:107047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107047:1876946713125760:0@lo:104: 00000100:00100000:3.0:1789998102.043531:0:107047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789998102.043555:0:107047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ea30 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043563:0:107047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ea30 expref: 18 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998102.043570:0:107047:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107047:1876946713125888:0@lo:104: 00000100:00100000:3.0:1789998102.043592:0:107047:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998102.043609:0:107047:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789998102.043649:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713125632 00000100:00100000:3.0:1789998102.043679:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713125632 00000100:00100000:3.0:1789998102.043727:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713125760 00000100:00100000:3.0:1789998102.043730:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713125760 00000100:00100000:3.0:1789998102.043738:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713125888 00000100:00100000:3.0:1789998102.043740:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713125888 00000100:00100000:3.0:1789998102.043752:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789998102.043759:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+5:107047:x1876946713125632:12345-0@lo:104: 00010000:00010000:3.0:1789998102.043782:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043844:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998102.043850:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+5:107047:x1876946713125632:12345-0@lo:104: Request processed in 91us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998102.043857:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789998102.043884:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789998102.043892:0:5794:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+4:107047:x1876946713125760:12345-0@lo:104: 00010000:00010000:3.0:1789998102.043900:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.043937:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789998102.043941:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789998102.043944:0:5794:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+4:107047:x1876946713125760:12345-0@lo:104: Request processed in 53us (412us total) trans 0 rc 0/0 00010000:00010000:1.0:1789998102.043951:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.043962:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052ac00 already unused, calling callback (ffffffffc1aa8c20) 00000100:00100000:3.0:1789998102.043963:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 10000000:00010000:1.0:1789998102.043969:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.043980:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789998102.043988:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998102.043993:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789998102.044099:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.044107:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789998102.044126:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.044134:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052ac00/0x65b43101d592ea5a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea61 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.044148:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789998102.044153:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.044159:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789998102.044163:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.044171:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789998102.044179:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998102.044193:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789998102.044204:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+4:107047:x1876946713125888:12345-0@lo:104: 00010000:00010000:0.0:1789998102.044213:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998102.044251:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998102.044255:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+4:107047:x1876946713125888:12345-0@lo:104: Request processed in 55us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998102.044261:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789998102.044323:0:107047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107047:1876946713125632:0@lo:104: 00000100:00100000:3.0:1789998102.044331:0:107047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107047:1876946713125760:0@lo:104: 00000100:00100000:3.0:1789998102.044337:0:107047:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107047:1876946713125888:0@lo:104: 00010000:00010000:3.0:1789998102.044364:0:107047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998102.044403:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713126016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789998102.044456:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789998102.045588:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789998102.045611:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998102.045621:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.045623:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998102.045635:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052aa00 already unused, calling callback (ffffffffc1aa8c20) 00010000:00010000:1.0:1789998102.045638:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789998102.045640:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.045675:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.045684:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0400/0x65b43101d592ea4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea53 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.045705:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998102.045707:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998102.045708:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998102.045736:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713126144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998102.045783:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789998102.045785:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998102.045794:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998102.045801:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789998102.045825:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998102.045831:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998102.045851:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998102.045858:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052aa00/0x65b43101d592ea30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea37 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998102.045875:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998102.045877:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998102.045878:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998102.045890:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713126272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789998102.045919:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998102.045940:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713126016 00000100:00100000:1.0:1789998102.045948:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713126016 00000100:00100000:0.0:1789998102.045964:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713126144 00000100:00100000:0.0:1789998102.045969:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713126144 00010000:00010000:1.0:1789998102.045978:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea5a expref: 20 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998102.045988:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea4c expref: 20 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998102.046004:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713126272 00000100:00100000:1.0:1789998102.046009:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713126272 00000100:00100000:0.0:1789998102.046015:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:0.0:1789998102.046024:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c54f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+21:3284:x1876946713126016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998102.046035:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998102.046040:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea30 expref: 21 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998102.046041:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea5a expref: 21 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998102.046064:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ea5a expref: 21 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998102.046073:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00010000:00010000:0.0:1789998102.046080:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ea61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ea5a expref: 21 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998102.046084:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+21:3285:x1876946713126144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998102.046098:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789998102.046100:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789998102.046103:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea4c expref: 20 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046118:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ea4c expref: 20 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046130:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a400/0x65b43101d592ea53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ea4c expref: 20 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998102.046136:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c54f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+20:3284:x1876946713126016:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1677us total) trans 0 rc 0/0 00010000:00010000:1.0:1789998102.046146:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789998102.046146:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:1.0:1789998102.046198:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3285:x1876946713126144:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998102.046205:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1789998102.046219:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:1.0:1789998102.046225:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:3282:x1876946713126272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998102.046233:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998102.046237:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea30 expref: 17 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046245:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ea30 expref: 17 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046256:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592ea37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ea30 expref: 17 pid: 5803 timeout: 2390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046268:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046276:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046290:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046297:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046305:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998102.046306:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713126016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998102.046320:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046325:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789998102.046330:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046338:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046353:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.046363:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789998102.046393:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:3282:x1876946713126272:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998102.046400:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00010000:00010000:1.0:1789998102.046417:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998102.046439:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713126272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998102.046460:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713126144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998102.047203:0:107047:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.047216:0:107047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998102.047223:0:107047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b000/0x65b43101d592ea68 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998102.284670:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789998102.769417:0:107096:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=7508, dev=0 00010000:00010000:2.0:1789998103.306806:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998104.011111:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713126784:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.011191:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998104.011254:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789998104.011261:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713126400:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.011290:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998104.011315:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713126912:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.011336:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998104.011365:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713126528:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.011389:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998104.011406:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713127040:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.011425:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998104.011441:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789998104.011447:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713126656:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.011466:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998104.011499:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713126784 00000100:00100000:0.0:1789998104.011508:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713126784 00000100:00100000:0.0:1789998104.011561:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713126912 00000100:00100000:0.0:1789998104.011565:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713126912 00000100:00100000:0.0:1789998104.011586:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1789998104.011595:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713126784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.011647:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713126784:12345-0@lo:400:kworker.0 Request processed in 54us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998104.011678:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1789998104.011694:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1789998104.011701:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713126912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.011728:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713126912:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998104.011735:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1789998104.011935:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713126400 00000100:00100000:0.0:1789998104.011940:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713126400 00000100:00100000:0.0:1789998104.018503:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1789998104.018524:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:3282:x1876946713126400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.018620:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:3282:x1876946713126400:12345-0@lo:400:kworker.0 Request processed in 106us (7328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998104.018628:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1789998104.018684:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713126528 00000100:00100000:0.0:1789998104.018692:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713126528 00000100:00100000:2.0:1789998104.018922:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713127040 00000100:00100000:2.0:1789998104.018928:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713127040 00000100:00100000:3.0:1789998104.019082:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713126656 00000100:00100000:3.0:1789998104.019087:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713126656 00000100:00080000:1.0:1789998104.019749:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789998104.019766:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998104.019769:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998104.019808:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713126400:0@lo:400:kworker.0 00000100:00100000:1.0:1789998104.019828:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713126912:0@lo:400:kworker.0 00000100:00100000:1.0:1789998104.019839:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713126784:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.020176:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1789998104.020189:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713126528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.020261:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713126528:12345-0@lo:400:kworker.0 Request processed in 77us (8870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998104.020267:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1789998104.020282:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1789998104.020288:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713127040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.020316:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713127040:12345-0@lo:400:kworker.0 Request processed in 29us (8891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998104.020322:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:2.0:1789998104.020414:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1683 00000100:00100000:2.0:1789998104.020424:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713126656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998104.020461:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713126656:12345-0@lo:400:kworker.0 Request processed in 41us (8994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998104.020467:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1683 00000100:00100000:0.0:1789998104.020560:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713126656:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.020574:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713126528:0@lo:400:kworker.0 00000100:00100000:0.0:1789998104.020585:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713127040:0@lo:400:kworker.0 10000000:01000000:3.0:1789998104.076449:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789998104.076456:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38d0027000 from 10 10000000:01000000:3.0:1789998104.076460:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789998104.076504:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.076517:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.076530:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998104.076562:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.076636:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998104.076695:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713127168 00000100:00100000:0.0:1789998104.076704:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713127168 00000100:00100000:3.0:1789998104.076713:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998104.076762:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1789998104.076772:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:5807:x1876946713127168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998104.076787:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998104.076802:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ea6f expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998104.076827:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ea6f expref: 17 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998104.076839:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea6f expref: 17 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998104.076849:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789998104.076902:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713127168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998104.076909:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:1.0:1789998104.077026:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998104.077042:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998104.077051:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998104.077115:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789998104.077154:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998104.077177:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb3c6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789998104.077189:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713127296 00000100:00100000:1.0:1789998104.077193:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713127296 00000100:00100000:1.0:1789998104.077216:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1789998104.077222:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713127296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789998104.078266:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713127296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1039us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998104.078276:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1789998104.078452:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.078497:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.078539:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998104.078582:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789998104.078637:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713127424 00000100:00100000:1.0:1789998104.078643:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713127424 00000100:00100000:1.0:1789998104.078768:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1789998104.078777:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713127424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789998104.078952:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713127424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998104.078959:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1789998104.081397:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789998104.082746:0:107175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789998104.084501:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789998104.084531:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789998104.084543:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.084556:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998104.084567:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789998104.084569:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38e0c2b000 from 10 10000000:01000000:3.0:1789998104.084572:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789998104.084611:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.084619:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.084630:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998104.084681:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.084754:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998104.084815:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789998104.085531:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713127552 00000100:00100000:1.0:1789998104.085541:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713127552 00000100:00100000:1.0:1789998104.085791:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1789998104.085826:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713127552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998104.085842:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998104.085863:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ea7d expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998104.085888:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ea7d expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998104.085899:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea7d expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998104.085908:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3e00, rc 0) 00000100:00100000:1.0:1789998104.085984:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713127552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998104.085991:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1789998104.086131:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998104.086159:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.086169:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998104.086250:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.086282:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998104.086316:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789998104.086332:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713127680 00000100:00100000:3.0:1789998104.086335:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713127680 00000100:00100000:3.0:1789998104.086359:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1789998104.086366:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713127680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.086719:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713127680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 352us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998104.086726:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1789998104.086756:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.086783:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.086819:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998104.086836:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789998104.086847:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713127808 00000100:00100000:3.0:1789998104.086849:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713127808 00000100:00100000:3.0:1789998104.086880:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1789998104.086886:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713127808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.087115:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713127808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998104.087121:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:3.0:1789998104.087237:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789998104.088542:0:107177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789998104.088789:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789998104.088814:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789998104.088824:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.088835:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998104.088845:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789998104.088847:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38e9732000 from 10 10000000:01000000:3.0:1789998104.088850:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789998104.088876:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.088884:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.088892:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998104.088913:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.089041:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998104.089084:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71d0240 going to sleep for 11 seconds 00000100:00100000:1.0:1789998104.089135:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713127936 00000100:00100000:1.0:1789998104.089141:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713127936 00000100:00100000:1.0:1789998104.089194:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1789998104.089203:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713127936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998104.089214:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998104.089226:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ea8b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998104.089251:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ea8b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998104.089262:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea8b expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998104.089271:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2000, rc 0) 00000100:00100000:1.0:1789998104.089305:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713127936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998104.089312:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1789998104.089743:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713127936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998104.089759:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998104.089768:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998104.089825:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713128064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998104.089853:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998104.089882:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c83a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789998104.090025:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713128064 00000100:00100000:3.0:1789998104.090031:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713128064 00000100:00100000:3.0:1789998104.090066:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:3.0:1789998104.090074:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713128064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.090386:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713128064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998104.090393:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1789998104.091064:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713128064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998104.091101:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713128192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789998104.091159:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998104.091228:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c83a2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789998104.091320:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713128192 00000100:00100000:3.0:1789998104.091325:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713128192 00000100:00100000:3.0:1789998104.091357:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:3.0:1789998104.091364:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713128192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998104.091619:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713128192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998104.091626:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1789998104.091732:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713128192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789998104.092596:0:107178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789998104.092833:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789998104.092860:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789998104.092871:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998104.092883:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998104.331855:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998105.356568:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789998105.709945:0:107295:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=7508, dev=0 00000020:00000004:0.0:1789998105.716345:0:107296:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=7508, dev=0 00000020:00000004:3.0:1789998105.731345:0:107297:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=7508, dev=0 00000100:00100000:2.0:1789998106.059007:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789998106.059033:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713128320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998106.059124:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998106.059317:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713128320 00000100:00100000:1.0:1789998106.059328:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713128320 00000100:00080000:3.0:1789998106.059408:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998106.059927:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1789998106.059942:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713128320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998106.059956:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713128448:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998106.059983:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998106.059996:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998106.060052:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713128320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998106.060060:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1789998106.061489:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713128448 00000100:00100000:1.0:1789998106.061501:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713128448 00000100:00080000:3.0:1789998106.061544:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998106.061557:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1789998106.061568:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713128448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998106.061602:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998106.061694:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713128448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998106.061701:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1789998106.064542:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713128448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998106.064597:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713128320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789998106.378956:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998107.403699:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789998108.074826:0:107443:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=8034, dev=0 00010000:00010000:1.0:1789998108.429472:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998109.135099:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713128832:0@lo:400:kworker.0 00000100:00100000:1.0:1789998109.135173:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998109.135234:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789998109.135241:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713128704:0@lo:400:kworker.0 00000100:00100000:1.0:1789998109.135263:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998109.135280:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713129216:0@lo:400:kworker.0 00000100:00100000:1.0:1789998109.135301:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998109.136324:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713128960:0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136373:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998109.136409:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789998109.136416:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713128576:0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136444:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998109.136473:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713129088:0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136494:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998109.136530:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713128960 00000100:00100000:3.0:1789998109.136538:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713128960 00000100:00100000:3.0:1789998109.136598:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713129088 00000100:00100000:3.0:1789998109.136602:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713129088 00000100:00100000:3.0:1789998109.136626:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1789998109.136636:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713128960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136715:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713128960:12345-0@lo:400:kworker.0 Request processed in 80us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998109.136721:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1789998109.136738:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1789998109.136744:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713129088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136769:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713129088:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998109.136774:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1789998109.136791:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713128576 00000100:00100000:3.0:1789998109.136794:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713128576 00000100:00100000:3.0:1789998109.136817:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1789998109.136822:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713128576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136849:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713128576:12345-0@lo:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998109.136858:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00080000:3.0:1789998109.136888:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789998109.136892:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789998109.136918:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713128576:0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136931:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713129088:0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136939:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713128960:0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.136980:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713128832 00000100:00100000:3.0:1789998109.136984:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713128832 00000100:00100000:3.0:1789998109.137013:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713128704 00000100:00100000:3.0:1789998109.137016:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713128704 00000100:00100000:3.0:1789998109.137031:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713129216 00000100:00100000:3.0:1789998109.137033:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713129216 00000100:00100000:3.0:1789998109.137076:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1789998109.137083:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713128832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.137119:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713128832:12345-0@lo:400:kworker.0 Request processed in 36us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998109.137125:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:3.0:1789998109.137137:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:3.0:1789998109.137143:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713128704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.137171:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713128704:12345-0@lo:400:kworker.0 Request processed in 28us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998109.137176:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:3.0:1789998109.137188:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:3.0:1789998109.137193:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713129216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998109.137219:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713129216:12345-0@lo:400:kworker.0 Request processed in 26us (1918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998109.137225:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00080000:3.0:1789998109.137241:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998109.138071:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713128704:0@lo:400:kworker.0 00000100:00100000:1.0:1789998109.138087:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713129216:0@lo:400:kworker.0 00000100:00100000:1.0:1789998109.138097:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713128832:0@lo:400:kworker.0 00010000:00010000:2.0:1789998109.450929:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998110.475101:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789998111.109034:0:107639:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=8034, dev=0 00000020:00000004:2.0:1789998111.115144:0:107640:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=8034, dev=0 00000020:00000004:0.0:1789998111.130240:0:107641:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=8034, dev=0 00000100:00100000:3.0:1789998111.179107:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789998111.179131:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713129344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789998111.179196:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998111.179261:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713129472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789998111.179283:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998111.179359:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713129344 00000100:00100000:0.0:1789998111.179368:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713129344 00000100:00100000:2.0:1789998111.179390:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713129472 00000100:00100000:2.0:1789998111.179394:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713129472 00000100:00100000:0.0:1789998111.179458:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1789998111.179468:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713129344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998111.179500:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998111.179545:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713129344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998111.179552:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:0.0:1789998111.179595:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713129344:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789998111.184250:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789998111.184260:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998111.184419:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1789998111.184437:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713129472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789998111.184479:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998111.184579:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713129472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (5294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998111.184586:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1789998111.185041:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6a02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713129472:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789998111.503075:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998112.523806:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998112.618581:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.619117:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704641536 00000100:00100000:3.0:1789998112.619130:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704641536 00000100:00100000:3.0:1789998112.619170:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1346 00000100:00100000:3.0:1789998112.619180:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1876946704641536:12345-192.168.204.4@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789998112.619212:0:5803:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 24fef93e-9c02-4b13-b7a6-fb1fb5333935@192.168.204.4@tcp t0 exp 0000000000000000 cur 2301 last 0 00000020:00000080:3.0:1789998112.619249:0:5803:0:(genops.c:1384:class_connect()) connect: client 24fef93e-9c02-4b13-b7a6-fb1fb5333935, cookie 0x65b43101d592ea99 00000100:00080000:3.0:1789998112.619299:0:5803:0:(import.c:65:import_set_state_nolock()) ffff8a37c7301000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789998112.619377:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+5:2351:x1876946704641536:12345-192.168.204.4@tcp:250:mount.lustre.0 Request processed in 197us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998112.619385:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1346 00000100:00100000:2.0:1789998112.628444:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.628631:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704641664 00000100:00100000:3.0:1789998112.628643:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704641664 00000100:00100000:3.0:1789998112.628733:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1347 00000100:00100000:3.0:1789998112.628743:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+5:64541:x1876946704641664:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789998112.628760:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998112.628777:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b400/0x65b43101d592eaa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2df expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998112.628804:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b400/0x65b43101d592eaa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2df expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998112.628815:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b400/0x65b43101d592eaa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2df expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998112.628825:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789998112.628883:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+6:64541:x1876946704641664:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 141us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998112.628901:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1347 00000100:00100000:2.0:1789998112.631119:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.631253:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704641792 00000100:00100000:3.0:1789998112.631262:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704641792 00000100:00100000:3.0:1789998112.631317:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1348 00000100:00100000:3.0:1789998112.631327:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+6:64541:x1876946704641792:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789998112.631628:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+6:64541:x1876946704641792:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 300us (516us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789998112.631636:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1348 00000100:00100000:2.0:1789998112.636104:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.636628:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704641920 00000100:00100000:3.0:1789998112.636639:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704641920 00000100:00100000:3.0:1789998112.636733:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1349 00000100:00100000:3.0:1789998112.636743:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+6:64541:x1876946704641920:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789998112.636761:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998112.636781:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b600/0x65b43101d592eaa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf2e6 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998112.636817:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b600/0x65b43101d592eaa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2e6 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998112.636828:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b600/0x65b43101d592eaa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2e6 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998112.636838:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b600, rc 0) 00000100:00100000:3.0:1789998112.636904:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+7:64541:x1876946704641920:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 162us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998112.636911:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1349 00000100:00100000:2.0:1789998112.640153:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.646814:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704642048 00000100:00100000:3.0:1789998112.646830:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704642048 00000100:00100000:2.0:1789998112.646963:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1350 00000100:00100000:2.0:1789998112.646996:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+7:64541:x1876946704642048:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789998112.647339:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:64541:x1876946704642048:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 365us (7196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.647348:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1350 00000100:00100000:2.0:1789998112.650391:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.650480:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704642176 00000100:00100000:3.0:1789998112.650490:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704642176 00000100:00100000:3.0:1789998112.650555:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1351 00000100:00100000:3.0:1789998112.650565:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:64541:x1876946704642176:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789998112.651254:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c340b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:64541:x1876946704642176:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 687us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.651264:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1351 00000100:00100000:3.0:1789998112.654130:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998112.654237:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704642304 00000100:00100000:2.0:1789998112.654247:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704642304 00000100:00100000:2.0:1789998112.654309:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1352 00000100:00100000:2.0:1789998112.654319:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:64559:x1876946704642304:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789998112.654731:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:64559:x1876946704642304:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 412us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.654740:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1352 00000100:00100000:3.0:1789998112.670241:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998112.670417:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704642432 00000100:00100000:2.0:1789998112.670430:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704642432 00000100:00100000:2.0:1789998112.670491:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1353 00000100:00100000:2.0:1789998112.670502:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:64559:x1876946704642432:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789998112.671391:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:64559:x1876946704642432:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 886us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.671401:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1353 00000100:00100000:0.0:1789998112.680748:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998112.680844:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704642560 00000100:00100000:1.0:1789998112.680856:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704642560 00000100:00100000:1.0:1789998112.680927:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1354 00000100:00100000:1.0:1789998112.680937:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:64541:x1876946704642560:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789998112.680954:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998112.680985:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592eaae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf310 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.681016:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592eaae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf310 expref: 9 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.681028:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592eaae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf310 expref: 9 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.681036:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3a00, rc 0) 00000100:00100000:1.0:1789998112.681098:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+9:64541:x1876946704642560:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 163us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998112.681105:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1354 00000100:00100000:3.0:1789998112.684070:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998112.687274:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704642688 00000100:00100000:1.0:1789998112.687290:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704642688 00000100:00100000:1.0:1789998112.687359:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1355 00000100:00100000:1.0:1789998112.687368:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24fef93e-9c02-4b13-b7a6-fb1fb5333935+9:64541:x1876946704642688:12345-192.168.204.4@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789998112.687396:0:5804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789998112.687421:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789998112.687426:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789998112.687429:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789998112.687432:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789998112.690055:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:24fef93e-9c02-4b13-b7a6-fb1fb5333935+9:64541:x1876946704642688:12345-192.168.204.4@tcp:256:mount.lustre.0 Request processed in 2678us (5985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998112.690075:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1355 00000100:00100000:0.0:1789998112.696033:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998112.696169:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704642816 00000100:00100000:1.0:1789998112.696180:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704642816 00000100:00100000:1.0:1789998112.696284:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1356 00000100:00100000:1.0:1789998112.696295:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+9:64541:x1876946704642816:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789998112.696313:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998112.696330:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf317 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.696356:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 10 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.696368:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 10 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.696376:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2c00, rc 0) 00000100:00100000:1.0:1789998112.696442:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64541:x1876946704642816:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 149us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998112.696449:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1356 00000100:00100000:3.0:1789998112.698347:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998112.698415:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704642944 00000100:00100000:2.0:1789998112.698425:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704642944 00000100:00100000:2.0:1789998112.698537:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1357 00000100:00100000:2.0:1789998112.698549:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64541:x1876946704642944:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789998112.698878:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64541:x1876946704642944:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 329us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.698887:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1357 00000100:00100000:3.0:1789998112.701348:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998112.706070:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704643072 00000100:00100000:2.0:1789998112.706087:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704643072 00000100:00100000:2.0:1789998112.706159:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1358 00000100:00100000:2.0:1789998112.706170:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64541:x1876946704643072:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789998112.706414:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64541:x1876946704643072:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 245us (5073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.706421:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1358 00000100:00100000:0.0:1789998112.712011:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998112.712545:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704643200 00000100:00100000:2.0:1789998112.712555:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704643200 00000100:00100000:2.0:1789998112.712613:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1359 00000100:00100000:2.0:1789998112.712624:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64563:x1876946704643200:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789998112.713414:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64563:x1876946704643200:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 787us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.713424:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1359 00000100:00100000:3.0:1789998112.737336:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998112.737446:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704643328 00000100:00100000:2.0:1789998112.737459:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704643328 00000100:00100000:2.0:1789998112.737519:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1360 00000100:00100000:2.0:1789998112.737529:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64563:x1876946704643328:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789998112.737829:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64563:x1876946704643328:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 300us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.737836:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1360 00000100:00100000:0.0:1789998112.744223:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.744321:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704643456 00000100:00100000:3.0:1789998112.744332:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704643456 00000100:00100000:3.0:1789998112.744382:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1258 00000100:00100000:3.0:1789998112.744392:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1876946704643456:12345-192.168.204.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789998112.744424:0:5811:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ee8dd0da-5890-47e9-b68b-29f185a97bb5@192.168.204.4@tcp t0 exp 0000000000000000 cur 2301 last 0 00000020:00000080:3.0:1789998112.744472:0:5811:0:(genops.c:1384:class_connect()) connect: client ee8dd0da-5890-47e9-b68b-29f185a97bb5, cookie 0x65b43101d592eabc 00000004:00100000:3.0:1789998112.744539:0:5811:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789998112.744847:0:5811:0:(import.c:65:import_set_state_nolock()) ffff8a37c7303800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789998112.745484:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:2351:x1876946704643456:12345-192.168.204.4@tcp:38:mount.lustre.0 Request processed in 1089us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998112.745493:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1258 00000100:00100000:0.0:1789998112.750885:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998112.750936:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.751069:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704643712 00000100:00100000:3.0:1789998112.751078:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704643712 00000100:00100000:3.0:1789998112.751251:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704643584 00000100:00100000:3.0:1789998112.751255:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704643584 00000100:00080000:0.0:1789998112.752702:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998112.754354:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1259 00000100:00100000:2.0:1789998112.754381:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8dd0da-5890-47e9-b68b-29f185a97bb5+7:64541:x1876946704643712:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789998112.754433:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789998112.754476:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1260 00000100:00100000:1.0:1789998112.754486:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ee8dd0da-5890-47e9-b68b-29f185a97bb5+7:0:x1876946704643584:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789998112.754500:0:12471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1789998112.754534:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ee8dd0da-5890-47e9-b68b-29f185a97bb5+7:0:x1876946704643584:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 51us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998112.754542:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1260 00000100:00100000:2.0:1789998112.755332:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64541:x1876946704643712:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 961us (4451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.755341:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1259 00000100:00100000:0.0:1789998112.761236:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998112.761355:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704643840 00000100:00100000:2.0:1789998112.761365:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704643840 00000100:00100000:2.0:1789998112.761535:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1261 00000100:00100000:2.0:1789998112.761548:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64541:x1876946704643840:12345-192.168.204.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789998112.761691:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64541:x1876946704643840:12345-192.168.204.4@tcp:40:mount.lustre.0 Request processed in 145us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.761699:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1261 00000100:00100000:0.0:1789998112.768457:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998112.768503:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998112.768536:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998112.772850:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704644224 00000100:00100000:3.0:1789998112.772867:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704644224 00000100:00100000:3.0:1789998112.773040:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 128 00000100:00100000:3.0:1789998112.773054:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38de232450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64541:x1876946704644224:12345-192.168.204.4@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789998112.773071:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704643968 00000100:00100000:1.0:1789998112.773077:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704643968 00000004:00200000:3.0:1789998112.773127:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789998112.773235:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38de232450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64541:x1876946704644224:12345-192.168.204.4@tcp:33:mount.lustre.0 Request processed in 185us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998112.773243:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 128 00000100:00100000:1.0:1789998112.773272:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704644096 00000100:00100000:1.0:1789998112.773277:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704644096 00000100:00100000:1.0:1789998112.773303:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 679 00000100:00100000:1.0:1789998112.773311:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2351:x1876946704643968:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789998112.773340:0:99743:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ee8dd0da-5890-47e9-b68b-29f185a97bb5@192.168.204.4@tcp t0 exp 0000000000000000 cur 2301 last 0 00000100:00100000:2.0:1789998112.773374:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 680 00000020:00000080:1.0:1789998112.773375:0:99743:0:(genops.c:1384:class_connect()) connect: client ee8dd0da-5890-47e9-b68b-29f185a97bb5, cookie 0x65b43101d592eac3 00000100:00100000:2.0:1789998112.773385:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876946704644096:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789998112.773405:0:6656:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ee8dd0da-5890-47e9-b68b-29f185a97bb5@192.168.204.4@tcp t0 exp 0000000000000000 cur 2301 last 0 00002000:00100000:1.0:1789998112.773419:0:99743:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ee8dd0da-5890-47e9-b68b-29f185a97bb5/ffff8a37c6ec3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:2.0:1789998112.773430:0:6656:0:(genops.c:1384:class_connect()) connect: client ee8dd0da-5890-47e9-b68b-29f185a97bb5, cookie 0x65b43101d592eaca 00002000:00100000:2.0:1789998112.773439:0:6656:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ee8dd0da-5890-47e9-b68b-29f185a97bb5/ffff8a37c5dc0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789998112.773445:0:99743:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1789998112.773457:0:6656:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789998112.773849:0:99743:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:2.0:1789998112.773850:0:6656:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789998112.773887:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a37c5dc4000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789998112.773888:0:99743:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789998112.773931:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:2351:x1876946704643968:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 619us (5427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998112.773938:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 679 00000100:00100000:2.0:1789998112.774399:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:2351:x1876946704644096:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 1013us (5860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998112.774407:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 680 00000100:00100000:0.0:1789998112.965541:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998112.965650:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704644352 00000100:00100000:1.0:1789998112.965687:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704644352 00000100:00100000:1.0:1789998112.965750:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1262 00000100:00100000:1.0:1789998112.965761:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64583:x1876946704644352:12345-192.168.204.4@tcp:101:mkdir.0 00010000:00010000:1.0:1789998112.965784:0:12471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998112.965863:0:12471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3600/0x65b43101d592ead1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf341 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.965927:0:12471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592ead8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.965941:0:12471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592ead8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.965955:0:12471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592ead8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789998112.966003:0:12471:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789998112.966007:0:12471:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789998112.966028:0:12471:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592ead8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12471 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.966051:0:12471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb3600/0x65b43101d592ead1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf341 expref: 8 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.966070:0:12471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592ead8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf341 expref: 7 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998112.966078:0:12471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789998112.966081:0:12471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789998112.966084:0:12471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb2400, rc 0) 00000100:00100000:1.0:1789998112.966179:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:ee8dd0da-5890-47e9-b68b-29f185a97bb5+7:64583:x1876946704644352:12345-192.168.204.4@tcp:101:mkdir.0 Request processed in 420us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998112.966187:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1262 00010000:00010000:1.0:1789998113.547692:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998114.251056:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713129600:0@lo:400:kworker.0 00000100:00100000:3.0:1789998114.251131:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998114.251131:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713129984:0@lo:400:kworker.0 00000100:00100000:1.0:1789998114.251179:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998114.251191:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713130112:0@lo:400:kworker.0 00000100:00100000:3.0:1789998114.251215:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998114.251216:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713129856:0@lo:400:kworker.0 00000100:00100000:1.0:1789998114.251251:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998114.251264:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713129984 00000100:00100000:2.0:1789998114.251281:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713129728:0@lo:400:kworker.0 00000100:00100000:3.0:1789998114.251286:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713129984 00000100:00100000:1.0:1789998114.251286:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713130112 00000100:00100000:1.0:1789998114.251291:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713130112 00000100:00100000:2.0:1789998114.251323:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998114.251347:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713129600 00000100:00100000:1.0:1789998114.251350:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1789998114.251352:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713129600 00000100:00100000:2.0:1789998114.251353:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713130240:0@lo:400:kworker.0 00000100:00100000:1.0:1789998114.251362:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713130112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998114.251385:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998114.251386:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1789998114.251394:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713129600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998114.251421:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713130112:12345-0@lo:400:kworker.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998114.251429:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1789998114.251431:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713129600:12345-0@lo:400:kworker.0 Request processed in 39us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998114.251437:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1789998114.251446:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713129856 00000100:00100000:2.0:1789998114.251452:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713129856 00000100:00100000:0.0:1789998114.251470:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713129728 00000100:00100000:0.0:1789998114.251475:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713129728 00000100:00100000:0.0:1789998114.251494:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713130240 00000100:00100000:0.0:1789998114.251496:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713130240 00000100:00100000:3.0:1789998114.252069:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1789998114.252078:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713129984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998114.252122:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713129984:12345-0@lo:400:kworker.0 Request processed in 47us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998114.252128:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1789998114.252148:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1687 00000100:00100000:3.0:1789998114.252155:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713129728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998114.252189:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713129728:12345-0@lo:400:kworker.0 Request processed in 35us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998114.252195:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1687 00000100:00100000:3.0:1789998114.252230:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713129984:0@lo:400:kworker.0 00000100:00100000:2.0:1789998114.252277:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:2.0:1789998114.252286:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713129856:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789998114.252287:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789998114.252294:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789998114.252298:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998114.252332:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713129600:0@lo:400:kworker.0 00000100:00100000:2.0:1789998114.252334:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713129856:12345-0@lo:400:kworker.0 Request processed in 48us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998114.252345:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1789998114.252352:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713130112:0@lo:400:kworker.0 00000100:00100000:1.0:1789998114.252377:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713129856:0@lo:400:kworker.0 00000100:00100000:3.0:1789998114.252378:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713129728:0@lo:400:kworker.0 00000100:00100000:0.0:1789998114.252504:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:0.0:1789998114.252513:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713130240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998114.252563:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713130240:12345-0@lo:400:kworker.0 Request processed in 51us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998114.252568:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:2.0:1789998114.252637:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713130240:0@lo:400:kworker.0 00010000:00010000:2.0:1789998114.571879:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998114.599182:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998114.603203:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704644480 00000100:00100000:3.0:1789998114.603219:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704644480 00000100:00080000:1.0:1789998114.603400:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789998114.604325:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1263 00000100:00100000:3.0:1789998114.604342:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8dd0da-5890-47e9-b68b-29f185a97bb5+7:64635:x1876946704644480:12345-192.168.204.4@tcp:41:lfs.0 00000004:00000024:3.0:1789998114.604389:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:3.0:1789998114.604555:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee8dd0da-5890-47e9-b68b-29f185a97bb5+7:64635:x1876946704644480:12345-192.168.204.4@tcp:41:lfs.0 Request processed in 218us (5383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998114.604563:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1263 00000100:00100000:0.0:1789998114.608151:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998114.608216:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704644608 00000100:00100000:2.0:1789998114.608228:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704644608 00000100:00100000:2.0:1789998114.608308:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 863 00000100:00100000:2.0:1789998114.608319:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64635:x1876946704644608:12345-192.168.204.4@tcp:13:lfs.0 00002000:00000024:2.0:1789998114.608356:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998114.608435:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64635:x1876946704644608:12345-192.168.204.4@tcp:13:lfs.0 Request processed in 117us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998114.608443:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 863 00000100:00080000:1.0:1789998114.608560:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998114.610144:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998114.610287:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704644736 00000100:00100000:0.0:1789998114.610305:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704644736 00000100:00100000:0.0:1789998114.610418:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 864 00000100:00100000:0.0:1789998114.610429:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64635:x1876946704644736:12345-192.168.204.4@tcp:13:lfs.0 00002000:00000024:0.0:1789998114.610460:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998114.610543:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:64635:x1876946704644736:12345-192.168.204.4@tcp:13:lfs.0 Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998114.610550:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 864 00000100:00080000:1.0:1789998114.617281:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1789998115.310120:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee8dd0da-5890-47e9-b68b-29f185a97bb5 00000001:00100000:0.0:1789998115.316969:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee8dd0da-5890-47e9-b68b-29f185a97bb5 00010000:00010000:1.0:1789998115.595055:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789998116.128062:0:107840:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789998116.299130:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713130368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998116.299226:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998116.299401:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713130368 00000100:00100000:1.0:1789998116.299412:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713130368 00000100:00100000:2.0:1789998116.300002:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713130496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998116.300040:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998116.300135:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713130496 00000100:00100000:1.0:1789998116.300140:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713130496 00000100:00100000:0.0:1789998116.300195:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:0.0:1789998116.300216:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713130368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998116.300241:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998116.300294:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6a02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713130368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998116.300301:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00100000:0.0:1789998116.300348:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713130368:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789998116.301269:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789998116.301274:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998116.301309:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1789998116.301320:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713130496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998116.301334:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998116.301374:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713130496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998116.301379:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:2.0:1789998116.301423:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713130496:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789998116.618945:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789998117.357795:0:5832:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee8dd0da-5890-47e9-b68b-29f185a97bb5 00010000:00010000:1.0:1789998117.643867:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998118.178755:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998118.178797:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998118.178823:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998118.178848:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998118.178889:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704644864 00000100:00100000:0.0:1789998118.178899:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704644864 00000100:00100000:0.0:1789998118.178952:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1362 00000100:00100000:0.0:1789998118.178963:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:2354:x1876946704644864:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998118.179029:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:2354:x1876946704644864:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 67us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998118.179036:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1362 00000100:00100000:0.0:1789998118.179065:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704645120 00000100:00100000:0.0:1789998118.179069:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704645120 00000100:00100000:0.0:1789998118.179102:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704645248 00000100:00100000:0.0:1789998118.179104:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704645248 00000100:00100000:0.0:1789998118.179126:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1182 00000100:00100000:0.0:1789998118.179132:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+5:2354:x1876946704645120:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998118.179160:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+5:2354:x1876946704645120:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998118.179166:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1182 00000100:00100000:0.0:1789998118.179177:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1183 00000100:00100000:0.0:1789998118.179184:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+5:2354:x1876946704645248:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998118.179207:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+5:2354:x1876946704645248:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998118.179213:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1183 00000100:00100000:0.0:1789998118.179227:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704644992 00000100:00100000:0.0:1789998118.179231:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704644992 00000100:00100000:0.0:1789998118.179254:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1690 00000100:00100000:0.0:1789998118.179259:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:2354:x1876946704644992:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998118.179283:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:2354:x1876946704644992:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998118.179289:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1690 00000100:00080000:0.0:1789998118.179426:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789998118.179431:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789998118.179433:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789998118.253324:0:107990:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd70c1c10 20000000:00000080:0.0:1789998118.253342:0:107990:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a38fb46d000 uarg=0000000000000000 20000000:01000000:0.0:1789998118.253379:0:107990:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789998118.253385:0:107990:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789998118.253390:0:107990:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789998118.254137:0:107991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789998118.254312:0:107990:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789998118.264418:0:107990:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789998118.264450:0:107990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.264542:0:107990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea6f expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.264551:0:107990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea7d expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.264558:0:107990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea8b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.264568:0:107990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 9 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.264576:0:107990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.264632:0:107990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 9 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.264648:0:107990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 9 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998118.264807:0:107990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107990:1876946713130624:192.168.204.4@tcp:104: 00010000:00010000:0.0:1789998118.264926:0:107990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ea8b expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.264934:0:107990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ea8b expref: 18 pid: 5804 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998118.264943:0:107990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107990:1876946713130752:0@lo:104: 00000100:00100000:0.0:1789998118.264983:0:107990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998118.265019:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713130752 00000100:00100000:0.0:1789998118.265025:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713130752 00000100:00100000:0.0:1789998118.265070:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789998118.265078:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:107990:x1876946713130752:12345-0@lo:104: 00010000:00010000:0.0:1789998118.265389:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.265434:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998118.265440:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:107990:x1876946713130752:12345-0@lo:104: Request processed in 363us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998118.265447:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00010000:00010000:0.0:1789998118.265488:0:107990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ea7d expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.265497:0:107990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ea7d expref: 18 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998118.265506:0:107990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107990:1876946713130880:0@lo:104: 00000100:00100000:0.0:1789998118.265527:0:107990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998118.265548:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713130880 00000100:00100000:0.0:1789998118.265551:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713130880 00000100:00100000:0.0:1789998118.265574:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789998118.265580:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:107990:x1876946713130880:12345-0@lo:104: 00010000:00010000:0.0:1789998118.265588:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.265617:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789998118.265621:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:107990:x1876946713130880:12345-0@lo:104: Request processed in 42us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998118.265627:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:0.0:1789998118.266139:0:107990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ea6f expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266156:0:107990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ea6f expref: 18 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998118.266166:0:107990:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107990:1876946713131008:0@lo:104: 00000100:00100000:0.0:1789998118.266198:0:107990:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998118.266231:0:107990:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789998118.266262:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713131008 00000100:00100000:2.0:1789998118.266267:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713131008 00000100:00100000:0.0:1789998118.266295:0:107990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107990:1876946713130752:0@lo:104: 00000100:00100000:0.0:1789998118.266305:0:107990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107990:1876946713130880:0@lo:104: 00000100:00100000:2.0:1789998118.266461:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789998118.266470:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:107990:x1876946713131008:12345-0@lo:104: 00010000:00010000:2.0:1789998118.266479:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998118.266555:0:107990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107990:1876946713131008:0@lo:104: 00010000:00010000:2.0:1789998118.266592:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789998118.266599:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:107990:x1876946713131008:12345-0@lo:104: Request processed in 131us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998118.266605:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00010000:00010000:0.0:1789998118.266641:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789998118.266647:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266715:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789998118.266720:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266728:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.266810:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789998118.266817:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.266824:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:1.0:1789998118.266827:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.266834:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998118.266834:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998118.266841:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:1.0:1789998118.266842:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998118.266846:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789998118.266882:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266882:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.266890:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998118.266890:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998118.266899:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266907:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052be00/0x65b43101d592ea8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea92 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.266915:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266919:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789998118.266921:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b800/0x65b43101d592ea7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea84 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266922:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266929:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b000 already unused, calling callback (ffffffffc1aa8c20) 00010000:00010000:1.0:1789998118.266930:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998118.266932:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789998118.266932:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.266934:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998118.266939:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.266941:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1789998118.266945:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998118.266950:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789998118.266962:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.266967:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789998118.267006:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713131136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998118.267006:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713131392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998118.267036:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998118.267069:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713131136 00000100:00100000:1.0:1789998118.267074:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713131136 00010000:00010000:0.0:1789998118.267079:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.267086:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052b000/0x65b43101d592ea6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea76 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.267098:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998118.267100:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998118.267102:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea7d expref: 19 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998118.267102:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998118.267129:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1789998118.267137:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713131136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998118.267147:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998118.267152:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea7d expref: 19 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.267161:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ea7d expref: 19 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.267174:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3e00/0x65b43101d592ea84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ea7d expref: 19 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998118.267185:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713131264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998118.267185:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998118.267203:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998118.267207:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713131136:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998118.267213:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:1.0:1789998118.267226:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713131264 00000100:00100000:1.0:1789998118.267229:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713131264 00000100:00100000:2.0:1789998118.267234:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713131136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998118.267239:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea8b expref: 18 pid: 5804 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998118.267258:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1789998118.267263:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713131264:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998118.267269:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789998118.267269:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789998118.267273:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea8b expref: 18 pid: 5804 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.267281:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ea8b expref: 18 pid: 5804 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998118.267291:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2000/0x65b43101d592ea92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ea8b expref: 18 pid: 5804 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998118.267292:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713131392 00000100:00100000:2.0:1789998118.267296:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713131392 00010000:00010000:1.0:1789998118.267304:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789998118.267308:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea6f expref: 18 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998118.267327:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789998118.267327:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713131264:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998118.267332:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713131392:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998118.267333:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00010000:00010000:2.0:1789998118.267339:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998118.267343:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea6f expref: 17 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.267351:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ea6f expref: 17 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.267361:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0200/0x65b43101d592ea76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ea6f expref: 17 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.267379:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998118.267414:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:3284:x1876946713131392:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998118.267419:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789998118.267445:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713131264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998118.267463:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713131392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789998118.272267:0:107990:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107990:1876946713130624:192.168.204.4@tcp:104: 00010000:00010000:3.0:1789998118.272312:0:107990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998118.275831:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998118.275921:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704645376 00000100:00100000:2.0:1789998118.275931:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704645376 00010000:00010000:2.0:1789998118.275969:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 10 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998118.276001:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 473 00000100:00100000:2.0:1789998118.276010:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:2355:x1876946704645376:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789998118.276025:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998118.276031:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 10 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276043:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 10 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276061:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2c00/0x65b43101d592eab5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf317 expref: 10 pid: 7594 timeout: 2406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276080:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276088:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276113:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276120:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276128:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276134:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276141:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e1200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998118.276145:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276152:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276168:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998118.276178:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789998118.276202:0:107990:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998118.276214:0:107990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998118.276221:0:107990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e1200/0x65b43101d592eadf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998118.276239:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24fef93e-9c02-4b13-b7a6-fb1fb5333935+9:2355:x1876946704645376:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 228us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998118.276247:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 473 00010000:00010000:1.0:1789998118.667160:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998119.371286:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713131520:0@lo:400:kworker.0 00000100:00100000:2.0:1789998119.371324:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713131648:0@lo:400:kworker.0 00000100:00100000:0.0:1789998119.371381:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713131904:0@lo:400:kworker.0 00000100:00100000:2.0:1789998119.371447:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998119.371497:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713132160:0@lo:400:kworker.0 00000100:00100000:3.0:1789998119.371514:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998119.371529:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998119.371565:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789998119.371566:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713132032:0@lo:400:kworker.0 00000100:00100000:2.0:1789998119.371574:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713131776:0@lo:400:kworker.0 00000100:00100000:3.0:1789998119.371606:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998119.371613:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998119.371686:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713131648 00000100:00100000:3.0:1789998119.371694:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713132032 00000100:00100000:2.0:1789998119.371694:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713131648 00000100:00100000:3.0:1789998119.371701:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713132032 00000100:00100000:2.0:1789998119.371746:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713132160 00000100:00100000:2.0:1789998119.371751:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713132160 00000100:00100000:3.0:1789998119.371768:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1789998119.371780:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713132032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998119.371781:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713131776 00000100:00100000:2.0:1789998119.371785:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713131776 00000100:00100000:2.0:1789998119.371810:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1691 00000100:00100000:2.0:1789998119.371819:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713131648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998119.371869:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713132032:12345-0@lo:400:kworker.0 Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998119.371877:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1789998119.371885:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1876946713131648:12345-0@lo:400:kworker.0 Request processed in 67us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.371893:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1691 00000100:00100000:2.0:1789998119.371911:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1789998119.371920:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713132160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998119.371952:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713132032:0@lo:400:kworker.0 00000100:00100000:2.0:1789998119.371958:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1876946713132160:12345-0@lo:400:kworker.0 Request processed in 38us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.371967:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:2.0:1789998119.371983:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:2.0:1789998119.371990:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713131776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998119.372021:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713131776:12345-0@lo:400:kworker.0 Request processed in 32us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.372027:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00100000:0.0:1789998119.373618:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789998119.373698:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789998119.373716:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998119.373733:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713131904 00000100:00100000:0.0:1789998119.373740:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713131904 00000100:00100000:0.0:1789998119.373784:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1789998119.373793:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713131904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998119.373837:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713131904:12345-0@lo:400:kworker.0 Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998119.373857:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00080000:0.0:1789998119.373875:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998119.373908:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713131904:0@lo:400:kworker.0 00000100:00100000:0.0:1789998119.373961:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713131776:0@lo:400:kworker.0 00000100:00100000:0.0:1789998119.373979:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3282:1876946713131648:0@lo:400:kworker.0 00000100:00100000:0.0:1789998119.374109:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3282:1876946713132160:0@lo:400:kworker.0 00000100:00100000:2.0:1789998119.375179:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713131520 00000100:00100000:2.0:1789998119.375187:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713131520 00000100:00100000:2.0:1789998119.375240:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1789998119.375249:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:3285:x1876946713131520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998119.375313:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:3285:x1876946713131520:12345-0@lo:400:kworker.0 Request processed in 66us (3800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.375320:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1789998119.376174:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713131520:0@lo:400:kworker.0 00000100:00100000:0.0:1789998119.581872:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998119.583440:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704645504 00000100:00100000:2.0:1789998119.583451:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704645504 00000100:00100000:2.0:1789998119.583505:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1364 00000100:00100000:2.0:1789998119.583514:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+9:64555:x1876946704645504:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998119.583531:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789998119.583550:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592eae6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf348 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998119.583576:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592eae6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf348 expref: 10 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998119.583585:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592eae6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf348 expref: 10 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998119.583594:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2400, rc 0) 00000100:00100000:2.0:1789998119.583994:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64555:x1876946704645504:12345-192.168.204.4@tcp:101:ll_cfg_requeue.0 Request processed in 477us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.584006:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1364 00000100:00100000:0.0:1789998119.590893:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998119.590972:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704645632 00000100:00100000:2.0:1789998119.590982:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704645632 00000100:00100000:2.0:1789998119.591037:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1365 00000100:00100000:2.0:1789998119.591046:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64555:x1876946704645632:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998119.591368:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64555:x1876946704645632:12345-192.168.204.4@tcp:501:ll_cfg_requeue.0 Request processed in 321us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.591377:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1365 00000100:00100000:3.0:1789998119.595185:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998119.595318:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704645760 00000100:00100000:2.0:1789998119.595332:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704645760 00000100:00100000:2.0:1789998119.595396:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1366 00000100:00100000:2.0:1789998119.595407:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64555:x1876946704645760:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789998119.596928:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:64555:x1876946704645760:12345-192.168.204.4@tcp:503:ll_cfg_requeue.0 Request processed in 1514us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.596941:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1366 00010000:00010000:1.0:1789998119.691197:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789998119.818940:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789998119.819028:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38d0027000 from 10 10000000:01000000:3.0:1789998119.819035:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789998119.819087:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592eaed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998119.819099:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592eaed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998119.819111:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592eaed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998119.819150:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998119.819227:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998119.819627:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713132288 00000100:00100000:2.0:1789998119.819637:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713132288 00000100:00100000:2.0:1789998119.819719:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1789998119.819729:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+16:5807:x1876946713132288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998119.819744:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789998119.819759:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592eaf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592eaed expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998119.819785:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592eaf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592eaed expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998119.819801:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3600/0x65b43101d592eaf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eaed expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998119.819811:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3600, rc 0) 00000100:00100000:2.0:1789998119.819870:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713132288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.819877:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1789998119.820512:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb6480c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789998119.820540:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998119.820559:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592eaed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eaf4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998119.820571:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592eaed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592eaf4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998119.820681:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998119.820740:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998119.821043:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb6480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789998119.821058:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713132416 00000100:00100000:2.0:1789998119.821065:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713132416 00000100:00100000:2.0:1789998119.821104:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1789998119.821114:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713132416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998119.822050:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713132416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 932us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.822063:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:3.0:1789998119.826076:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998119.826162:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998119.826253:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998119.826310:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb6480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789998119.826404:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713132544 00000100:00100000:2.0:1789998119.826413:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713132544 00000100:00100000:2.0:1789998119.826525:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:2.0:1789998119.826537:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713132544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789998119.826811:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713132544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.826819:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1789998119.826919:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789998119.827723:0:108099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789998119.827923:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789998119.827949:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789998119.827960:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592eaed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eaf4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998119.827972:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052ba00/0x65b43101d592eaed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eaf4 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998119.827983:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789998119.827986:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38e0c2b000 from 10 10000000:01000000:3.0:1789998119.827988:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789998119.828019:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592eafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998119.828026:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592eafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998119.828036:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592eafb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998119.828055:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998119.828100:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998119.828141:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb6480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998119.828210:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713132672 00000100:00100000:0.0:1789998119.828217:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713132672 00000100:00100000:0.0:1789998119.828299:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:0.0:1789998119.828309:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+17:5807:x1876946713132672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998119.828320:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998119.828334:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0200/0x65b43101d592eb02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592eafb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.828355:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0200/0x65b43101d592eb02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592eafb expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.828365:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0200/0x65b43101d592eb02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eafb expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.828373:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0200, rc 0) 00000100:00100000:0.0:1789998119.828414:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713132672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998119.828420:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1789998119.828488:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998119.828502:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592eafb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb02 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998119.828510:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592eafb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592eb02 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998119.828557:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998119.828596:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998119.828690:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb6480c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789998119.828923:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713132800 00000100:00100000:2.0:1789998119.828929:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713132800 00000100:00100000:2.0:1789998119.828965:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1789998119.828972:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713132800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789998119.829221:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713132800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998119.829228:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1789998119.829310:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789998119.829358:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789998119.829398:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998119.829418:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fb6480c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998119.829750:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713132928 00000100:00100000:0.0:1789998119.829757:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713132928 00000100:00100000:0.0:1789998119.829794:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1789998119.829802:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713132928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789998119.829972:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713132928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998119.829978:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:0.0:1789998119.830017:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713132928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789998119.830695:0:108100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789998119.830742:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789998119.830761:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789998119.830770:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592eafb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb02 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.830780:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052bc00/0x65b43101d592eafb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb02 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998119.830791:0:5807:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789998119.830794:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a38e9732000 from 10 10000000:01000000:0.0:1789998119.830796:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789998119.830824:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592eb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.830831:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592eb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.830855:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592eb09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998119.830872:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713133056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789998119.830911:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998119.830931:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789998119.830946:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713133056 00000100:00100000:0.0:1789998119.830950:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713133056 00000100:00100000:0.0:1789998119.830973:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1789998119.830980:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713133056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998119.830989:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998119.831000:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e1c00/0x65b43101d592eb10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592eb09 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.831020:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e1c00/0x65b43101d592eb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592eb09 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.831029:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e1c00/0x65b43101d592eb10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eb09 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.831043:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e1c00, rc 0) 00000100:00100000:0.0:1789998119.831071:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713133056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998119.831076:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:0.0:1789998119.831108:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713133056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998119.831122:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592eb09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.831130:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592eb09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592eb10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998119.831169:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713133184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789998119.831192:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998119.831204:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789998119.831214:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713133184 00000100:00100000:0.0:1789998119.831217:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713133184 00000100:00100000:0.0:1789998119.831233:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:0.0:1789998119.831238:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713133184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789998119.831437:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713133184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998119.831444:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:0.0:1789998119.831473:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713133184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789998119.831496:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713133312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789998119.831533:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998119.831546:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c77c7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789998119.831556:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713133312 00000100:00100000:0.0:1789998119.831559:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713133312 00000100:00100000:0.0:1789998119.831573:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:0.0:1789998119.831577:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713133312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789998119.831714:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713133312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998119.831720:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:0.0:1789998119.831752:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713133312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789998119.832430:0:108101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789998119.832466:0:5807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789998119.832478:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789998119.832485:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592eb09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998119.832494:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a39020e1600/0x65b43101d592eb09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb10 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998120.715308:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998121.418854:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713133568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998121.418855:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789998121.418872:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713133440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998121.419331:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998121.419394:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713133440 00000100:00100000:0.0:1789998121.419408:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713133440 00000100:00080000:2.0:1789998121.419474:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998121.419484:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:0.0:1789998121.419495:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713133440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789998121.419532:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998121.419589:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713133440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998121.419599:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:0.0:1789998121.419635:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998121.419703:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713133568 00000100:00100000:0.0:1789998121.419707:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713133568 00000100:00100000:2.0:1789998121.419725:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713133440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998121.419739:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1789998121.419748:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713133568:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789998121.419758:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789998121.419769:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998121.419819:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713133568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998121.419827:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1789998121.419847:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713133568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789998121.738853:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789998122.267311:0:108188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: finish setup 09:42:01 (1789998121) === 00010000:00010000:1.0:1789998122.764884:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998123.224001:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998123.224118:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704646144 00000100:00100000:2.0:1789998123.224135:0:5795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704646144 00000100:00100000:2.0:1789998123.224231:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:2.0:1789998123.224244:0:5795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c54f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:2352:x1876946704646144:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789998123.224261:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998123.224294:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592eae6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf348 expref: 10 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998123.224314:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998123.224369:0:5795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c54f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+9:2352:x1876946704646144:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 128us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998123.224376:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 22 00000100:00100000:1.0:1789998123.228856:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998123.228973:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998123.232215:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704645888 00000100:00100000:0.0:1789998123.232233:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704645888 00000100:00100000:1.0:1789998123.234159:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998123.234293:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704646016 00000100:00100000:2.0:1789998123.234303:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704646016 00000100:00100000:2.0:1789998123.234361:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:3.0:1789998123.234369:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704646272 00000100:00100000:2.0:1789998123.234375:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24fef93e-9c02-4b13-b7a6-fb1fb5333935+10:2355:x1876946704645888:12345-192.168.204.4@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789998123.234377:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704646272 00010000:00010000:2.0:1789998123.234395:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998123.234417:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b600/0x65b43101d592eaa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2e6 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998123.234434:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 681 00010000:00010000:2.0:1789998123.234437:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998123.234445:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8dd0da-5890-47e9-b68b-29f185a97bb5+5:2351:x1876946704646272:12345-192.168.204.4@tcp:9:umount.0 00000020:00000080:3.0:1789998123.234472:0:6658:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592eaca 00000100:00080000:3.0:1789998123.234481:0:6658:0:(import.c:65:import_set_state_nolock()) ffff8a37c5dc4000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789998123.234513:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24fef93e-9c02-4b13-b7a6-fb1fb5333935+9:2355:x1876946704645888:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 142us (5667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998123.234521:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 23 00000100:00100000:2.0:1789998123.234556:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00100000:2.0:1789998123.234563:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24fef93e-9c02-4b13-b7a6-fb1fb5333935+8:2355:x1876946704646016:12345-192.168.204.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789998123.234571:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998123.234582:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3a00/0x65b43101d592eaae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf310 expref: 8 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998123.234593:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998123.234611:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:24fef93e-9c02-4b13-b7a6-fb1fb5333935+7:2355:x1876946704646016:12345-192.168.204.4@tcp:103:ldlm_bl.0 Request processed in 49us (5638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998123.234617:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 24 00000100:00080000:2.0:1789998123.234671:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789998123.235014:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789998123.235171:0:6658:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:3.0:1789998123.235967:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee8dd0da-5890-47e9-b68b-29f185a97bb5+2:2351:x1876946704646272:12345-192.168.204.4@tcp:9:umount.0 Request processed in 1522us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998123.235978:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 681 00000100:00100000:1.0:1789998123.241841:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998123.241952:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704646400 00000100:00100000:0.0:1789998123.241965:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704646400 00000100:00100000:0.0:1789998123.242051:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 682 00000100:00100000:0.0:1789998123.242063:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+5:2351:x1876946704646400:12345-192.168.204.4@tcp:9:umount.0 00000020:00000080:0.0:1789998123.242097:0:6656:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592eac3 00000100:00080000:0.0:1789998123.242108:0:6656:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789998123.242220:0:6656:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1789998123.242557:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+2:2351:x1876946704646400:12345-192.168.204.4@tcp:9:umount.0 Request processed in 495us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998123.242566:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 682 00010000:00010000:3.0:1789998123.243431:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789998123.246197:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998123.255014:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998123.257479:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704646656 00000100:00100000:2.0:1789998123.257497:0:5810:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704646656 00000100:00100000:2.0:1789998123.257598:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1264 00000100:00100000:2.0:1789998123.257612:0:5810:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+6:2351:x1876946704646656:12345-192.168.204.4@tcp:39:umount.0 00000020:00000080:2.0:1789998123.257682:0:5810:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592eabc 00000020:00010000:2.0:1789998123.257692:0:5810:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a37c7300000: total 0 00000100:00080000:2.0:1789998123.257698:0:5810:0:(import.c:65:import_set_state_nolock()) ffff8a37c7303800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789998123.257722:0:5810:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967778 00000020:00010000:1.0:1789998123.257759:0:6673:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a37c7300000: total 0 00010000:00010000:1.0:1789998123.257765:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998123.257899:0:6673:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c7300000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789998123.258112:0:6673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a38e062dc00) 00010000:00010000:1.0:1789998123.258117:0:6673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789998123.258192:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a38e0fb2400/0x65b43101d592ead8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf341 expref: 5 pid: 12471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998123.258220:0:6673:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c7300000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789998123.258235:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998123.258237:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998123.258240:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998123.258251:0:5810:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee8dd0da-5890-47e9-b68b-29f185a97bb5+3:2351:x1876946704646656:12345-192.168.204.4@tcp:39:umount.0 Request processed in 641us (3246us total) trans 4294967779 rc 0/0 00000100:00100000:2.0:1789998123.258260:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1264 00000100:00080000:0.0:1789998123.258439:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998123.282647:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998123.282824:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704646912 00000100:00100000:2.0:1789998123.282837:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704646912 00000100:00100000:2.0:1789998123.282938:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1376 00000100:00100000:2.0:1789998123.282951:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+7:2351:x1876946704646912:12345-192.168.204.4@tcp:251:umount.0 00000020:00000080:2.0:1789998123.283010:0:5803:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592ea99 00000020:00010000:2.0:1789998123.283018:0:5803:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a37c7305000: total 0 00000100:00080000:2.0:1789998123.283023:0:5803:0:(import.c:65:import_set_state_nolock()) ffff8a37c7301000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1789998123.283171:0:5798:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a37c7305000: total 0 00010000:00010000:1.0:1789998123.283220:0:5798:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c7305000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789998123.283256:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b400/0x65b43101d592eaa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf2df expref: 3 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998123.283274:0:5798:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c7305000, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1789998123.283281:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4867850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:24fef93e-9c02-4b13-b7a6-fb1fb5333935+2:2351:x1876946704646912:12345-192.168.204.4@tcp:251:umount.0 Request processed in 330us (644us total) trans 0 rc 0/0 00010000:00010000:1.0:1789998123.283284:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998123.283287:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998123.283290:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998123.283294:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1376 00000020:00000080:2.0:1789998123.283306:0:5803:0:(genops.c:885:class_export_put()) final put ffff8a37c7305000/24fef93e-9c02-4b13-b7a6-fb1fb5333935 00000020:00000080:1.0:1789998123.283372:0:84165:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c7305000/24fef93e-9c02-4b13-b7a6-fb1fb5333935 for MGS 00000020:00000080:1.0:1789998123.283413:0:84165:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c7301000 for MGS 00010000:00010000:3.0:1789998123.786957:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998124.491733:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713133696:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.491742:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713133952:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492063:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998124.492064:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998124.492139:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713134208:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492143:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789998124.492153:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713133824:0@lo:400:kworker.0 00000100:00100000:1.0:1789998124.492178:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998124.492188:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998124.492207:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789998124.492216:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713134080:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492219:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713134336:0@lo:400:kworker.0 00000100:00100000:1.0:1789998124.492269:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998124.492270:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998124.492313:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713134208 00000100:00100000:1.0:1789998124.492323:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713134208 00000100:00100000:0.0:1789998124.492324:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713133952 00000100:00100000:0.0:1789998124.492330:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713133952 00000100:00100000:0.0:1789998124.492391:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1789998124.492399:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713134080 00000100:00100000:1.0:1789998124.492405:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713134080 00000100:00100000:0.0:1789998124.492405:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713133952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998124.492436:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1789998124.492445:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713134208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492472:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713133952:12345-0@lo:400:kworker.0 Request processed in 70us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998124.492480:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00100000:1.0:1789998124.492500:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713134208:12345-0@lo:400:kworker.0 Request processed in 54us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998124.492500:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713133824 00000100:00100000:0.0:1789998124.492505:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713133824 00000100:00100000:1.0:1789998124.492512:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1789998124.492533:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713134336 00000100:00100000:1.0:1789998124.492536:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1789998124.492537:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713134336 00000100:00100000:1.0:1789998124.492550:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713134080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492568:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1695 00000100:00100000:0.0:1789998124.492577:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713133824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998124.492587:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713134080:12345-0@lo:400:kworker.0 Request processed in 40us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998124.492594:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1789998124.492613:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713133824:12345-0@lo:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998124.492621:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1695 00000100:00080000:1.0:1789998124.492629:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998124.492635:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00080000:1.0:1789998124.492636:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789998124.492641:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998124.492645:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713134336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998124.492708:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713134080:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492713:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713134336:12345-0@lo:400:kworker.0 Request processed in 69us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998124.492720:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:1.0:1789998124.492725:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713134208:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492784:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713133824:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492796:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713134336:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492805:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713133952:0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492851:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713133696 00000100:00100000:0.0:1789998124.492854:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713133696 00000100:00100000:0.0:1789998124.492885:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:0.0:1789998124.492892:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713133696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998124.492925:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713133696:12345-0@lo:400:kworker.0 Request processed in 33us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998124.492931:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1789998124.493324:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713133696:0@lo:400:kworker.0 00010000:00010000:0.0:1789998124.812063:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998125.404549:0:108332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf8bf7bb0 20000000:00000080:2.0:1789998125.404572:0:108332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38d8e89000 uarg=0000000000000000 10000000:01000000:3.0:1789998125.446103:0:108332:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998125.446134:0:108332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998125.446246:0:108332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ea3e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998125.446255:0:108332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998125.446302:0:108332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ea3e expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998125.446317:0:108332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ea3e expref: 18 pid: 5804 timeout: 2414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998125.446332:0:108332:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108332:1876946713134464:0@lo:104: 00000100:00100000:3.0:1789998125.446406:0:108332:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998125.446533:0:108332:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c574f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998125.446584:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713134464 00000100:00100000:0.0:1789998125.446594:0:5794:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713134464 00000100:00100000:2.0:1789998125.447019:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789998125.447077:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38e03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:108332:x1876946713134464:12345-0@lo:104: 00010000:00010000:3.0:1789998125.447093:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998125.447173:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998125.447178:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38e03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:108332:x1876946713134464:12345-0@lo:104: Request processed in 151us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998125.447185:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00010000:0.0:1789998125.447277:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998125.447285:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447293:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0c00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789998125.447297:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447306:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998125.447313:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998125.447319:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789998125.447361:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447368:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998125.447389:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447396:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a39020e0c00/0x65b43101d592ea3e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ea45 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447419:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998125.447421:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998125.447423:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998125.447436:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713134592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789998125.447470:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998125.447513:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713134592 00000100:00100000:0.0:1789998125.447518:0:5797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713134592 00010000:00010000:0.0:1789998125.447538:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea3e expref: 19 pid: 5804 timeout: 2414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998125.447561:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1789998125.447567:0:5797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713134592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998125.447578:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789998125.447583:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ea3e expref: 19 pid: 5804 timeout: 2414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447593:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ea3e expref: 19 pid: 5804 timeout: 2414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447610:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447621:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447635:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447642:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447649:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447685:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447690:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b200 already unused, calling callback (ffffffffc1492910) 00010000:00010000:0.0:1789998125.447694:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447700:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447709:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998125.447718:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789998125.447760:0:5797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713134592:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998125.447766:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1789998125.447803:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713134592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998125.447997:0:108332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2200/0x65b43101d592ea45 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ea3e expref: 18 pid: 5804 timeout: 2414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998125.448009:0:108332:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b31f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108332:1876946713134464:0@lo:104: 00010000:00010000:2.0:1789998125.448023:0:108332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998125.448032:0:108332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998125.448040:0:108332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998125.448046:0:108332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b200/0x65b43101d592eb17 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789998125.588060:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee8dd0da-5890-47e9-b68b-29f185a97bb5 00000020:00000080:1.0:1789998125.588071:0:7614:0:(genops.c:885:class_export_put()) final put ffff8a37c5dc0800/ee8dd0da-5890-47e9-b68b-29f185a97bb5 00000020:00000080:1.0:1789998125.588100:0:84165:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c5dc0800/ee8dd0da-5890-47e9-b68b-29f185a97bb5 for lustre-OST0001 00000020:00000080:1.0:1789998125.588143:0:84165:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c5dc4000 for lustre-OST0001 00000001:00100000:1.0:1789998125.605405:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee8dd0da-5890-47e9-b68b-29f185a97bb5 00000020:00000080:1.0:1789998125.605416:0:6684:0:(genops.c:885:class_export_put()) final put ffff8a37c6ec3000/ee8dd0da-5890-47e9-b68b-29f185a97bb5 00000020:00000080:1.0:1789998125.605445:0:84165:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c6ec3000/ee8dd0da-5890-47e9-b68b-29f185a97bb5 for lustre-OST0000 00000020:00000080:1.0:1789998125.605489:0:84165:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c6ec7000 for lustre-OST0000 00010000:00010000:1.0:1789998125.838253:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789998126.053121:0:108382:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd23692af0 20000000:00000080:1.0:1789998126.053136:0:108382:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4f06000 uarg=0000000000000000 10000000:01000000:1.0:1789998126.056207:0:108382:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1789998126.056235:0:108382:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056253:0:108382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056269:0:108382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056276:0:108382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056293:0:108382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056301:0:108382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056309:0:108382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:1.0:1789998126.056313:0:108382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056321:0:108382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056335:0:108382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056343:0:108382:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.056350:0:108382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb2400/0x65b43101d592eb1e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998126.476801:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789998126.476810:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789998126.476814:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998126.476864:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998126.476878:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998126.476890:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998126.476921:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713134720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789998126.476997:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998126.477049:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c5f61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789998126.477071:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713134720 00000100:00100000:2.0:1789998126.477078:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713134720 00000100:00100000:2.0:1789998126.477126:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1789998126.477136:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713134720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998126.477150:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789998126.477163:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592eb25 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998126.477187:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592eb25 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998126.477204:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eb25 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998126.477214:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b3e00, rc 0) 00000100:00100000:2.0:1789998126.477258:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713134720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998126.477265:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1789998126.477326:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713134720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998126.477340:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998126.477350:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998126.477368:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789998126.477373:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998126.477381:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998126.539140:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789998126.539168:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713134976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998126.539313:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998126.539360:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713134976 00000100:00100000:2.0:1789998126.539370:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713134976 00000100:00100000:0.0:1789998126.539377:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713134848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998126.539404:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998126.539439:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713134848 00000100:00100000:2.0:1789998126.539444:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713134848 00000100:00100000:0.0:1789998126.539468:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1789998126.539482:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713134976:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789998126.539494:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998126.539499:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789998126.539524:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998126.539590:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713134976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998126.539686:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713134976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998126.543188:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:2.0:1789998126.544001:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713134848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789998126.544124:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998126.544227:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713134848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1022us (4822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998126.544236:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:1.0:1789998126.544633:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713134848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998126.546863:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000020:00000080:0.0:1789998126.723329:0:108430:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8cfb0150 20000000:00000080:0.0:1789998126.723351:0:108430:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c85ad800 uarg=0000000000000000 10000000:01000000:0.0:1789998126.723594:0:108430:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998126.723618:0:108430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998126.723637:0:108430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eb25 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998126.723646:0:108430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998126.723892:0:108430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592eb25 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998126.723908:0:108430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592eb25 expref: 18 pid: 5805 timeout: 2415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998126.723923:0:108430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108430:1876946713135104:0@lo:104: 00000100:00100000:0.0:1789998126.723992:0:108430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998126.724103:0:108430:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fae5c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789998126.724191:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713135104 00000100:00100000:2.0:1789998126.724199:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713135104 00000100:00100000:2.0:1789998126.724368:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789998126.724379:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:108430:x1876946713135104:12345-0@lo:104: 00010000:00010000:2.0:1789998126.724394:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998126.724518:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789998126.724526:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:108430:x1876946713135104:12345-0@lo:104: Request processed in 148us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998126.724533:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00010000:00010000:3.0:1789998126.724580:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789998126.724588:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724597:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789998126.724603:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724613:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789998126.724620:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998126.724627:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789998126.724679:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724686:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789998126.724721:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724729:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb25 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb2c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724747:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998126.724749:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998126.724751:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789998126.724764:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713135232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789998126.724797:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998126.724839:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713135232 00000100:00100000:3.0:1789998126.724843:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713135232 00010000:00010000:3.0:1789998126.724862:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592eb25 expref: 19 pid: 5805 timeout: 2415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998126.724884:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1789998126.724892:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713135232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998126.724902:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998126.724907:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592eb25 expref: 19 pid: 5805 timeout: 2415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724917:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592eb25 expref: 19 pid: 5805 timeout: 2415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724933:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724942:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724957:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724964:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724972:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724979:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724984:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998126.724988:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.724995:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.725004:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998126.725014:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998126.725041:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713135232:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998126.725048:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:3.0:1789998126.725078:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713135232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998126.725147:0:108430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592eb2c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592eb25 expref: 18 pid: 5805 timeout: 2415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998126.725158:0:108430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108430:1876946713135104:0@lo:104: 00010000:00010000:1.0:1789998126.725172:0:108430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.725181:0:108430:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.725188:0:108430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.725195:0:108430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb33 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998126.860434:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998127.370197:0:108478:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdaf4777b0 20000000:00000080:2.0:1789998127.370215:0:108478:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fb4b4c00 uarg=0000000000000000 10000000:01000000:2.0:1789998127.370424:0:108478:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998127.370446:0:108478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370462:0:108478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370474:0:108478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370480:0:108478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370491:0:108478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370498:0:108478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370504:0:108478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3a00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998127.370508:0:108478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370517:0:108478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370530:0:108478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370537:0:108478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998127.370543:0:108478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3a00/0x65b43101d592eb3a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1789998127.593752:0:5832:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee8dd0da-5890-47e9-b68b-29f185a97bb5 00000001:00080000:2.0:1789998127.593781:0:5832:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967779 is committed 00000020:00000080:2.0:1789998127.593788:0:5832:0:(genops.c:885:class_export_put()) final put ffff8a37c7300000/ee8dd0da-5890-47e9-b68b-29f185a97bb5 00000020:00000080:3.0:1789998127.593866:0:84165:0:(genops.c:844:class_export_destroy()) destroying export ffff8a37c7300000/ee8dd0da-5890-47e9-b68b-29f185a97bb5 for lustre-MDT0000 00000020:00000080:3.0:1789998127.593933:0:84165:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a37c7303800 for lustre-MDT0000 00010000:00010000:1.0:1789998127.883876:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789998128.653087:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789998128.653096:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789998128.653101:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998128.653151:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998128.653168:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998128.653180:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998128.653209:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713135360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789998128.653280:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998128.653333:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38f9c59300 going to sleep for 11 seconds 00000100:00100000:3.0:1789998128.653387:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713135360 00000100:00100000:3.0:1789998128.653396:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713135360 00000100:00100000:3.0:1789998128.653458:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1789998128.653467:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713135360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998128.653480:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998128.653494:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592eb41 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998128.653518:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592eb41 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998128.653530:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eb41 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998128.653540:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b400, rc 0) 00000100:00100000:3.0:1789998128.653592:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713135360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998128.653603:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:2.0:1789998128.653819:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713135360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998128.653835:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998128.653843:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998128.653863:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789998128.653867:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998128.653874:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998128.906834:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998129.611017:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713135616:0@lo:400:kworker.0 00000100:00100000:2.0:1789998129.611110:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998129.611116:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713135488:0@lo:400:kworker.0 00000100:00100000:0.0:1789998129.611163:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998129.611207:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713135744:0@lo:400:kworker.0 00000100:00100000:0.0:1789998129.611233:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998129.611259:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713135872:0@lo:400:kworker.0 00000100:00100000:2.0:1789998129.611274:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713136128:0@lo:400:kworker.0 00000100:00100000:0.0:1789998129.611298:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713135616 00000100:00100000:2.0:1789998129.611307:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998129.611308:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713135616 00000100:00100000:0.0:1789998129.611357:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713135744 00000100:00100000:0.0:1789998129.611360:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713135744 00000100:00100000:0.0:1789998129.611387:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713136128 00000100:00100000:0.0:1789998129.611391:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713136128 00000100:00100000:0.0:1789998129.611414:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:0.0:1789998129.611423:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713135616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998129.611823:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:2.0:1789998129.611834:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713135744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998129.612009:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998129.612055:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713135872 00000100:00100000:3.0:1789998129.612060:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713135872 00000100:00100000:3.0:1789998129.612096:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1789998129.612103:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c6b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713135872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998129.612147:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c6b32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713135872:12345-0@lo:400:kworker.0 Request processed in 44us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998129.612156:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1789998129.612206:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713135872:0@lo:400:kworker.0 00000100:00080000:1.0:1789998129.612706:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789998129.612713:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998129.612733:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1699 00000100:00100000:1.0:1789998129.612746:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713136128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998129.612806:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713136128:12345-0@lo:400:kworker.0 Request processed in 64us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998129.612817:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1699 00000100:00100000:2.0:1789998129.612831:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713135744:12345-0@lo:400:kworker.0 Request processed in 996us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998129.612841:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00100000:2.0:1789998129.612872:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713135488 00000100:00100000:2.0:1789998129.612877:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713135488 00000100:00100000:2.0:1789998129.612912:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:2.0:1789998129.612920:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713135488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998129.612955:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713135488:12345-0@lo:400:kworker.0 Request processed in 37us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998129.612963:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:2.0:1789998129.613015:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713135744:0@lo:400:kworker.0 00000100:00100000:2.0:1789998129.613057:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713135488:0@lo:400:kworker.0 00000100:00100000:2.0:1789998129.613070:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713136000:0@lo:400:kworker.0 00000100:00100000:2.0:1789998129.613103:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998129.613187:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713136128:0@lo:400:kworker.0 00000100:00100000:3.0:1789998129.613257:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713136000 00000100:00100000:3.0:1789998129.613262:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713136000 00000100:00080000:2.0:1789998129.613310:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789998129.613313:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:3.0:1789998129.613322:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713136000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998129.613370:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713136000:12345-0@lo:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998129.613377:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1789998129.613402:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713136000:0@lo:400:kworker.0 00000100:00100000:0.0:1789998129.613509:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713135616:12345-0@lo:400:kworker.0 Request processed in 2084us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998129.613518:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:2.0:1789998129.613533:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713135616:0@lo:400:kworker.0 00010000:00010000:1.0:1789998129.930945:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789998130.281439:0:108676:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf8dc6da0 20000000:00000080:0.0:1789998130.281463:0:108676:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fd8f0c00 uarg=0000000000000000 10000000:01000000:0.0:1789998130.282891:0:108676:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998130.282917:0:108676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998130.282937:0:108676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eb41 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998130.282946:0:108676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998130.282993:0:108676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592eb41 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998130.283009:0:108676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592eb41 expref: 18 pid: 7594 timeout: 2418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998130.283024:0:108676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108676:1876946713136256:0@lo:104: 00000100:00100000:0.0:1789998130.283097:0:108676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998130.283230:0:108676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa55a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789998130.283366:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713136256 00000100:00100000:3.0:1789998130.283375:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713136256 00000100:00100000:3.0:1789998130.283472:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1789998130.283484:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:108676:x1876946713136256:12345-0@lo:104: 00010000:00010000:3.0:1789998130.283498:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998130.283574:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789998130.283581:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:108676:x1876946713136256:12345-0@lo:104: Request processed in 100us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998130.283589:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00010000:00010000:2.0:1789998130.283651:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789998130.283680:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.283689:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998130.283694:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.283702:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998130.283722:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998130.283728:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998130.283780:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.283787:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789998130.283809:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.283815:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2000/0x65b43101d592eb41 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb48 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.283832:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998130.283834:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998130.283835:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998130.283857:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713136384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998130.283890:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998130.283929:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713136384 00000100:00100000:2.0:1789998130.283933:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713136384 00010000:00010000:2.0:1789998130.283956:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592eb41 expref: 19 pid: 7594 timeout: 2418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998130.283982:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789998130.283990:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713136384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998130.284002:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998130.284008:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592eb41 expref: 19 pid: 7594 timeout: 2418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284019:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592eb41 expref: 19 pid: 7594 timeout: 2418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284040:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284049:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284063:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284071:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284079:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284085:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284090:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998130.284095:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284104:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284120:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998130.284130:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998130.284160:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713136384:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998130.284166:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789998130.284233:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713136384:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789998130.284328:0:108676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b400/0x65b43101d592eb48 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592eb41 expref: 18 pid: 7594 timeout: 2418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998130.284340:0:108676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108676:1876946713136256:0@lo:104: 00010000:00010000:0.0:1789998130.284358:0:108676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998130.284367:0:108676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998130.284374:0:108676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998130.284381:0:108676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592eb4f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998130.959124:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998131.658873:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789998131.658897:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713136512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789998131.658974:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998131.659048:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713136512 00000100:00100000:1.0:1789998131.659056:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713136512 00000100:00100000:0.0:1789998131.659082:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713136640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998131.659109:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998131.659112:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:1.0:1789998131.659122:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713136512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998131.659142:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713136640 00000100:00100000:0.0:1789998131.659145:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713136640 00002000:00000024:1.0:1789998131.659157:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998131.659164:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:0.0:1789998131.659170:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713136640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998131.659186:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998131.659198:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713136512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998131.659205:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1789998131.659223:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713136640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998131.659229:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00080000:0.0:1789998131.659243:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789998131.659248:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789998131.659283:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713136640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789998131.659296:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713136512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789998131.978894:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789998132.106788:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789998132.106798:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789998132.106804:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998132.106939:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998132.106953:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998132.106967:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998132.107000:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb37d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713136768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789998132.107091:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998132.107250:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789998132.110309:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713136768 00000100:00100000:1.0:1789998132.110326:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713136768 00000100:00100000:0.0:1789998132.114985:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:0.0:1789998132.115009:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713136768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998132.115031:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998132.115054:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592eb56 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.115087:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592eb56 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.115099:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eb56 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.115109:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789998132.115346:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713136768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 347us (8254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.115357:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1789998132.115474:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb37d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713136768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998132.115498:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998132.115509:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998132.115532:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789998132.115538:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998132.115546:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998132.762214:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998132.762343:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704647040 00000100:00100000:1.0:1789998132.762354:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704647040 00000100:00100000:1.0:1789998132.762766:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1382 00000100:00100000:1.0:1789998132.762776:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1876946704647040:12345-192.168.204.4@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789998132.762809:0:5803:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 51d1e942-5b4f-4a8b-95c1-22b30ca307b2@192.168.204.4@tcp t0 exp 0000000000000000 cur 2321 last 0 00000020:00000080:1.0:1789998132.762841:0:5803:0:(genops.c:1384:class_connect()) connect: client 51d1e942-5b4f-4a8b-95c1-22b30ca307b2, cookie 0x65b43101d592eb64 00000100:00080000:0.0:1789998132.763239:0:5803:0:(import.c:65:import_set_state_nolock()) ffff8a38c53da800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789998132.763522:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4864050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+5:2351:x1876946704647040:12345-192.168.204.4@tcp:250:mount.lustre.0 Request processed in 682us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.763533:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1382 00000100:00100000:0.0:1789998132.766476:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998132.766568:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704647168 00000100:00100000:3.0:1789998132.766579:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704647168 00000100:00100000:3.0:1789998132.766647:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1383 00000100:00100000:3.0:1789998132.766701:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+5:65614:x1876946704647168:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789998132.766717:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998132.766736:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b000/0x65b43101d592eb6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf35d expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998132.766763:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b000/0x65b43101d592eb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf35d expref: 6 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998132.766774:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b000/0x65b43101d592eb6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf35d expref: 6 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998132.766784:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b000, rc 0) 00000100:00100000:3.0:1789998132.766848:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4865850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+6:65614:x1876946704647168:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 149us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998132.766855:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1383 00000100:00100000:1.0:1789998132.772154:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998132.772233:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704647296 00000100:00100000:2.0:1789998132.772245:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704647296 00000100:00100000:2.0:1789998132.772368:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1384 00000100:00100000:2.0:1789998132.772381:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+6:65614:x1876946704647296:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789998132.772758:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c4866850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+6:65614:x1876946704647296:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 378us (615us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789998132.772767:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1384 00000100:00100000:1.0:1789998132.774794:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998132.774928:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704647424 00000100:00100000:3.0:1789998132.774940:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704647424 00000100:00100000:3.0:1789998132.775001:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1385 00000100:00100000:3.0:1789998132.775013:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+6:65614:x1876946704647424:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789998132.775031:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789998132.775051:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e052b600/0x65b43101d592eb72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf364 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998132.775084:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b600/0x65b43101d592eb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf364 expref: 7 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998132.775097:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e052b600/0x65b43101d592eb72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf364 expref: 7 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998132.775106:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e052b600, rc 0) 00000100:00100000:3.0:1789998132.775171:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+7:65614:x1876946704647424:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 161us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998132.775178:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1385 00000100:00100000:3.0:1789998132.776734:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998132.776830:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704647552 00000100:00100000:0.0:1789998132.776839:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704647552 00000100:00100000:0.0:1789998132.776892:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1386 00000100:00100000:0.0:1789998132.776903:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+7:65614:x1876946704647552:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789998132.777241:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+8:65614:x1876946704647552:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 339us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.777249:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1386 00000100:00100000:1.0:1789998132.781757:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998132.781859:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704647680 00000100:00100000:3.0:1789998132.781870:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704647680 00000100:00100000:3.0:1789998132.781931:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1387 00000100:00100000:3.0:1789998132.781943:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+8:65614:x1876946704647680:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789998132.782234:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+8:65614:x1876946704647680:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 292us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998132.782242:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1387 00000100:00100000:1.0:1789998132.788446:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998132.788554:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704647808 00000100:00100000:0.0:1789998132.788566:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704647808 00000100:00100000:0.0:1789998132.788641:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1388 00000100:00100000:0.0:1789998132.788650:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+8:65633:x1876946704647808:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789998132.789014:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+8:65633:x1876946704647808:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 364us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.789022:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1388 00000100:00100000:1.0:1789998132.800621:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998132.800946:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704647936 00000100:00100000:3.0:1789998132.800959:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704647936 00000100:00100000:3.0:1789998132.801050:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1389 00000100:00100000:3.0:1789998132.801062:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+8:65633:x1876946704647936:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789998132.801457:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+8:65633:x1876946704647936:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 396us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998132.801465:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1389 00000100:00100000:1.0:1789998132.804620:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998132.804766:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704648064 00000100:00100000:0.0:1789998132.804778:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704648064 00000100:00100000:0.0:1789998132.804851:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1390 00000100:00100000:0.0:1789998132.804862:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+8:65614:x1876946704648064:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789998132.804881:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998132.804901:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0c00/0x65b43101d592eb79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf38e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.804935:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0c00/0x65b43101d592eb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf38e expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.804947:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0c00/0x65b43101d592eb79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf38e expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.804956:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0c00, rc 0) 00000100:00100000:0.0:1789998132.805025:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+9:65614:x1876946704648064:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 165us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.805032:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1390 00000100:00100000:1.0:1789998132.810434:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998132.810529:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704648192 00000100:00100000:0.0:1789998132.810541:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704648192 00000100:00100000:0.0:1789998132.810605:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1391 00000100:00100000:0.0:1789998132.810616:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+9:65614:x1876946704648192:12345-192.168.204.4@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789998132.810643:0:5804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789998132.810708:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789998132.810713:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789998132.810716:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789998132.810718:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789998132.814737:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+9:65614:x1876946704648192:12345-192.168.204.4@tcp:256:mount.lustre.0 Request processed in 4113us (4304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.814751:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1391 00000100:00100000:1.0:1789998132.819869:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998132.820235:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704648320 00000100:00100000:0.0:1789998132.820247:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704648320 00000100:00100000:0.0:1789998132.820310:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1392 00000100:00100000:0.0:1789998132.820418:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+9:65614:x1876946704648320:12345-192.168.204.4@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789998132.820439:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998132.820460:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0a00/0x65b43101d592eb80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7c319c3102aaf395 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.820494:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0a00/0x65b43101d592eb80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf395 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.820507:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0a00/0x65b43101d592eb80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.4@tcp remote: 0x7c319c3102aaf395 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998132.820517:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0a00, rc 0) 00000100:00100000:0.0:1789998132.820594:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65614:x1876946704648320:12345-192.168.204.4@tcp:101:mount.lustre.0 Request processed in 169us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.821909:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1392 00000100:00100000:1.0:1789998132.822796:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998132.822923:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704648448 00000100:00100000:3.0:1789998132.822933:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704648448 00000100:00100000:3.0:1789998132.822985:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1393 00000100:00100000:3.0:1789998132.823008:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65614:x1876946704648448:12345-192.168.204.4@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789998132.823312:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65614:x1876946704648448:12345-192.168.204.4@tcp:501:mount.lustre.0 Request processed in 305us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998132.823320:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1393 00000100:00100000:3.0:1789998132.825625:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998132.825897:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704648576 00000100:00100000:2.0:1789998132.825908:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704648576 00000100:00100000:2.0:1789998132.825965:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1394 00000100:00100000:2.0:1789998132.825975:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65614:x1876946704648576:12345-192.168.204.4@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789998132.826459:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65614:x1876946704648576:12345-192.168.204.4@tcp:503:mount.lustre.0 Request processed in 484us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998132.826469:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1394 00000100:00100000:1.0:1789998132.829861:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998132.830294:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704648704 00000100:00100000:3.0:1789998132.830641:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704648704 00000100:00100000:3.0:1789998132.830746:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1395 00000100:00100000:3.0:1789998132.830761:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65638:x1876946704648704:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789998132.831062:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65638:x1876946704648704:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 302us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998132.831071:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1395 00000100:00100000:1.0:1789998132.847183:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998132.847306:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704648832 00000100:00100000:0.0:1789998132.847318:0:5803:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704648832 00000100:00100000:0.0:1789998132.847423:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1396 00000100:00100000:0.0:1789998132.847434:0:5803:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65638:x1876946704648832:12345-192.168.204.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789998132.847745:0:5803:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:65638:x1876946704648832:12345-192.168.204.4@tcp:502:llog_process_th.0 Request processed in 312us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.847753:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1396 00000100:00100000:0.0:1789998132.859381:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998132.859504:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704648960 00000100:00100000:1.0:1789998132.859515:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704648960 00000100:00100000:1.0:1789998132.859604:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1265 00000100:00100000:1.0:1789998132.859614:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1876946704648960:12345-192.168.204.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789998132.859650:0:6536:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0f5c1393-0e16-400f-b0f5-cfea9bb30726@192.168.204.4@tcp t0 exp 0000000000000000 cur 2321 last 0 00000020:00000080:1.0:1789998132.859771:0:6536:0:(genops.c:1384:class_connect()) connect: client 0f5c1393-0e16-400f-b0f5-cfea9bb30726, cookie 0x65b43101d592eb87 00000004:00100000:1.0:1789998132.859806:0:6536:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789998132.860380:0:6536:0:(import.c:65:import_set_state_nolock()) ffff8a37c6ec7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789998132.860517:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:2351:x1876946704648960:12345-192.168.204.4@tcp:38:mount.lustre.0 Request processed in 903us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998132.860527:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1265 00000100:00100000:1.0:1789998132.863455:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998132.863554:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704649088 00000100:00100000:2.0:1789998132.863565:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704649088 00000100:00100000:2.0:1789998132.863693:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1266 00000100:00100000:2.0:1789998132.863705:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:0:x1876946704649088:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789998132.863761:0:12471:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1789998132.863828:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:0:x1876946704649088:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 126us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998132.863836:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1266 00000100:00080000:0.0:1789998132.863910:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998132.864080:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998132.864163:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704649216 00000100:00100000:0.0:1789998132.864168:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704649216 00000100:00100000:0.0:1789998132.864207:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1267 00000100:00100000:0.0:1789998132.864215:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:65614:x1876946704649216:12345-192.168.204.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789998132.864230:0:11799:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1789998132.864274:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:65614:x1876946704649216:12345-192.168.204.4@tcp:41:mount.lustre.0 Request processed in 60us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.864285:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1267 00000100:00100000:0.0:1789998132.867764:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998132.867854:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704649344 00000100:00100000:2.0:1789998132.867864:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704649344 00000100:00100000:2.0:1789998132.867929:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1268 00000100:00100000:2.0:1789998132.867940:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:65614:x1876946704649344:12345-192.168.204.4@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789998132.868031:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:65614:x1876946704649344:12345-192.168.204.4@tcp:40:mount.lustre.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998132.868039:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1268 00000100:00100000:2.0:1789998132.872537:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998132.872632:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998132.872754:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998132.872781:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704649472 00000100:00100000:0.0:1789998132.872792:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704649472 00000100:00100000:3.0:1789998132.872819:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704649600 00000100:00100000:3.0:1789998132.872823:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704649600 00000100:00100000:3.0:1789998132.872911:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 683 00000100:00100000:0.0:1789998132.872917:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 684 00000100:00100000:3.0:1789998132.872920:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876946704649600:12345-192.168.204.4@tcp:8:mount.lustre.0 00000100:00100000:0.0:1789998132.872922:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876946704649472:12345-192.168.204.4@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789998132.872950:0:6659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0f5c1393-0e16-400f-b0f5-cfea9bb30726@192.168.204.4@tcp t0 exp 0000000000000000 cur 2321 last 0 00010000:00080000:0.0:1789998132.872950:0:8169:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0f5c1393-0e16-400f-b0f5-cfea9bb30726@192.168.204.4@tcp t0 exp 0000000000000000 cur 2321 last 0 00000020:00000080:3.0:1789998132.872982:0:6659:0:(genops.c:1384:class_connect()) connect: client 0f5c1393-0e16-400f-b0f5-cfea9bb30726, cookie 0x65b43101d592eb8e 00000020:00000080:0.0:1789998132.872982:0:8169:0:(genops.c:1384:class_connect()) connect: client 0f5c1393-0e16-400f-b0f5-cfea9bb30726, cookie 0x65b43101d592eb95 00002000:00100000:0.0:1789998132.872993:0:8169:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0f5c1393-0e16-400f-b0f5-cfea9bb30726/ffff8a38c53d8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789998132.873004:0:8169:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789998132.873026:0:11802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704649728 00000100:00100000:1.0:1789998132.873030:0:11802:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704649728 00000100:00100000:1.0:1789998132.873061:0:11802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 129 00000100:00100000:1.0:1789998132.873068:0:11802:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:65614:x1876946704649728:12345-192.168.204.4@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789998132.873140:0:11802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789998132.873217:0:11802:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:65614:x1876946704649728:12345-192.168.204.4@tcp:33:mount.lustre.0 Request processed in 149us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998132.873225:0:11802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 129 00002000:00080000:0.0:1789998132.873279:0:8169:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789998132.873308:0:8169:0:(import.c:65:import_set_state_nolock()) ffff8a38c53dc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789998132.873640:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:2351:x1876946704649472:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 716us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.873648:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 684 00002000:00100000:0.0:1789998132.874012:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0f5c1393-0e16-400f-b0f5-cfea9bb30726/ffff8a37c7302000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789998132.874022:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789998132.874189:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789998132.874210:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c53db800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789998132.874928:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+6:2351:x1876946704649600:12345-192.168.204.4@tcp:8:mount.lustre.0 Request processed in 2002us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998132.874941:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 683 00010000:00010000:2.0:1789998133.004495:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998134.028698:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998134.731231:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713137152:0@lo:400:kworker.0 00000100:00100000:1.0:1789998134.731302:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998134.731394:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713136896:0@lo:400:kworker.0 00000100:00100000:2.0:1789998134.731432:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998134.731459:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789998134.731465:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713137024:0@lo:400:kworker.0 00000100:00100000:2.0:1789998134.731490:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998134.731521:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713137152 00000100:00100000:2.0:1789998134.731528:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713137152 00000100:00100000:2.0:1789998134.731590:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713137024 00000100:00100000:2.0:1789998134.731603:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713137024 00000100:00100000:2.0:1789998134.731629:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:2.0:1789998134.731637:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713137152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998134.731800:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713136896 00000100:00100000:0.0:1789998134.731805:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713136896 00000100:00100000:0.0:1789998134.731834:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1789998134.731841:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713136896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998134.731882:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713136896:12345-0@lo:400:kworker.0 Request processed in 42us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998134.731889:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00080000:0.0:1789998134.731919:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998134.731931:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00100000:0.0:1789998134.731938:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713137024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998134.731963:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713137024:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998134.731969:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00100000:0.0:1789998134.731987:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713137280:0@lo:400:kworker.0 00000100:00100000:0.0:1789998134.732013:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998134.732044:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713137280 00000100:00100000:0.0:1789998134.732048:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713137280 00000100:00100000:0.0:1789998134.732079:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1789998134.732085:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713137280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998134.732118:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713137280:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998134.732123:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00080000:0.0:1789998134.732140:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998134.732164:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713137280:0@lo:400:kworker.0 00000100:00100000:0.0:1789998134.732200:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713137024:0@lo:400:kworker.0 00000100:00100000:0.0:1789998134.732209:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713136896:0@lo:400:kworker.0 00000100:00100000:3.0:1789998134.733639:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713137536:0@lo:400:kworker.0 00000100:00100000:3.0:1789998134.733704:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998134.733739:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789998134.733745:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713137408:0@lo:400:kworker.0 00000100:00100000:3.0:1789998134.733771:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998134.733810:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713137536 00000100:00100000:3.0:1789998134.733817:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713137536 00000100:00100000:3.0:1789998134.733861:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:3.0:1789998134.733869:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713137536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998134.733911:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713137536:12345-0@lo:400:kworker.0 Request processed in 43us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998134.733918:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:3.0:1789998134.733953:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713137536:0@lo:400:kworker.0 00000100:00080000:3.0:1789998134.733974:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998134.734043:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713137408 00000100:00100000:0.0:1789998134.734048:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713137408 00000100:00100000:0.0:1789998134.734091:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1789998134.734097:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713137408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998134.734134:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713137408:12345-0@lo:400:kworker.0 Request processed in 38us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998134.734139:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1789998134.734217:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713137408:0@lo:400:kworker.0 00000100:00080000:3.0:1789998134.734238:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998134.734340:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1876946713137152:12345-0@lo:400:kworker.0 Request processed in 2702us (3036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998134.734347:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:1.0:1789998134.737348:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3282:1876946713137152:0@lo:400:kworker.0 00010000:00010000:1.0:1789998135.050997:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789998135.796299:0:6684:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f5c1393-0e16-400f-b0f5-cfea9bb30726 00000001:00100000:0.0:1789998135.804121:0:7614:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f5c1393-0e16-400f-b0f5-cfea9bb30726 00010000:00010000:2.0:1789998136.074899:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998136.780239:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789998136.780268:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713137664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998136.780351:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998136.781448:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713137792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998136.781500:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998136.781559:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713137664 00000100:00100000:2.0:1789998136.781651:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713137664 00000100:00080000:3.0:1789998136.781836:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998136.782454:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713137792 00000100:00100000:2.0:1789998136.782463:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713137792 00000100:00100000:2.0:1789998136.782499:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:2.0:1789998136.782521:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713137664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789998136.782835:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998136.782911:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713137664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 392us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998136.782919:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:2.0:1789998136.782939:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1789998136.782946:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713137792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789998136.782967:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998136.782996:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713137792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998136.783003:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00100000:2.0:1789998136.783078:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713137792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998136.783098:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713137664:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789998136.784718:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789998137.098943:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789998137.856080:0:5832:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f5c1393-0e16-400f-b0f5-cfea9bb30726 00000001:02000400:2.0:1789998137.953971:0:109025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25b: test nodemap info values ========= 09:42:16 (1789998136) 00010000:00010000:0.0:1789998138.125273:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998138.142005:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998138.142083:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998138.142119:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998138.142160:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998138.142234:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704649984 00000100:00100000:3.0:1789998138.142245:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704649984 00000100:00100000:3.0:1789998138.142317:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1703 00000100:00100000:3.0:1789998138.142328:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704649984:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998138.142403:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704649984:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 76us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998138.142410:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1703 00000100:00100000:0.0:1789998138.142493:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704650112 00000100:00100000:0.0:1789998138.142500:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704650112 00000100:00100000:0.0:1789998138.142622:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704650240 00000100:00100000:0.0:1789998138.142627:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704650240 00000100:00100000:0.0:1789998138.142687:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1192 00000100:00100000:0.0:1789998138.142695:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704650112:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998138.142737:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704650112:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 43us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998138.142744:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1192 00000100:00100000:0.0:1789998138.142761:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1193 00000100:00100000:0.0:1789998138.142769:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704650240:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998138.142799:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704650240:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998138.142808:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1193 00000100:00080000:1.0:1789998138.142858:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998138.142864:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789998138.142866:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998138.142933:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704649856 00000100:00100000:2.0:1789998138.142938:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704649856 00000100:00100000:2.0:1789998138.142976:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1398 00000100:00100000:2.0:1789998138.142985:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:2355:x1876946704649856:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998138.143015:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:2355:x1876946704649856:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 33us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998138.143022:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1398 00010000:00010000:2.0:1789998139.147150:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1789998139.300059:0:109073:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1789998139.315521:0:109073:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:2.0:1789998139.851007:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713138304:0@lo:400:kworker.0 00000100:00100000:2.0:1789998139.851082:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998139.851151:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789998139.851157:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713138176:0@lo:400:kworker.0 00000100:00100000:2.0:1789998139.851207:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998139.851243:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713138304 00000100:00100000:2.0:1789998139.851251:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713138304 00000100:00100000:2.0:1789998139.851330:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1789998139.851340:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713138304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998139.851390:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713138304:12345-0@lo:400:kworker.0 Request processed in 51us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998139.851396:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:2.0:1789998139.851419:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713138176 00000100:00100000:2.0:1789998139.851423:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713138176 00000100:00100000:2.0:1789998139.851462:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:2.0:1789998139.851469:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713138176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998139.851499:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713138176:12345-0@lo:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998139.851505:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00100000:2.0:1789998139.851554:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713138176:0@lo:400:kworker.0 00000100:00100000:2.0:1789998139.851568:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713138304:0@lo:400:kworker.0 00000100:00100000:3.0:1789998139.851768:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713138048:0@lo:400:kworker.0 00000100:00100000:3.0:1789998139.851800:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998139.851833:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713138560:0@lo:400:kworker.0 00000100:00100000:3.0:1789998139.851853:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998139.851875:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789998139.851881:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713137920:0@lo:400:kworker.0 00000100:00100000:3.0:1789998139.851907:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998139.851931:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713138432:0@lo:400:kworker.0 00000100:00100000:3.0:1789998139.851951:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998139.851979:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713137920 00000100:00100000:3.0:1789998139.851983:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713137920 00000100:00100000:3.0:1789998139.852010:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1789998139.852017:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713137920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998139.852052:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713137920:12345-0@lo:400:kworker.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998139.852058:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1789998139.852089:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713138432 00000100:00100000:3.0:1789998139.852093:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713138432 00000100:00100000:3.0:1789998139.852126:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1789998139.852133:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713138432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998139.852137:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713138048 00000100:00100000:2.0:1789998139.852141:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713138048 00000100:00100000:3.0:1789998139.852163:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713138432:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998139.852163:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713138560 00000100:00100000:2.0:1789998139.852166:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713138560 00000100:00100000:3.0:1789998139.852169:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1789998139.852185:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:2.0:1789998139.852191:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713138048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789998139.852197:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713137920:0@lo:400:kworker.0 00000100:00100000:3.0:1789998139.852206:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713138432:0@lo:400:kworker.0 00000100:00100000:2.0:1789998139.852220:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713138048:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998139.852223:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713138048:0@lo:400:kworker.0 00000100:00080000:1.0:1789998139.852322:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998139.852328:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789998139.852330:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998139.852400:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1706 00000100:00100000:1.0:1789998139.852409:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713138560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998139.852459:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1876946713138560:12345-0@lo:400:kworker.0 Request processed in 52us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998139.852465:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1706 00000100:00100000:1.0:1789998139.852493:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3285:1876946713138560:0@lo:400:kworker.0 00000100:00100000:2.0:1789998139.852634:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000020:00000080:3.0:1789998139.967073:0:109121:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbb753810 20000000:00000080:3.0:1789998139.967091:0:109121:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fad8f800 uarg=0000000000000000 10000000:01000000:3.0:1789998139.967769:0:109121:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998139.967789:0:109121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.967808:0:109121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592eb56 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.967817:0:109121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.967855:0:109121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592eb56 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.967875:0:109121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592eb56 expref: 18 pid: 5804 timeout: 2428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998139.967889:0:109121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109121:1876946713138688:0@lo:104: 00000100:00100000:3.0:1789998139.967946:0:109121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998139.968076:0:109121:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c13593c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789998139.968115:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713138688 00000100:00100000:2.0:1789998139.968122:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713138688 00000100:00100000:2.0:1789998139.968161:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789998139.968170:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109121:x1876946713138688:12345-0@lo:104: 00010000:00010000:2.0:1789998139.968182:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998139.968241:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789998139.968248:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109121:x1876946713138688:12345-0@lo:104: Request processed in 80us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998139.968255:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789998139.968318:0:109121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109121:1876946713138688:0@lo:104: 00010000:00010000:3.0:1789998139.968340:0:109121:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998139.968355:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998139.968364:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998139.968372:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:0.0:1789998139.968376:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998139.968386:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789998139.968393:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789998139.968400:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1789998139.968437:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998139.968456:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789998139.968480:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998139.968487:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2400/0x65b43101d592eb56 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592eb5d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998139.968503:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998139.968505:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789998139.968507:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998139.968508:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789998139.968523:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713138816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998139.968552:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998139.968842:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713138816 00000100:00100000:3.0:1789998139.968847:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713138816 00010000:00010000:3.0:1789998139.968866:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592eb56 expref: 19 pid: 5804 timeout: 2428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998139.968922:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:3.0:1789998139.968929:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713138816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998139.968939:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998139.968944:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592eb56 expref: 19 pid: 5804 timeout: 2428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.968953:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592eb56 expref: 19 pid: 5804 timeout: 2428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.968966:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592eb5d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592eb56 expref: 19 pid: 5804 timeout: 2428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.968985:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.968993:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.969005:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.969011:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.969018:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.969025:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.969030:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052b800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998139.969034:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.969042:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.969063:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998139.969072:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998139.969113:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713138816:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998139.969120:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:0.0:1789998139.969184:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713138816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789998139.969237:0:109121:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998139.969245:0:109121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998139.969252:0:109121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052b800/0x65b43101d592eb9c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998140.171240:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789998140.511500:0:109169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffbd4740e0 20000000:00000080:3.0:1789998140.511517:0:109169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fad8dc00 uarg=0000000000000000 10000000:01000000:3.0:1789998140.511851:0:109169:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998140.511872:0:109169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511889:0:109169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511900:0:109169:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511908:0:109169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511915:0:109169:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511923:0:109169:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511930:0:109169:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998140.511935:0:109169:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511944:0:109169:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511958:0:109169:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511967:0:109169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998140.511974:0:109169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052be00/0x65b43101d592eba3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789998141.098618:0:109219:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb3582330 20000000:00000080:3.0:1789998141.098636:0:109219:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae3b800 uarg=0000000000000000 10000000:01000000:3.0:1789998141.098942:0:109219:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998141.098966:0:109219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.098982:0:109219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.098993:0:109219:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.099000:0:109219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.099007:0:109219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.099016:0:109219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.099023:0:109219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998141.099028:0:109219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.099036:0:109219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.099049:0:109219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.099057:0:109219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.099064:0:109219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebaa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998141.194818:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789998141.324777:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789998141.324786:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789998141.324793:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998141.324850:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998141.324863:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998141.324875:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998141.324903:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713138944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789998141.324978:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998141.325051:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c2a520c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998141.325855:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713138944 00000100:00100000:0.0:1789998141.325866:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713138944 00000100:00100000:0.0:1789998141.325934:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1789998141.325945:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713138944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998141.325966:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998141.325985:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ebb1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.326018:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.326028:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.326038:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789998141.326102:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38d100bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713138944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998141.326108:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1789998141.328709:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713138944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998141.328743:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998141.328756:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998141.328783:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789998141.328789:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998141.328796:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789998141.634260:0:109267:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe67a727c0 20000000:00000080:0.0:1789998141.634279:0:109267:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38c54a2000 uarg=0000000000000000 10000000:01000000:0.0:1789998141.634498:0:109267:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1789998141.634521:0:109267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.634543:0:109267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.634552:0:109267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.634601:0:109267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.634618:0:109267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 18 pid: 5805 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998141.634635:0:109267:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109267:1876946713139072:0@lo:104: 00000100:00100000:0.0:1789998141.634783:0:109267:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998141.634927:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713139072 00000100:00100000:3.0:1789998141.634937:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713139072 00000100:00100000:0.0:1789998141.634950:0:109267:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c2a52540 going to sleep for 11 seconds 00000100:00100000:1.0:1789998141.635059:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789998141.635073:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109267:x1876946713139072:12345-0@lo:104: 00010000:00010000:1.0:1789998141.635088:0:6672:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998141.635205:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789998141.635212:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109267:x1876946713139072:12345-0@lo:104: Request processed in 143us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998141.635221:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789998141.635250:0:109267:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109267:1876946713139072:0@lo:104: 00010000:00010000:3.0:1789998141.635268:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789998141.635270:0:109267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635277:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635286:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2e00 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789998141.635290:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635299:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789998141.635306:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998141.635313:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789998141.635376:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635384:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789998141.635427:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635434:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b2e00/0x65b43101d592ebb1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebb8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998141.635448:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713139200:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998141.635452:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998141.635455:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998141.635457:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998141.635486:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998141.635565:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713139200 00000100:00100000:3.0:1789998141.635571:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713139200 00010000:00010000:3.0:1789998141.635595:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 19 pid: 5805 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998141.635623:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1789998141.635632:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c54f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713139200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998141.635644:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998141.635649:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 19 pid: 5805 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635689:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 19 pid: 5805 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635704:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0400/0x65b43101d592ebb8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ebb1 expref: 19 pid: 5805 timeout: 2430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635729:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635738:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635752:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635761:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635769:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635777:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635783:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a39020e0e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998141.635787:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635795:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635811:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998141.635821:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789998141.635825:0:109267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.635832:0:109267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998141.635836:0:109267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebbf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998141.635867:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c54f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713139200:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998141.635877:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1789998141.635893:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713139200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789998141.898923:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713139328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789998141.898992:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998141.899376:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789998141.899386:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713139456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998141.899435:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998141.899474:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713139328 00000100:00100000:1.0:1789998141.899484:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713139328 00000100:00100000:1.0:1789998141.899541:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713139456 00000100:00100000:1.0:1789998141.899544:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713139456 00000100:00100000:1.0:1789998141.899564:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1789998141.899573:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713139328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789998141.899618:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998141.899686:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713139328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998141.899693:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1789998141.899710:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:1.0:1789998141.899716:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713139456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789998141.899739:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789998141.899766:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713139456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998141.899772:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00080000:1.0:1789998141.899788:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789998141.899791:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998141.899828:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713139456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789998141.899844:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713139328:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1789998142.214268:0:109315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff51d6d040 20000000:00000080:3.0:1789998142.214284:0:109315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae3b000 uarg=0000000000000000 10000000:01000000:3.0:1789998142.214833:0:109315:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998142.214856:0:109315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214872:0:109315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214883:0:109315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214890:0:109315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214898:0:109315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214906:0:109315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214913:0:109315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998142.214917:0:109315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214925:0:109315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214938:0:109315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214950:0:109315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998142.214956:0:109315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebc6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998142.218803:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998142.796878:0:109364:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc6dffe50 20000000:00000080:2.0:1789998142.796897:0:109364:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4dfd000 uarg=0000000000000000 10000000:01000000:2.0:1789998142.797095:0:109364:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998142.797118:0:109364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797134:0:109364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797146:0:109364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797152:0:109364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797158:0:109364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797165:0:109364:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797171:0:109364:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998142.797176:0:109364:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797183:0:109364:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797197:0:109364:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797205:0:109364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998142.797211:0:109364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2400/0x65b43101d592ebcd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998143.244757:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789998143.244770:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789998143.244778:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998143.244782:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998143.244840:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998143.244857:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998143.244877:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998143.244912:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713139584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789998143.245016:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998143.245087:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38faf3d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789998143.245316:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713139584 00000100:00100000:2.0:1789998143.245331:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713139584 00000100:00100000:2.0:1789998143.245744:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:2.0:1789998143.245765:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713139584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998143.245788:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789998143.245817:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ebd4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998143.245854:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998143.245871:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998143.245883:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38fb4b2800, rc 0) 00000100:00100000:2.0:1789998143.246012:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713139584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 256us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998143.246021:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1789998143.246343:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713139584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789998143.246388:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998143.246403:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998143.246436:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789998143.246442:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998143.246452:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789998143.255574:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998143.255630:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998143.255763:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704650496 00000100:00100000:1.0:1789998143.255780:0:5811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704650496 00000100:00100000:2.0:1789998143.255811:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704650368 00000100:00100000:2.0:1789998143.255818:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704650368 00000100:00100000:1.0:1789998143.255876:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1707 00000100:00100000:2.0:1789998143.255895:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1402 00000100:00100000:1.0:1789998143.255905:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2354:x1876946704650496:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998143.255907:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:2355:x1876946704650368:12345-192.168.204.4@tcp:400:kworker.0 00000100:00080000:0.0:1789998143.255999:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998143.256016:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:2355:x1876946704650368:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 112us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998143.256025:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1402 00000100:00100000:1.0:1789998143.256225:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2354:x1876946704650496:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 336us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998143.256234:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1707 00000100:00100000:2.0:1789998143.256909:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998143.257042:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998143.257078:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704650624 00000100:00100000:2.0:1789998143.257087:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704650624 00000100:00080000:1.0:1789998143.257142:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789998143.257150:0:6658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704650752 00000100:00100000:2.0:1789998143.257158:0:6658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704650752 00000100:00100000:0.0:1789998143.257174:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1196 00000100:00080000:1.0:1789998143.257195:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998143.257214:0:6658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1197 00000100:00100000:2.0:1789998143.257229:0:6658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2354:x1876946704650752:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998143.257251:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704650624:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998143.257301:0:6658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2354:x1876946704650752:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 74us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998143.257312:0:6658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1197 00000100:00100000:1.0:1789998143.257561:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704650624:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 373us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998143.257574:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1196 00010000:00010000:3.0:1789998144.267752:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998144.525514:0:109512:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcce6a80c0 20000000:00000080:2.0:1789998144.525535:0:109512:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c4f04400 uarg=0000000000000000 10000000:01000000:2.0:1789998144.526517:0:109512:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998144.526545:0:109512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998144.526566:0:109512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998144.526575:0:109512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998144.526621:0:109512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998144.526640:0:109512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 18 pid: 5804 timeout: 2433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998144.526679:0:109512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109512:1876946713139712:0@lo:104: 00000100:00100000:2.0:1789998144.526759:0:109512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998144.526897:0:109512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37cb037f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789998144.527343:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713139712 00000100:00100000:0.0:1789998144.527365:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713139712 00000100:00100000:0.0:1789998144.527424:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1789998144.527434:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109512:x1876946713139712:12345-0@lo:104: 00010000:00010000:0.0:1789998144.527448:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998144.527529:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998144.527537:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109512:x1876946713139712:12345-0@lo:104: Request processed in 103us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998144.527544:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1789998144.527572:0:109512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109512:1876946713139712:0@lo:104: 00010000:00010000:2.0:1789998144.527593:0:109512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.527686:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789998144.527696:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.527705:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789998144.527709:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.527722:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789998144.527729:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998144.527736:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789998144.527778:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.527786:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789998144.527816:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.527823:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ebd4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebdb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.527841:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998144.527843:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998144.527844:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998144.527934:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713139840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789998144.527983:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998144.528405:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713139840 00000100:00100000:3.0:1789998144.528411:0:8409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713139840 00010000:00010000:3.0:1789998144.528438:0:8409:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 19 pid: 5804 timeout: 2433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998144.528473:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1789998144.528482:0:8409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3282:x1876946713139840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998144.528494:0:8409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789998144.528500:0:8409:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 19 pid: 5804 timeout: 2433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528514:0:8409:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 19 pid: 5804 timeout: 2433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528530:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ebdb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ebd4 expref: 19 pid: 5804 timeout: 2433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528545:0:8409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528554:0:8409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528568:0:8409:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528576:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528583:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528590:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528595:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3e00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998144.528599:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528606:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528634:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998144.528645:0:8409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789998144.528728:0:8409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3282:x1876946713139840:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (744us total) trans 0 rc 0/0 00010000:00010000:0.0:1789998144.528731:0:109512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998144.528740:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00010000:00010000:0.0:1789998144.528747:0:109512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998144.528755:0:109512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3e00/0x65b43101d592ebe2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998144.529584:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3282:1876946713139840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998144.971363:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713139968:0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.971438:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998144.971500:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713140480:0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.971524:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998144.971554:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789998144.971561:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713140352:0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.971586:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998144.971600:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713139968 00000100:00100000:2.0:1789998144.971609:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713139968 00000100:00100000:1.0:1789998144.971622:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713140096:0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.971648:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998144.971677:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713140480 00000100:00100000:2.0:1789998144.971681:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713140480 00000100:00100000:1.0:1789998144.971702:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789998144.971709:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c80b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713140224:0@lo:400:kworker.0 00000100:00100000:2.0:1789998144.971727:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713140096 00000100:00100000:2.0:1789998144.971731:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713140096 00000100:00100000:1.0:1789998144.971736:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998144.971761:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:2.0:1789998144.971773:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713139968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.971780:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:1.0:1789998144.971790:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713140480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.971838:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1876946713140480:12345-0@lo:400:kworker.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998144.971847:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00100000:2.0:1789998144.971848:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c80b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1876946713139968:12345-0@lo:400:kworker.0 Request processed in 76us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998144.971858:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00100000:1.0:1789998144.971969:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1710 00000100:00100000:1.0:1789998144.971978:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713140096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.972020:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1876946713140096:12345-0@lo:400:kworker.0 Request processed in 44us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998144.972026:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1710 00000100:00100000:1.0:1789998144.972046:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713140352 00000100:00100000:1.0:1789998144.972050:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713140352 00000100:00100000:1.0:1789998144.972090:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713140224 00000100:00100000:1.0:1789998144.972093:0:6656:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713140224 00000100:00100000:1.0:1789998144.972118:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1789998144.972125:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713140352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.972157:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713140352:12345-0@lo:400:kworker.0 Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998144.972164:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1789998144.972176:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1789998144.972181:0:6656:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713140224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.972207:0:6656:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713140224:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998144.972213:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00080000:1.0:1789998144.972239:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789998144.972243:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998144.972245:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789998144.972283:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713140352:0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.972295:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3283:1876946713139968:0@lo:400:kworker.0 00000100:00100000:1.0:1789998144.972304:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3283:1876946713140480:0@lo:400:kworker.0 00000100:00100000:2.0:1789998144.972486:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713140224:0@lo:400:kworker.0 00000100:00100000:2.0:1789998144.972503:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c80b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3284:1876946713140096:0@lo:400:kworker.0 00000020:00000080:3.0:1789998145.060516:0:109560:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2c0a7a10 20000000:00000080:3.0:1789998145.060534:0:109560:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae39800 uarg=0000000000000000 10000000:01000000:3.0:1789998145.060876:0:109560:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998145.060897:0:109560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060914:0:109560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060926:0:109560:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060933:0:109560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060940:0:109560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060948:0:109560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060954:0:109560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1492910) 00010000:00010000:3.0:1789998145.060958:0:109560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060968:0:109560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060983:0:109560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060990:0:109560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998145.060997:0:109560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052a400/0x65b43101d592ebe9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998145.291264:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998146.319791:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789998146.507457:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1789998146.507466:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:3.0:1789998146.507472:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789998146.507539:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998146.507564:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998146.507578:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998146.507612:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713140608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789998146.507732:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998146.507798:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998146.507959:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713140608 00000100:00100000:0.0:1789998146.507970:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713140608 00000100:00100000:0.0:1789998146.508041:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1789998146.508053:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713140608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998146.508069:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998146.508087:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ebf0 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998146.508112:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998146.508124:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998146.508135:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0e00, rc 0) 00000100:00100000:0.0:1789998146.508190:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713140608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998146.508197:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1789998146.508497:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fafc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713140608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998146.508516:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998146.508526:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998146.508549:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789998146.508553:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998146.508560:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998147.019758:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789998147.019783:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713140736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789998147.019856:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998147.019883:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713140736 00000100:00100000:0.0:1789998147.019895:0:6661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713140736 00000100:00100000:0.0:1789998147.019964:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:0.0:1789998147.019977:0:6661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713140736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998147.020016:0:6661:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789998147.020079:0:6661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fafc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713140736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998147.020087:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00080000:0.0:1789998147.020110:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789998147.021129:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713140864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789998147.021183:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998147.021264:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713140736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998147.021369:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713140864 00000100:00100000:2.0:1789998147.021376:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713140864 00000100:00080000:1.0:1789998147.021515:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789998147.021527:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1789998147.021538:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713140864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789998147.021578:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998147.021635:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7333b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1876946713140864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998147.021642:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:1.0:1789998147.021713:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb655500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3285:1876946713140864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789998147.340802:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789998147.764379:0:109755:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb31487a0 20000000:00000080:3.0:1789998147.764399:0:109755:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a38fae38c00 uarg=0000000000000000 00010000:00010000:3.0:1789998147.764953:0:109755:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c6ec3000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1789998147.764974:0:109755:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c6ec3000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1789998147.764991:0:109755:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1789998147.765009:0:109755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998147.765026:0:109755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998147.765036:0:109755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998147.766146:0:109755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998147.766181:0:109755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 18 pid: 7594 timeout: 2436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998147.766205:0:109755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109755:1876946713140992:0@lo:104: 00000100:00100000:3.0:1789998147.766278:0:109755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998147.766359:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713140992 00000100:00100000:1.0:1789998147.766368:0:5793:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713140992 00000100:00100000:3.0:1789998147.766371:0:109755:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37cb037b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789998147.766423:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789998147.766434:0:5793:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb37f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109755:x1876946713140992:12345-0@lo:104: 00010000:00010000:1.0:1789998147.766449:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789998147.766592:0:109755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c7330e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109755:1876946713140992:0@lo:104: 00010000:00010000:1.0:1789998147.766594:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789998147.766605:0:5793:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb37f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109755:x1876946713140992:12345-0@lo:104: Request processed in 172us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998147.766613:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00010000:00010000:2.0:1789998147.766616:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789998147.766626:0:109755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.766627:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.766647:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052a400 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:2.0:1789998147.766673:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.766683:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789998147.766691:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998147.766697:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1789998147.766729:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.766736:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789998147.766801:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1789998147.766822:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.766829:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e052a400/0x65b43101d592ebf0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ebf7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.766851:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998147.766853:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789998147.766854:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789998147.766886:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713141120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789998147.766920:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998147.767020:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713141120 00000100:00100000:2.0:1789998147.767025:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713141120 00010000:00010000:2.0:1789998147.767046:0:6674:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 19 pid: 7594 timeout: 2436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998147.767120:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1789998147.767128:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713141120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998147.767139:0:6674:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998147.767145:0:6674:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 19 pid: 7594 timeout: 2436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767155:0:6674:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 19 pid: 7594 timeout: 2436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767169:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a39020e0e00/0x65b43101d592ebf7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ebf0 expref: 19 pid: 7594 timeout: 2436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767191:0:6674:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767200:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767214:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767221:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767228:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767234:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767244:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e052be00 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998147.767249:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767256:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767278:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998147.767301:0:6674:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789998147.767347:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3283:x1876946713141120:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998147.767353:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00010000:00010000:3.0:1789998147.767395:0:109755:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998147.767403:0:109755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998147.767403:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713141120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789998147.767410:0:109755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e052be00/0x65b43101d592ebfe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998148.362857:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998148.376202:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998148.376248:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998148.376289:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:2.0:1789998148.376320:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998148.376325:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704650880 00000100:00100000:3.0:1789998148.376335:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704650880 00000100:00100000:2.0:1789998148.376339:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704651008 00000100:00100000:2.0:1789998148.376342:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704651008 00000100:00100000:3.0:1789998148.376387:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1404 00000100:00100000:2.0:1789998148.376387:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1711 00000100:00100000:3.0:1789998148.376397:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:2352:x1876946704650880:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998148.376397:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2352:x1876946704651008:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998148.376467:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:2352:x1876946704650880:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998148.376475:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1404 00000100:00100000:1.0:1789998148.376480:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704651136 00000100:00100000:1.0:1789998148.376484:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704651136 00000100:00100000:1.0:1789998148.376511:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704651264 00000100:00100000:1.0:1789998148.376513:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704651264 00000100:00100000:1.0:1789998148.376532:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1200 00000100:00100000:1.0:1789998148.376539:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2352:x1876946704651136:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:2.0:1789998148.377523:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2352:x1876946704651008:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1122us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998148.377909:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1711 00000100:00100000:1.0:1789998148.378437:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2352:x1876946704651136:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 1895us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998148.378448:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1200 00000100:00100000:1.0:1789998148.378472:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1201 00000100:00100000:1.0:1789998148.378486:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2352:x1876946704651264:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:1.0:1789998148.378539:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2352:x1876946704651264:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 59us (2218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998148.378545:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1201 00000100:00080000:1.0:1789998148.378569:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789998148.378575:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789998148.378579:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1789998149.132337:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1789998149.132352:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:1.0:1789998149.132361:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789998149.132438:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998149.132455:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998149.132489:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789998149.132601:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713141248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789998149.132729:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998149.132820:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a37c71d0000 going to sleep for 11 seconds 00000100:00100000:1.0:1789998149.132855:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713141248 00000100:00100000:1.0:1789998149.132866:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713141248 00000100:00100000:1.0:1789998149.132935:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1789998149.132946:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713141248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998149.132981:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789998149.133052:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ec05 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998149.133095:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ec05 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998149.133109:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ec05 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998149.133121:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a38e0fb3400, rc 0) 00000100:00100000:1.0:1789998149.133176:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713141248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998149.133187:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:1.0:1789998149.133352:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713141248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789998149.133446:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998149.133457:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789998149.133479:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789998149.133486:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998149.133496:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998149.387153:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998150.090900:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713141376:0@lo:400:kworker.0 00000100:00100000:3.0:1789998150.090968:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713141760:0@lo:400:kworker.0 00000100:00100000:0.0:1789998150.091001:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713141632:0@lo:400:kworker.0 00000100:00100000:2.0:1789998150.091375:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713141504:0@lo:400:kworker.0 00000100:00100000:3.0:1789998150.092808:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998150.093112:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789998150.093123:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713141888:0@lo:400:kworker.0 00000100:00100000:3.0:1789998150.093328:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998150.093368:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998150.093387:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713141760 00000100:00100000:3.0:1789998150.093398:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713141760 00000100:00100000:0.0:1789998150.093412:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998150.093473:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713141632 00000100:00100000:0.0:1789998150.093478:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713141632 00000100:00100000:0.0:1789998150.093513:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:0.0:1789998150.093525:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713141632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998150.093545:0:8169:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713141888 00000100:00100000:1.0:1789998150.093552:0:8169:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713141888 00000100:00100000:3.0:1789998150.093578:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:0.0:1789998150.093585:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1876946713141632:12345-0@lo:400:kworker.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998150.093594:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713141760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998150.093594:0:8169:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1789998150.093598:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1789998150.093608:0:8169:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713141888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998150.093646:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998150.093676:0:8169:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713141888:12345-0@lo:400:kworker.0 Request processed in 71us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998150.093683:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3285:1876946713141632:0@lo:400:kworker.0 00000100:00080000:0.0:1789998150.093731:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789998150.093736:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789998150.093739:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789998150.093750:0:8169:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1789998150.093751:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713141376 00000100:00100000:0.0:1789998150.093756:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713141376 00000100:00100000:1.0:1789998150.093780:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713141504 00000100:00100000:1.0:1789998150.093785:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713141504 00000100:00100000:2.0:1789998150.093798:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713142016:0@lo:400:kworker.0 00000100:00100000:0.0:1789998150.093802:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1789998150.093814:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:0.0:1789998150.093816:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713141376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998150.093827:0:6536:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713141504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998150.093841:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789998150.094037:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713141760:12345-0@lo:400:kworker.0 Request processed in 450us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998150.094039:0:6536:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1876946713141504:12345-0@lo:400:kworker.0 Request processed in 216us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998150.094056:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1789998150.094056:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00100000:1.0:1789998150.094073:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713142016 00000100:00100000:1.0:1789998150.094077:0:6536:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713142016 00000100:00100000:2.0:1789998150.094079:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3284:1876946713141504:0@lo:400:kworker.0 00000100:00100000:0.0:1789998150.094129:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c51ed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3283:x1876946713141376:12345-0@lo:400:kworker.0 Request processed in 316us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998150.094130:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1714 00000100:00100000:3.0:1789998150.094144:0:5811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713142016:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789998150.094147:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789998150.094151:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1789998150.094168:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3283:1876946713141376:0@lo:400:kworker.0 00000100:00100000:3.0:1789998150.094196:0:5811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713142016:12345-0@lo:400:kworker.0 Request processed in 55us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998150.094204:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1714 00000100:00100000:0.0:1789998150.094223:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713141888:0@lo:400:kworker.0 00000100:00100000:2.0:1789998150.094258:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713142016:0@lo:400:kworker.0 00000100:00100000:0.0:1789998150.094259:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c6b31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713141760:0@lo:400:kworker.0 00010000:00010000:2.0:1789998150.411164:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789998150.451800:0:109952:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa171aca0 20000000:00000080:2.0:1789998150.451823:0:109952:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c6968400 uarg=0000000000000000 00010000:00010000:2.0:1789998150.452307:0:109952:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a37c6ec3000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1789998150.452319:0:109952:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a37c6ec3000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1789998150.452331:0:109952:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998150.452347:0:109952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.452365:0:109952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ec05 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.452374:0:109952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.452417:0:109952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x65b43101d592ec05 expref: 18 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.452435:0:109952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x65b43101d592ec05 expref: 18 pid: 7594 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998150.452451:0:109952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109952:1876946713142144:0@lo:104: 00000100:00100000:2.0:1789998150.452523:0:109952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998150.452604:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789998150.452617:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713142144 00000100:00100000:0.0:1789998150.452624:0:8408:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713142144 00000100:00100000:2.0:1789998150.452629:0:109952:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38c395f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789998150.452814:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:0.0:1789998150.452825:0:8408:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38ffd87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109952:x1876946713142144:12345-0@lo:104: 00010000:00010000:0.0:1789998150.452837:0:8408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998150.452920:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789998150.452927:0:8408:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38ffd87850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+3:109952:x1876946713142144:12345-0@lo:104: Request processed in 104us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998150.452933:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789998150.452978:0:109952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109952:1876946713142144:0@lo:104: 00010000:00010000:2.0:1789998150.453007:0:109952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998150.453023:0:6673:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789998150.453032:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998150.453039:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38e0fb3000 already unused, calling callback (ffffffffc1aa8c20) 10000000:00010000:3.0:1789998150.453043:0:6673:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998150.453052:0:6673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789998150.453060:0:6673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789998150.453066:0:6673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1789998150.453101:0:6673:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998150.453108:0:6673:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789998150.453134:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998150.453146:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.104@tcp lock: ffff8a38e0fb3000/0x65b43101d592ec05 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x65b43101d592ec0c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789998150.453161:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998150.453164:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998150.453166:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789998150.453187:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789998150.453199:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713142272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789998150.453249:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998150.453321:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713142272 00000100:00100000:2.0:1789998150.453326:0:5796:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713142272 00010000:00010000:2.0:1789998150.453349:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ec05 expref: 19 pid: 7594 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998150.453448:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:2.0:1789998150.453457:0:5796:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3284:x1876946713142272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789998150.453543:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789998150.453549:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x65b43101d592ec05 expref: 19 pid: 7594 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453562:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x65b43101d592ec05 expref: 19 pid: 7594 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453577:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38e0fb3400/0x65b43101d592ec0c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x65b43101d592ec05 expref: 19 pid: 7594 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453589:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453598:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453618:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453625:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453635:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453642:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453648:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b3000 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998150.453777:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453787:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453806:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.453834:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789998150.453840:0:109952:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998150.453849:0:109952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998150.453853:0:109952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b3000/0x65b43101d592ec13 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998150.453899:0:5796:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c571fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:3284:x1876946713142272:12345-0@lo:103:ldlm_bl.0 Request processed in 435us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998150.453908:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1789998150.454062:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3284:1876946713142272:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789998150.973036:0:110000:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3b4033f0 20000000:00000080:2.0:1789998150.973055:0:110000:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8a37c696bc00 uarg=0000000000000000 10000000:01000000:2.0:1789998150.973317:0:110000:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1789998150.973340:0:110000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973357:0:110000:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973367:0:110000:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973374:0:110000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973382:0:110000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973389:0:110000:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973396:0:110000:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a38fb4b2800 already unused, calling callback (ffffffffc1492910) 00010000:00010000:2.0:1789998150.973400:0:110000:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973408:0:110000:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973420:0:110000:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973429:0:110000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998150.973435:0:110000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a38fb4b2800/0x65b43101d592ec1a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789998151.435975:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998152.138853:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789998152.138877:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713142400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789998152.138953:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998152.139029:0:6660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713142400 00000100:00100000:2.0:1789998152.139037:0:6660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713142400 00000100:00100000:2.0:1789998152.139110:0:6660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1789998152.139121:0:6660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713142400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789998152.139158:0:6660:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789998152.139217:0:6660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713142400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998152.139234:0:6660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00080000:2.0:1789998152.139260:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789998152.140539:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789998152.140566:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713142528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789998152.140641:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998152.141004:0:34911:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713142528 00000100:00100000:0.0:1789998152.141012:0:34911:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713142528 00000100:00100000:0.0:1789998152.142068:0:34911:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1789998152.142084:0:34911:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713142528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789998152.142125:0:34911:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789998152.142130:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998152.142226:0:34911:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1876946713142528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998152.142235:0:34911:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:3.0:1789998152.142276:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a37c571d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3282:1876946713142528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789998152.143670:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713142400:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1789998152.267751:0:5807:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1789998152.267759:0:5807:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a38c48e4d40 from 1 10000000:01000000:2.0:1789998152.267764:0:5807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789998152.267805:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592ec21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998152.267828:0:5807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592ec21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998152.267841:0:5807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592ec21 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789998152.267867:0:5807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713142656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789998152.267935:0:5807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998152.267982:0:5807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a38fa4a6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789998152.268042:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713142656 00000100:00100000:0.0:1789998152.268051:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713142656 00000100:00100000:0.0:1789998152.268112:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1789998152.268122:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+18:5807:x1876946713142656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789998152.268136:0:7594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789998152.268151:0:7594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a39020e0400/0x65b43101d592ec28 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x65b43101d592ec21 expref: -99 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998152.268175:0:7594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a39020e0400/0x65b43101d592ec28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x65b43101d592ec21 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998152.268187:0:7594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a39020e0400/0x65b43101d592ec28 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x65b43101d592ec21 expref: 19 pid: 7594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789998152.268196:0:7594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a39020e0400, rc 0) 00000100:00100000:0.0:1789998152.268258:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:5807:x1876946713142656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998152.268265:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1789998152.268449:0:5807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:5807:1876946713142656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789998152.268464:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592ec21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ec28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998152.268479:0:5807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592ec21 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x65b43101d592ec28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789998152.268501:0:5807:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789998152.268506:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592ec21 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ec28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998152.268513:0:5807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.104@tcp lock: ffff8a38fb4b3e00/0x65b43101d592ec21 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x65b43101d592ec28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789998152.459453:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789998153.482862:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789998153.496881:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:3.0:1789998153.497219:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704651392 00000100:00100000:3.0:1789998153.497231:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704651392 00000100:00100000:3.0:1789998153.497301:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1408 00000100:00100000:3.0:1789998153.497312:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:2355:x1876946704651392:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:3.0:1789998153.497394:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3408050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51d1e942-5b4f-4a8b-95c1-22b30ca307b2+10:2355:x1876946704651392:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 84us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789998153.497403:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1408 00000100:00100000:0.0:1789998153.498798:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998153.498869:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:1.0:1789998153.498973:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704651648 00000100:00100000:1.0:1789998153.498981:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704651648 00000100:00100000:1.0:1789998153.499040:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704651776 00000100:00100000:1.0:1789998153.499043:0:6659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704651776 00000100:00100000:1.0:1789998153.499067:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 685 00000100:00100000:1.0:1789998153.499076:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2351:x1876946704651648:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:1.0:1789998153.499103:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592eb95 00000100:00080000:1.0:1789998153.499113:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c53dc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789998153.499157:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1789998153.499510:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+2:2351:x1876946704651648:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 431us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998153.499518:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 685 00000100:00100000:1.0:1789998153.499538:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 686 00000100:00100000:1.0:1789998153.499545:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c7411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2351:x1876946704651776:12345-192.168.204.4@tcp:9:kworker.0 00000020:00000080:1.0:1789998153.499562:0:6659:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x65b43101d592eb8e 00000100:00080000:1.0:1789998153.499569:0:6659:0:(import.c:65:import_set_state_nolock()) ffff8a38c53db800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789998153.499592:0:6659:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1789998153.499838:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c7411c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f5c1393-0e16-400f-b0f5-cfea9bb30726+2:2351:x1876946704651776:12345-192.168.204.4@tcp:9:kworker.0 Request processed in 293us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998153.499846:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 686 00010000:00010000:1.0:1789998153.500139:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789998153.500282:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789998153.500441:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789998153.500447:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789998153.503612:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.4@tcp (source: 12345-192.168.204.4@tcp) 00000100:00100000:0.0:1789998153.504294:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946704651520 00000100:00100000:0.0:1789998153.504307:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946704651520 00000100:00100000:0.0:1789998153.504454:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.4@tcp, seq: 1715 00000100:00100000:0.0:1789998153.504469:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704651520:12345-192.168.204.4@tcp:400:kworker.0 00000100:00100000:0.0:1789998153.504557:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0f5c1393-0e16-400f-b0f5-cfea9bb30726+5:2355:x1876946704651520:12345-192.168.204.4@tcp:400:kworker.0 Request processed in 92us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998153.504565:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.4@tcp, seq: 1715 00000100:00080000:3.0:1789998153.504914:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789998154.506793:0:6673:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789998154.610194:0:110241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_25b: @@@@@@ FAIL: nodemap info differs from get_param output (2) 00000100:00100000:3.0:1789998155.211032:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789998155.211061:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713142912:0@lo:400:kworker.0 00000100:00100000:2.0:1789998155.211140:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713143168:0@lo:400:kworker.0 00000100:00100000:3.0:1789998155.211178:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789998155.211196:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998155.211249:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713143296:0@lo:400:kworker.0 00000100:00100000:1.0:1789998155.211250:0:11799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713142912 00000100:00100000:1.0:1789998155.211261:0:11799:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713142912 00000100:00100000:1.0:1789998155.211317:0:11799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:1.0:1789998155.211327:0:11799:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713142912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998155.211394:0:11799:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38f9fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1876946713142912:12345-0@lo:400:kworker.0 Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998155.211401:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789998155.211402:0:11799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1789998155.211413:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713143040:0@lo:400:kworker.0 00000100:00100000:2.0:1789998155.211443:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998155.211472:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713143040 00000100:00100000:1.0:1789998155.211477:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713143040 00000100:00100000:1.0:1789998155.211602:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:1.0:1789998155.211610:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713143040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998155.211649:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1876946713143040:12345-0@lo:400:kworker.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998155.211677:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:1.0:1789998155.211706:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713143168 00000100:00100000:1.0:1789998155.211710:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713143168 00000100:00100000:0.0:1789998155.211765:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789998155.211795:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1789998155.211799:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789998155.211803:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38fb656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713143424:0@lo:400:kworker.0 00000100:00080000:2.0:1789998155.211807:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998155.211853:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3283:1876946713143040:0@lo:400:kworker.0 00000100:00100000:1.0:1789998155.211862:0:99743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713143296 00000100:00100000:1.0:1789998155.211867:0:99743:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713143296 00000100:00080000:2.0:1789998155.211880:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789998155.211896:0:99743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1789998155.211903:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998155.211906:0:99743:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713143168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998155.212031:0:99743:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38fb657b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3283:x1876946713143168:12345-0@lo:400:kworker.0 Request processed in 128us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998155.212054:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1789998155.212056:0:12471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713143424 00000100:00100000:2.0:1789998155.212063:0:12471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713143424 00000100:00100000:1.0:1789998155.212064:0:99743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1789998155.212070:0:6659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713143296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789998155.212111:0:12471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1718 00000100:00100000:2.0:1789998155.212126:0:12471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a37c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713143424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789998155.212126:0:6659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1876946713143296:12345-0@lo:400:kworker.0 Request processed in 56us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789998155.212140:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1789998155.212158:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3284:1876946713143296:0@lo:400:kworker.0 00000100:00100000:2.0:1789998155.212211:0:12471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a37c7f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1876946713143424:12345-0@lo:400:kworker.0 Request processed in 90us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789998155.212219:0:12471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1718 00000100:00100000:1.0:1789998155.212224:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3284:1876946713143424:0@lo:400:kworker.0 00000100:00080000:2.0:1789998155.212239:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789998155.212269:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3283:1876946713143168:0@lo:400:kworker.0 00000100:00100000:3.0:1789998155.212487:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38fb654a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3285:1876946713142912:0@lo:400:kworker.0 00000100:00100000:0.0:1789998155.212753:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a38f9fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713142784:0@lo:400:kworker.0 00000100:00100000:0.0:1789998155.212807:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789998155.212906:0:7594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946713142784 00000100:00100000:1.0:1789998155.212912:0:7594:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946713142784 00000100:00100000:1.0:1789998155.212946:0:7594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1789998155.212958:0:7594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713142784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789998155.213010:0:7594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a38c3409850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8+19:3285:x1876946713142784:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789998155.213016:0:7594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:0.0:1789998155.213093:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a38f9fdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ccc31dbd-bc3a-4b6a-b9bf-cf212de4eda8:3285:1876946713142784:0@lo:400:kworker.0 00010000:00010000:0.0:1789998155.531116:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 73491 lines, 73491 kept, 0 dropped, 0 bad.